Klee and the others went off to play, and Jiang Chen simply decided to wander around as well.
The reason he let Klee go off on her own was simply that if he tagged along, the little girls wouldn't be able to play to their heart's content.
Since they were out to have fun, it was only natural to let them enjoy themselves however they pleased.
Chapter 344