If the bees are fighting, it's a sure sign of robbing. That is the best way to tell the difference between,
"robbing" and playflight/oreintation flights.
It could still be hot in the hive, and from this time till dark more field are returning and some will take up, hanging out on the "front pourch".
Main thing is to watch for fighing.
If they are not fighting not to worry too much if you're sure they have plenty of room.
Some time the only sign of swarming will be inside the hive in the form of a queen cell.
Hope this helps.