Yes, I would say all is common right now. I've seen that happen too in my hive.
As a matter of fact, as I tool a frame out of my hive today to look around in the super, I later found a wasp with its' head in a cell drinking up honey that was yet to be capped. I quickly shoo'ed that one away.
Depending on your weather, you might think about an entrance reducer to allow the bees to protect the hive a little better.