Personally, I don't think you need to resume feeding. BUT, the girls will draw out foundation more quickly when being feed.
In the brood frames there is some pollen and some honey around the edges and lots of empty cells in the middle. There are a few capped cells in the brood area but I'm not experienced enough to know if they are brood or something else. However, there aren't very many of them.
but then you say
Will the queen act this way due to being smoked? Or is she just looking for a place prepared for her to lay which doesn't exist?
indicating she has no open broodspace.
So, does she have open brood space, or not? You don't mention, but I'm wondering if all the brood is in the second box, or split between the first and second. Also (in a BTW) you may want to put a queen excluder on between the second and third boxes unless you don't mind her moving up. She's not guarenteed to, but she could without the excluder.
You mention 'empty cells', are you sure there are no eggs in them? Eggs are very difficult to see if you have't seen them before, once you know what you're looking for (at) you'll be able to recognize them. Reading glasses could help magnify if needed.
If the bottom box is empty of brood, you could reverse the first and second boxes. The queen will tend to move up and this gives her an open brood area again (if it in fact is open right now).