the problem with swarming, especially in a neighborhood, is that those bees are going to end up somewhere. usually somewhere they are not wanted. fair or not, the closest beekeeper will get the blame for the cost of removals, etc. better to try to avoid the problem with some early intervention. it won't always work, but it is better than doing nothing.