It's partly the pain of having to filter that's the issue,
But I also think that providing a 403 response to the bad guys trying to trawl the sites is giving them more respect and information than they merit, plus requires more server resource. A 444 that just slams the connection shut with no content returned is much more effective to my mind as a "f**k you", you never know it may even discourage some of them from bothering my server.
So if I do decide to go that path, would an edit of locations-wo.conf be appropriate, or is there a better method?