If you're going to go the controllable method, and you don't want townies to come in while you're buying, you could set the very front door to be household & employees only. That way, it'll be more realistic in that only the factory owner is buying the merchandise, not some random townie off of the street.
Won't help, visitors "spawn" inside areas they normally can't even physically get to when you visit community lots.