YOU CAN'T BE SERIOUS. His point is, like, TOTALLY valid. I know Broken Hills humans hate me, so encounters with them should pull an outdoorsman check on my face. Yet those ol' innocuous encounters should be skippable. It's realistic. You're walking around the desert and you see one of those monks jerking off. You say "Ah, it's just a dude... I'll leave him be". OFC, these "innocuous" encounters offer a possibility to another player to arrive and maybe do some massacrin'. Who would want THAT? I wouldn't. Skipping the encounter is the same thing as passing beside them NPCs without even sayin' "Hi".
There is a chance that in this innocuous looking encounter you end up in one of those secret cavel maps, with the bunch of neat stuff. We'll just assume that people skipping the encounter are aware of this.