That’s the extreme minority. To keep things simple let’s just say xx one bathroom and xy the other. That encompasses 99.9% of bathroom usage. For the cases you are talking about I’m sure that person can figure out what bathroom to use for themselves and explain it to anyone that asks.