The only reason this should be talked about critically is if someone is doing it to leave work to their partner, otherwise, it's no-one else's business. Aside, I guess, if someone's doing something else while in there; porn if that's non-negotiable for you, or being unfaithful.
Otherwise, butt out, it's just not your business or something to try to control. Yes, they may be 'avoiding family life', but who doesn't at times, and why is that wrong? My wife would often like to sit upstairs in the bedroom, or have a 90min bath when we had young kids, cos everyone needs a break sometimes.
I didn't assume she was texting someone she shouldn't, or feel she was off-loading the kids on me. Time on your own, however it's taken, is important, whether or not it's in a way you'd choose.
That's not even including, that some people take longer to have a bowel movement than others, diagnosed medical condition or not.
There's a ton of stuff to judge men about, this is just ridiculous however, unless it's part of a bigger problem.