No experience of ADs but my DH has taken meds for stress, me too.
If your GP has prescribed ADs then they must think it's needed and will help. As long as you have a GP who listens. If no other dads come along to talk about this I would suggest you go back to GP and talk about any concerns you have about taking them.