So sorry for your loss, its a huge thing to come to terms with, and i imagine you have so many emotions at this time to deal with.
The advice I give to my patients relatives, is that it is something that you can only do now. You won't be able to go back on the decision of not going to see him. You very well might regret not seeing him, and in my experience, people rarely - if ever, regret actually seeing a loved one after they have passed away, but do regret not going to see them.
I think its quite an important part of the grieving process. Its a time to really say goodbye, and come to terms with whats happened. To coin an Americanism, its 'good closure'. I realise that may sound callus, not intended that way.
The thoughts that some people have mentioned here, and that you might be thinking, that you'd rather remember him how you last saw him, ad how he was in life, but, honestly, those memories do prevail. The image of being with him in the chapel of rest, will also stay with you, but will always be overridden by the happy memories.
He will have been looked after, after he died, and honestly won't be 'going off'. He'll very probably look paler than he would have done, but he will look like he's asleep, and at peace. Seeing this can be such a help to come to terms with losing someone so suddenly, and in the case of someone who has died following a long illness, it also helps to see them finally at peace.
To give you a further idea of what you will see if you go to see him, depending if he is laid to rest in the hospital chapel of rest, or a funeral parlor. If its the latter, they usually dress the person in some of their own clothes if possible. They sometimes put a little bit of makeup on, so that they don't look quite so pale, on the cheeks and lips. Its not in a grotesque way,always very subtle and you may not even notice.Often they will shave the face of a man ( if requested by loved ones) so he looks his best, and brush his hair.
I am really sorry if the last paragraph was to much for you to think about, only I thought having a little more information on what happens, might help you be prepared, should you decide to go.I'd hate to think you didn't go, purely because you were scared or unsure of what you might see.
Sorry there are no definitive answers really. Its such a sad and difficult time for you. I hope that some of what i've written can be of some help.
Take care, and try to remember, that what ever you decide to do now, will be the right thing for you to do. Even if, in a few months time, you look back and think you would have done things differently. The decision you make will be based on how you feel now, and therefore, will always be the right thing to have done.