In the book (sorry!) Valjean doesn't go back to Digne.
Having seeing the musical several times it made me wonder just how did Valjean know he was going to die. Was he ill?? When I saw it most recently, after about 8-9 years, the thought occurred to me... does he actually commit suicide in some way because he is so convinced of his impending death?? This bit of the musical bothered me somewhat.
Book Spoiler alert.....
After Valjean tells Marius the truth about his past they agree that Cosette won't see Valjean anymore. But Marius softens slightly and afterwards does let Valjean come to see her at his grandfather's house. Cosette sees Valjean in a grotty room in the basement which is gradually made more and more uncomfortable for him by Marius (who is acting like an arse), but Valjean never complains. I think Cosette asks Valjean at one point, why doesn't he see her in the main house, but he insists he is happy to see her there.
One time Valjean goes to visit Cosette, her and Marius are out, but she has forgotten to tell him. Valjean's visits after this become less frequent. He feels that Cosette has forgotten him.
There is an utterly heartbreaking description of Valjean going to visit Cosette, then turning back as he reaches the doorstep. Next time he only gets as far as the gate. The time after that, a few houses away. He is unable to bring himself to see Cosette as he is afraid of being rejected. Valjean is like a pendulum gradually coming to a stop as he eventually never makes it out of his own house.
Cosette notices that she hasnt seen Valjean for quite some time, so goes to see him, but he tells the housekeeper to say that he's "gone away".
He stops eating, and eventually stops drinking. He is dying of a broken heart.
Then Marius and Cosette learns the truth about Valjean and they rush to be with him. Cosette "forbids him to die" (sob). He is asked if he requires a priest, but he points heaven wards, indicating that he already has one - the Bishop of Digne(sob sob).
His "last confession" is a letter to Cosette detailing the manufacturing process for the black beads his factory made. Not his life history
.
And that's pretty much it.
I was surprised at the way the TV series had him return to Digne when the rest of the series had been so faithful to the book.