cheap but clean and central is Hotel du Dragon, rue Du Dragon, I found it about 12 years ago through Lonely Planet guide books, and then we stayed in it about 5 years ago.
www.hoteldudragon.com
dont bother with breakfast, bakery in the street, much yummier.