The Millennium Madejski Hotel just off the M4 junction 11 is good, has a pool and sometimes has offers. Closer in to the centre is the Marriott Renaissance which also has a pool.
Even in January, it's worth checking late rooms for February, type in Reading and see what it comes up with.