It might be an alternative, which is probably why it appears in that dictionary, but that does not mean it is correct in the UK.
The register is the set of actual records and the register office is the place where they are kept. One could call the building the 'registry', but not the 'registry office'.
Registry office is in common usage in the USA, but you know what they're like.
🙂