Does anyone know of a book in a Scottish castle with a boy and some ghosts..

[working9while5]

They move the castle from Scotland to America midway through?

I read it as a child but can't remember much more about it and would love to read it again!

I was going to say The Boggart by Susan Cooper, but not sure. Does this sound like it?