Well yes,
Irish migrants to England and Scotland experienced anti-Irish prejudice and anti-Catholic prejudice. It's why the politics of Liverpool and parts of Scotland are kind of complicated because a lot of the people there are descendants of Irish migrants so there's that heritage and sometimes continuing tensions as a result (being called Fenian, Rangers versus Celtic).
The example of the difference between how the Irish were viewed and how the Scottish and other British people were viewed would be the response to the Potatoes blight. Scotland was hit by a potatoe famine first. In discussing policy for the Highland Potato Famine on 20 September 1846, Trevelyan wrote: "The people cannot, under any circumstances, be allowed to starve." There were extensive relief works and aid poured in and, though many emigrated, there was no huge death toll. Although he had a laidsez faire approach to economics in general, he was not prepared to let people die for it. This was very much NOT Trevelyan's policy when the potatoes famine hit Ireland. A big part of this is that the Irish were viewed as more feckless/less deserving than the rest of the UK (including Scotland). It was prejudice basically
Of course, lots of people now in Scotland and England have ancestors affected by the Irish potatoe famine because many people emigrated to avoid starvation. But my point was that the attitude towards the Scottish/English/Welsh at the time (including the often maligned working classes) was different to the attitude towards the Irish. Incidentally the British government had a legal responsibility not to let citizens starve to death since 1602. Even though Ireland was officially part of the UK, it was viewed and treated differently.
Of course,.Irish landowners and Irish aristocrats also had a part to play. But that's a whole other complication.
I have Irish and Scottish and Welsh blood. Am I a victim or an evil oppressor? Is this a matter of (as someone else suggested) my accent? I don't have a chip on my shoulder. I just think history's important.