Why is there stigma behind usage of ‘ y’all ‘ from non american native english soeakers, but bri’ish equivalent of ‘you lot’ is perfectly fine?

I even have had americans telling me to stop use y'all lol. Is the southern vernacular looked down that hard?

'You lot' feels quite rude while y'all carries (imo) much more casual friendly implication.