It irks me to the core when I am hosting something at my house and the people that we invite bring other people. My family does this the most.
Like you said if I am inviting you to my personal space, I have specifically planned something with you in mind.
That is my trauma talking though.