As someone from Texas, these are disgusting, and people driving this garbage are not friendly towards pedestrians at all. They have no self awareness sitting inside these killing machines.
The only reason for 99.9% of people to drive this garbage is to feel big when on the road. How petty.
You absolutely can go have lunch elsewhere. I’ve been in similar situation. If asked, you can simply tell them, I enjoy having lunch by myself, it helps me recharge. Also, most of the time, boundaries are set through action not only words. Just do what you prefer without the concern of what others will think or feel, while being polite with your words. Most people will pick up on you actions and eventually leave up be. I’ve had serious boundary issues in my family and I’ve had to learn quite a bit about forming proper sustainable boundaries.