What if I can’t afford those things, still eat rice and beans, but I tell people I’m vegan to avoid awkward social interactions?
But would you? Would you really turn down free food simply because you're vegan? Would you really tell people you're vegan to avoid an "awkward social interaction" when offered free food? If so, that makes you privileged. Being able to pick and choose food makes you privileged, whether it's vegan or not. That's the difference.