“They left their wallet on the table” it sounds like you’re referring to multiple people instead of a singular person.
Does it? If multiple people left multiple wallets on the table, it would be, "They left their wallets on the table." Multiple people can't really leave a single wallet behind. Or at least that would be very unusual and unintuitive.