That’s something i’ve been occasionally experiencing with my Amerano usb as well. Though it’s a kernel related problem, because switching to pulse does not solve it, booting up a 18Lts iso does.
In fact it’s a bit better on pipewire and you can also experiment with a low latency kernel.