"a combination of a simple compressor like gzip with a k-nearest-neighbor classifier ... outperforms BERT on all five OOD datasets, including four low-resource languages. Our method also excels in the few-shot setting, where labeled data are too scarce to train DNNs effectively."
