After creating a simple example of natural language to SQL translator with the OpenAI API, this weekend, I extended my POC to open-source models with the Hugging Face API. The good news is that it is straightforward and simple to work with the API and get decent output. On the other hand, it is very slow to run locally. Any tips, articles, or examples on how to improve the model performance when running it locally? Thx!
