Always happy to see new MLOps books! The DevOps for Data Science is a new book by Alex K Gold. As the name implies, the book focuses on topics related to DevOps for data scientists. This includes the following:
✅ Command line
✅ Working with Linux systems
✅ Docker
✅ Scaling resources
✅ Network, domains, DNS, SSL, etc.
✅ Authentication
Andrej Karpathy released today a tutorial for reproducing GPT-2 from scratch. OpenAI released GPT -2 in 2019, and it is a 124M parameters model. This four-hour tutorial covers setting up the GTP-2 network and then training and optimizing its parameters.
It looks like a really cool tutorial; I hope to get the bandwidth to watch it in the coming weeks!