BIML believes that reproducibility economics is a serious risk to scientific study of #ML.
"Mensch said his new model cost less than €20 million, to train. By contrast OpenAI Chief Executive Sam Altman said last year after the release of GPT-4 that training his company’s biggest models cost “much more than” $50 million to $100 million."
Which academic CS organizations have a "mere $22M" to build an LLM to experiment with. How can you try alternatives?
