ovid, One of the biggest issues with LLMs today is their massive power consumption needs, along with performance. To entrepreneurs, these are opportunities, not problems. As a result, there are two new developments in AI which you should know about.
The first is silicon-photonic (SiPh) chips. They use light instead of electrons to perform mathematical calculations. Details are scant, but they appear to be faster than GPUs & use less memory. https://blog.seas.upenn.edu/new-chip-opens-door-to-ai-computing-at-light-speed/
1/2