It’s good be investing in Naveen & team again! I led the first investment in his last company, Nervana, the pioneer in dedicated machine learning chips which Intel acquired and promoted Naveen to run all AI work at Intel. He left to help democratize corporate access to cutting edge machine learning. His new company, MosaicML came out of stealth today. In short, Mosaic improves ML training efficiency algorithmically. By integrating the latest advances from academia and industry and testing on diverse hardware platforms, their mosaic of methods has already seen a 4x improvement in the price/performance of ML training. We expect ππ°π΄π’πͺπ€βπ΄ ππ’πΈ to continue for the near future, where learning/$ quadruples every year.
β’ Founder’s blog: https://www.mosaicml.com/blog/founders-blog
β’ Forbes: “Given the increasing cost and environmental impact of AI computation, his timing may be perfect once again. Rao believes he and his team can spread a revolution in training AI models by offering model optimization as a service.” β https://www.forbes.com/sites/karlfreund/2021/10/13/ai-startup-mosaicml-comes-out-of-stealth-to-aid-ai-developers/?sh=5b29cc7436e5
P.S. The improvement of algorithms outpacing Mooreβs Law reminds me of conversations I had with Jesse Levinson , co-founder of Zoox, about computer chess: the improvements to Stockfish algorithms outpaced hardware improvements over 2014-2017. And 10 years earlier, in 2007, Geordie Rose , co-founder of D-Wave, gave a more stark comparison from the domain of factoring integers: the latest algorithm running on a 30-yr old Apple ][ would beat the 30-year old algorithm running on an IBM Blue Gene/L (the supercomputer of the day). And in quantum computing, algorithmics advances are so important, they carry the names of their inventors (Shor, Grover, etc.)
Leave a Reply