Gimlet Labs, founded by Stanford adjunct professor and serial entrepreneur Zain Asgar, has raised an $80 million Series A led by Menlo Ventures to tackle inefficiencies in AI inference. The company has developed a “multi-silicon inference cloud,” a software layer that enables AI workloads to run simultaneously across diverse hardware, including CPUs, GPUs, and high-memory systems.
The platform distributes different stages of AI workloads across the most suitable hardware, addressing limitations where no single chip can efficiently handle all processes. Gimlet Labs reports performance gains of three to ten times at the same cost and power by optimizing underutilized infrastructure, where current usage levels are estimated between 15% and 30%.
Co-founded by Michelle Nguyen, Omid Azizi, and Natalie Serrino, the company has partnered with NVIDIA, AMD, Intel, Arm, Cerebras, and d-Matrix, targeting large AI labs and data centers with its software and cloud-based offering.
Featured image: Credit: Gimlet Labs
