Bloomberg’s Report According to, Ziroh Labs has received technical support of IIT Madras in this project. Together, the two want to show that AI is not just a game of data centers with rich resource, but also in a mid-range laptop, LLMS such as Meta’s Llama 2 or Alibaba’s Qwen2.5 can easily run.
The company also recently showed a demo in which these models were seen walking on laptops with Intel Xeon processor. Neither GPU, nor any cloud cost, just local computing. Ziroh Labs says Kompact AI can prove to be a game Changer for individual developers, college projects and short startups that were far from big models due to hardware limitations.
Kompact AI is currently in a private testing phase, but the company has made it clear that its aim is to give more and more developers a chance to explore AI in open-source style, without fear that they do not have GPU.
This move of Ziroh Labs has come at a time when both GPU shortage and prices are increasing worldwide. In such a situation, if a system can run a big model only on the basis of CPU, then it can become a root-breaking solution not only for India, but for the entire AI industry. Now it will have to be seen how scalable and developer-friendly Kompact AI can be made.