Lemony Introduces On-Prem AI Device for Enterprises
- By John K. Waters
- 10/08/25
Artificial intelligence startup Lemony has launched a hardware-based device designed to enable enterprises to run generative AI systems on premises without relying on the cloud.
The product, branded as "AI in a Box," is a small, stackable node that can host large language models, adapters, and AI agents while keeping data within an organization's local network. Each unit supports up to five users and can be combined into clusters to scale across departments.
Lemony said its approach is aimed at organizations reluctant to use cloud-based AI due to concerns over data privacy, compliance, and regulatory requirements. The nodes come preloaded with 16 open source models, including IBM's Granite family and Meta's Llama, and can be updated quarterly via a USB connection.
Partnerships with IBM, JetBrains, and Carahsoft support the launch. IBM will make its enterprise AI models available on the nodes, JetBrains will integrate its development tools, and Carahsoft will distribute the devices to U.S. government and healthcare customers.
The company said the devices are already being used in industries such as legal, finance, government, and healthcare. Lemony also highlighted their use in situations where teams want to share AI-driven knowledge internally while maintaining access controls.
The product is priced at $499 per month per node, including hardware, software updates, and support, with discounts for additional units. A two-week trial is available through the company's website.
Lemony has raised $2 million in seed funding led by True Ventures. For more information, visit the Lemony site.
About the Author
John K. Waters is the editor in chief of a number of Converge360.com sites, with a focus on high-end development, AI and future tech. He's been writing about cutting-edge technologies and culture of Silicon Valley for more than two decades, and he's written more than a dozen books. He also co-scripted the documentary film Silicon Valley: A 100 Year Renaissance, which aired on PBS. He can be reached at [email protected].