Skip to main content
Add as a preferred source on Google


Lemony Introduces On-Prem AI Device for Enterprises

  • By John K. Waters
  • 10/08/25

Artificial intelligence startup Lemony has launched a hardware-based device designed to enable enterprises to run generative AI systems on premises without relying on the cloud.

The product, branded as "AI in a Box," is a small, stackable node that can host large language models, adapters, and AI agents while keeping data within an organization's local network. Each unit supports up to five users and can be combined into clusters to scale across departments.

Lemony said its approach is aimed at organizations reluctant to use cloud-based AI due to concerns over data privacy, compliance, and regulatory requirements. The nodes come preloaded with 16 open source models, including IBM's Granite family and Meta's Llama, and can be updated quarterly via a USB connection.

Partnerships with IBM, JetBrains, and Carahsoft support the launch. IBM will make its enterprise AI models available on the nodes, JetBrains will integrate its development tools, and Carahsoft will distribute the devices to U.S. government and healthcare customers.

The company said the devices are already being used in industries such as legal, finance, government, and healthcare. Lemony also highlighted their use in situations where teams want to share AI-driven knowledge internally while maintaining access controls.

The product is priced at $499 per month per node, including hardware, software updates, and support, with discounts for additional units. A two-week trial is available through the company's website.

Lemony has raised $2 million in seed funding led by True Ventures. For more information, visit the Lemony site.

About the Author

John K. Waters is the editor in chief of a number of Converge360.com sites, with a focus on high-end development, AI and future tech. He's been writing about cutting-edge technologies and culture of Silicon Valley for more than two decades, and he's written more than a dozen books. He also co-scripted the documentary film Silicon Valley: A 100 Year Renaissance, which aired on PBS.  He can be reached at [email protected].

Featured

  • Neon blue security locks with a single red highlight

    AI Shifts Cybersecurity Focus from Finding Flaws to Fixing Them

    For decades, one of cybersecurity's most difficult challenges has been finding vulnerabilities before attackers do. A growing number of security professionals now say artificial intelligence is changing that equation, shifting the focus from discovering flaws to fixing them quickly enough to prevent exploitation.

  • robot hand holding stacks of coins

    Designing AI Systems for Financial Aid

    Financial aid offices have been slow to adopt AI, risking technological stagnation at a critical early student touchpoint. Systematic AI integration can improve student experiences and strengthen institutional positioning.

  • silhouette of business person facing wall of data

    Why AI Strategy Belongs in the President's Office

    Institutions that are succeeding with AI share one thing in common, and it is not a better committee, a larger budget, or a more sophisticated technology stack. It is a president who never handed off the steering wheel.

  • digital brain with network connections

    Microsoft Moving to Internally Developed AI Models in Office Apps

    Microsoft is reportedly using its own in-house artificial intelligence models to handle some workloads in Excel and Outlook, offering new evidence that the company is moving its AI strategy beyond model development and into large-scale cost reduction.