Lightbits Labs®, inventor of NVMe® over TCP and the Inferra™ KV cache acceleration engine for AI inference, today announced the appointment of former Infineon executive Ramesh Chettuvetty as Senior Vice President of Product and Business for AI Solutions. Chettuvetty will drive the business forward and build the playbook for Lightbits’ AI solutions in the next generation of data centers and NeoClouds, ensuring that the company’s technology solves hardware efficiency and performance challenges faced by organizations running GPU-heavy workloads. Central to this role is Inferra by Lightbits, a fully optimized KV cache engine designed to eliminate GPU stalls in long-context AI inference.
The appointment comes as NeoCloud providers face growing infrastructure challenges tied to long-context LLM inference workloads, including GPU memory bottlenecks, KV cache scaling limitations, and rising infrastructure costs. Inferra is designed to address these constraints by enabling disaggregated KV cache architectures that reduce GPU stalls and expand context window scalability beyond traditional GPU memory limits.
“Lightbits is currently working with NeoCloud providers evaluating high-performance scaleout software-defined architectures for long context, high-density GPU environments,” said Eran Kirzner, Co-Founder and CEO of Lightbits Labs. “Ramesh brings deep business and technology expertise across memory systems and AI infrastructure that will help accelerate Inferra’s adoption as a high-performance backend for modern inference environments.”
Inferra effectively breaks the memory wall by enabling practically infinite KV cache capacity through smart tiering and pre-fetching algorithms, allowing context windows to scale from 32K to 1M tokens in production systems today, and to expand to 10M tokens in the next generation of production systems without scaling HBM. Inferra enables NeoCloud operators to:
- Accelerate Time to First Token (TTFT) and reduce Inter-Token Latency (ITL),
- provide per-agent Quality of Service with SLAs,
- scale context windows with a path to 10M tokens for next-gen production systems,
- while improving GPU utilization,
- and reducing dependence on costly HBM capacity expansion.
- Chettuvetty will be instrumental in positioning Inferra as a foundational infrastructure layer for next-gen AI inference environments built on state-of-the-art GPU technologies.
“I am excited to join Lightbits at this pivotal time,” said Ramesh Chettuvetty. “Inferra directly addresses one of the most critical bottlenecks in AI inference — scalable KV cache management. Combining Lightbits’ proven software-defined storage leadership with next-generation AI inference infrastructure creates a compelling opportunity.”
For more information on the Lightbits leadership team, go to: https://www.lightbitslabs.com/company/. For NeoCloud providers and GPU cloud operators interested in evaluating Inferra, visit Lightbits Labs AI Solutions or schedule a technical briefing with the Lightbits engineering team.
Additional resources:
- Coredge Selects Lightbits to Power AI Cloud Services Infrastructure
- Lightbits Labs Named to Forbes’ List of America’s Best Startup Employers
- Lightbits Labs Sweeps Industry Awards in Recognition of Their Critical Role in Data Infrastructure Modernization
About Lightbits Labs
Lightbits Labs (Lightbits®) is the inventor of the NVMe over TCP storage protocol, which is natively built into its industry-leading block storage, and the first KV cache prefetch engine acceleration for AI. Lightbits data storage solutions are engineered to deliver unmatched high performance and maximum hardware efficiency for LLM inference, real-time analytics, and transactional workloads at scale. Lightbits is backed by enterprise technology leaders [Cisco Investments, Dell Technologies Capital, Intel Capital, Lenovo, and Micron] and is on a mission to deliver best-in-class, cost-efficient storage systems for performance-sensitive workloads at scale.
To learn more about Lightbits Labs, visit https://www.lightbitslabs.com/ and follow Lightbits Labs on Linkedin, X, Facebook, Instagram, and YouTube.
Lightbits, Lightbits Labs, LightOS, and Inferra are registered trademarks of Lightbits Labs, Ltd.
View source version on businesswire.com: https://www.businesswire.com/news/home/20260519631637/en/
Media gallery
