Avatar

Krishna Kant Chintalapudi, PhD

Senior Principal Researcher

LLM Inference Efficiency & Agentic Systems

Microsoft M365 Research
(formerly at Microsoft Research, 2009–2026)

About Me

I am a Senior Principal Researcher at Microsoft M365 Research, where I am the tech lead and architect for end-to-end inference efficiency of agentic workflows: workflow characterization, orchestrator–inference engine co-optimization, KV-cache management and novel methods for efficient inference.

My recent AI work includes task-specific LLM compression (LLM-Sieve: 20–75% parameter reduction at ≤1–5% accuracy loss) and prospection-guided agentic memory (EMNLP 2026), which introduced the public MemoryQuest benchmark.

Machine learning has run through my whole career. I started with neural-network pruning and feature selection (1997–99), and my best-known systems work on indoor localization (EZ, Zee, Centaur) is built on Bayesian inference, particle filters and custom optimization. Over 20 years at Microsoft Research and Bosch I have turned research into shipped systems, including Azure ML labeling (~10× cost reduction) and the next-generation Xbox controller protocol (5× lower latency).

I have published 50+ peer-reviewed papers with 9,500+ citations, hold 30+ US patents, and received the ACM Test of Time Award in 2022. I have mentored researchers who are now faculty at UIUC, Cornell, NYU, Georgia Tech and UC Irvine, and served on the FCC Technological Advisory Council AI Working Group (2022–23).

Background

I joined Microsoft M365 Research in 2026. Before that I was a researcher at Microsoft Research Redmond (2016–2026), Microsoft Research India (2009–2016), and the Bosch Research and Technology Center in Palo Alto, CA (2005–2009).

I graduated from the University of Southern California with a PhD in Computer Science in 2006, advised by Prof. Ramesh Govindan. Before my PhD I obtained a Masters in Electrical Engineering (Signal Processing and Control Systems) from Drexel University and a B.Tech in Electrical Engineering from IIT (BHU) Varanasi.

Research Interests

  • Efficient LLM inference
  • Agentic systems and memory
  • Machine learning systems
  • Networking
  • Internet of Things

News

  • 2026: "Thinking Ahead: Prospection-Guided Retrieval of Memory with Language Models" accepted to EMNLP 2026 (main conference). Paper · MemoryQuest benchmark
  • 2026: Joined Microsoft M365 Research to lead inference efficiency for agentic workflows.
  • 2025: LLM-Sieve, task-specific pruning for LLMs. Preprint
  • 2024: ADR-X and Cloud-LoRa published at NSDI 2024.
  • 2023: SIGCOMM paper "Ekho", on millisecond-level synchronization of cloud-gaming audio streams over the internet, covered by MIT News, Tech Times and New Atlas.
  • 2022: Received the ACM Test of Time Award.