Madhu Shantan

Madhu Shantan

User Simulation in AI: From Rule-Based Models to LLM-Powered Realism

User Simulation in AI: From Rule-Based Models to LLM-Powered Realism

What if you could test your AI system with thousands of diverse users without recruiting a single person? User Simulation makes this possible. Simulating human users - a fundamental application of AI has driven progress in both research and industry. By allowing machines to imitate real user interactions, user simulation

Do Language Models Know That They're Being Evaluated?

Do Language Models Know That They're Being Evaluated?

Picture this scenario: You’re very new to AI, exploring chatgpt by testing its capabilities on various topics, expecting honest answers unaware that behind the scenes, it already figured out that it’s being tested and is subtly changing its behaviour to ace your tests. This feels like a subtle

AlphaEvolve : AI for Scientific Discovery

AlphaEvolve : AI for Scientific Discovery

Introduction Consider a scenario: You're facing a complex optimization challenge with no known solution - the kind that requires inventing entirely new algorithms, not just tweaking existing ones. There's no textbook answer, no established approach. Existing coding models like Claude, Gemini 2.5 can implement known