IIT Madras-backed AI4Bharat and Josh Talks AI announced the launch of Voice of India, the country's first independent multimodal artificial intelligence evaluation platform. The platform was launched at an event in New Delhi in the presence of S. Krishnan, Secretary, Ministry of Electronics and Information Technology. According to reports from Business Standard, the platform is designed to assess AI systems under real-world Indian conditions, addressing a critical gap in India's AI ecosystem. Professor Mitesh Khapra of AI4Bharat at IIT Madras emphasized that India has a unique opportunity to build AI for the world while helping define how the world measures it, stating that "Evaluation determines what gets built."
The platform introduces a comprehensive three-stage evaluation framework comprising constituent model evaluation, end-to-end deployment evaluation under real operating conditions, and periodic post-deployment audits. As reported by Business Standard, this framework enables organizations to assess not only how AI performs in controlled environments but also how it performs for real users in real-world scenarios. The platform provides scientifically rigorous, India-specific evaluations that reflect how AI is used across the country, rather than relying solely on performance metrics or benchmarks developed for Western contexts.
The Voice of India AI Evaluation Platform will evaluate models across voice, speech translation, long-document processing, including accuracy, cultural appropriateness across Indian languages and legal reasoning. According to the joint statement, the platform will be a new layer in India's AI ecosystem building on top of AI models, compute infrastructure and language technologies. The platform introduces a suite of benchmarks under the Voice of India framework, including a finance-focused benchmark for assessing AI performance across key banking workflows. The collaboration between AI4Bharat at IIT Madras and Josh Talks AI aims to serve the broader AI ecosystem across government, enterprises, academia and industry.
Following the Voice of India launch, Ministry of Electronics and Information Technology Secretary S. Krishnan announced that the government will meet senior global executives from Meta on Wednesday to address multiple concerns. According to The Times of India, the meeting will focus on Meta's handling of child sexual abuse material (CSAM), concerns surrounding WhatsApp usernames, and treatment of prominent verified accounts. Krishnan stated that the government will question Meta about measures taken to tackle CSAM, protocols for synthetically generated information, and safeguards for content takedowns of prominent personalities. Earlier this week, the government sent a summons to Meta's president of global affairs Joel Kaplan, asking him to explain the company's content moderation policies after Meta apologized for unintentional takedown of Modi's post.
