AI Investment Trends and Large Language Model Challenges

Microsoft, Google, and Meta are making unprecedented bets on AI infrastructure. Microsoft alone plans to spend $80B+ in 2025. By 2027 their collective AI infrastructure investment could exceed $1T. The assumption driving these investments: bigger models equal better AI. But here’s the data: → OpenAI's Orion model plateaus after matching GPT-4 at 25% training → Google's Gemini falls short of internal targets → Training GPT-3 uses about 1,300 megawatt hrs of electricity, equivalent to the annual needs of a small town → Next gen models would require significant energy resources The physics of computation itself becomes a limiting factor. No amount of investment overcomes these fundamental barriers in data, compute, and architecture. Researchers are pursuing new architectures to address the limitations of transformers: → State Space Models excel at handling long-term dependencies and continuous data → RWKV achieves linear scaling with input length versus transformers' quadratic costs → World models, championed by LeCun and Li, target causality and physical interaction rather than pattern-matching DeepSeek’s efficiency breakthrough reinforces this trend: AI’s future won’t be won by brute force alone. Smarter architectures, optimized systems, and new approaches to reasoning will define machine intelligence. These constraints create opportunities. While tech giants pour resources into scaling existing architectures I’m watching for founders building something different.

Spending 10,000 hours mastering today's AI might be the equivalent of becoming a BlackBerry power user in 2006. The question is whether that comparison holds. Current large language models are probability engines. They predict plausible text based on statistical patterns, not reasoning from first principles. This isn't a bug to be patched; it's the mathematical foundation of how they work. Every new model generation refines this architecture rather than replacing it. The optimists point to emergent capabilities like chain-of-thought as evidence of deeper understanding. A more sober view suggests we're witnessing the perfection of mimicry, not the birth of reason. If that limitation persists, the practitioners logging thousands of hours in cognitive combat with these systems are building durable expertise. Their skill isn't in operating today's specific models but in maintaining intellectual independence from any probability-based system. That capability becomes more valuable as mimicry becomes more convincing. But what if a genuine architectural breakthrough arrives? Neuro-symbolic AI, causal reasoning models, systems that verify rather than predict. The commercial incentives don't obviously point that way. A probabilistic solution is far more saleable. Instant, confident, plausible answers create an efficient illusion of competence. A system built on verifiable reasoning would be slower, openly uncertain, requiring constant audit. The market typically chooses the former. This creates several unresolved tensions: 1. Are senior leaders who've never spent hundreds of hours with LLMs able to evaluate the expertise of those who have? 2. Is the skill being built something transferable across paradigm shifts, or highly specific to today's architecture? 3. Do the commercial incentives make probabilistic AI's persistence more likely than a fundamental breakthrough? This week's article examines whether today's investment in AI mastery is strategic foresight or wasted effort on the cognitive equivalent of manual spark advance.

HCLTech has led a ₹2,490 Crore funding round into Sarvam AI, valuing the Bengaluru-based startup at an astonishing ₹12,450 Crore. India’s AI ecosystem has just crossed its biggest psychological milestone yet. For years, India was seen as the world’s AI talent factory, supplying engineers to Silicon Valley while foundational models were built elsewhere. That narrative is now changing. Now, India is building its own intelligence infrastructure. ✅ India’s AI Funding Boom Has Officially Arrived 1. The Sarvam AI deal sits at the centre of a historic capital wave. 2. Indian AI startups collectively raised over ₹32,700 Crore in Q1 2026 alone, the strongest AI funding quarter in the country’s history. 3. The real product isn’t a chatbot. It’s sovereignty. Sarvam AI is developing Sarvam-105B, a foundational large language model optimised for all 22 official Indian languages. 4. Today, global LLMs are fundamentally English-first. Indian languages are expensive to process, inefficient to tokenise, and poorly optimised in most Western AI systems. Sarvam is attacking that exact gap. ✅ The Technical Edge: - Mixture-of-Experts (MoE) architecture for lower inference costs - Indigenous tokenisation optimised for Indic scripts - Lower compute cost per query - Better contextual understanding of regional languages ✅ Why HCLTech’s Move Matters - For HCLTech, this investment is far bigger than a financial bet. It’s a strategic operating layer for the next decade. - By embedding Sarvam’s models into enterprise workflows, HCLTech can offer: 1. AI systems trained for Indian compliance requirements 2. Local-language enterprise copilots 3. Sovereign AI deployments for banks & governments 4. DPDP-compliant data processing inside India India’s IT giants want to own the stack. ✅ Let me share the #Rajspectives 1. The biggest overlooked opportunity in AI today is not English. It’s Bharat. Hundreds of millions of users are now coming online in Hindi, Tamil, Bengali, Marathi, Telugu, Kannada, Malayalam, Punjabi, Gujarati, and other regional languages. 2. The company that solves low-cost inference, multilingual reasoning, localized AI search, and vernacular enterprise automation wins the next decade of Indian AI. 3. Sarvam is positioning itself exactly there. Earlier Indian startup booms focused on food delivery, fintech and others, but foundational AI is different. It requires: • enormous compute • deep research talent • hardware access • government alignment • enterprise distribution Which is why the participation of Nvidia + HCLTech + IndiaAI Mission matters so much. This is ecosystem coordination at scale. India now wants to build: - its own foundational models - its own compute infrastructure - its own sovereign AI layer - its own linguistic intelligence stack The Sarvam AI round may eventually be remembered as the moment India stopped consuming AI and started building its own. #AI #infrastructure #investing #startup #funding #innovation

As artificial intelligence continues its meteoric rise, we often hear about breakthroughs and new capabilities. But what if the next big challenge isn’t just technical, but about something more fundamental — running out of data? A recent report highlights a looming bottleneck: by 2028, AI developers may exhaust the stock of public online text available for training large language models (LLMs). The rapid growth in model size and complexity is outpacing the slow expansion of usable Internet content, and tightening restrictions on data usage are only compounding the problem. What does this mean for the future of AI? Good piece in Nature outlining some of the key advances in the field. 1️⃣ Shift to Specialized Models: The era of “bigger is better” may give way to smaller, more focused models, tailored to specific tasks. 2️⃣ Synthetic Data: Companies like OpenAI are already leveraging AI-generated content to train AI — a fascinating, but potentially risky, feedback loop. 3️⃣ Exploring New Data Types: From sensory inputs to domain-specific datasets (like healthcare or environmental data), innovation in what counts as “data” is accelerating. 4️⃣ Rethinking Training Strategies: Re-reading existing data, enhancing reinforcement learning, and prioritizing efficiency over scale are paving the way for smarter models that think more deeply. This challenge isn’t just technical; it’s ethical, legal, and creative. Lawsuits from content creators highlight the delicate balance between innovation and intellectual property rights. Meanwhile, researchers are pushing the boundaries of what’s possible with less. Link to piece here: https://lnkd.in/gvRvxJZq

The recent $500B AI infrastructure announcement may subtly signal a shift toward viewing artificial general intelligence (AGI) as primarily an infrastructure challenge, with a focus on scaling up large language models (LLMs). While infrastructure and scaling have their place, I think this perspective risks oversimplifying the complexities of achieving AGI. True progress will require, I think, significant investment in fundamental research and the creation of high-quality, diverse datasets tailored to support AI development. Also, the absence of a clear definition of AGI or a concrete vision of what a world with AGI might look like further complicates and hinders its pursuit. If we frame AGI as a system capable of making autonomous discoveries, it’s worth noting that some of the most exciting advancements in AI-driven discovery —such as AI-driven material discovery (e.g., recently published MatterGen)—come from models that aren’t based on LLMs. This underscores the importance of exploring diverse AI architectures rather than relying solely on scaling up LLMs. Infrastructure alone cannot substitute for the creative rethinking and foundational breakthroughs required to achieve AGI.

According to Sam Altman, AI costs are dropping 10x every 12 months, so why are your costs just going up? 🤔 This question keeps the finance team and many AI enterprise leaders awake at night. GenAI token costs are indeed plummeting. Of course, the real story is a bit more complicated. So what's really driving increased spend? 💰𝐈𝐧𝐝𝐢𝐫𝐞𝐜𝐭 𝐜𝐨𝐬𝐭𝐬 𝐬𝐭𝐢𝐥𝐥 𝐝𝐢𝐫𝐞𝐜𝐭𝐥𝐲 𝐚𝐟𝐟𝐞𝐜𝐭 𝐭𝐡𝐞 𝐛𝐨𝐭𝐭𝐨𝐦 𝐥𝐢𝐧𝐞 Fine-tuning for specific use cases and/or RAGs, backend development and API integration, testing, security, compliance, and specialized model development or implementation resources. None of these things disappear with token prices decreasing. The path to production and scaling is still as challenging as ever. 💰𝐂𝐨𝐧𝐭𝐢𝐧𝐮𝐨𝐮𝐬 𝐨𝐩𝐭𝐢𝐦𝐢𝐳𝐚𝐭𝐢𝐨𝐧 𝐜𝐚𝐧 𝐛𝐞 𝐚 𝐜𝐨𝐧𝐭𝐢𝐧𝐮𝐨𝐮𝐬 𝐜𝐨𝐬𝐭 Models are not one-and-done. Continuous optimization, training and learning are the keys to long-term success with AI. But, these lifetime costs rarely make it into the initial ROI calculations. Plus, as use cases expand, you might need larger models – and larger budgets. 💰𝐀𝐈 𝐈𝐧𝐟𝐫𝐚𝐬𝐭𝐫𝐮𝐜𝐭𝐮𝐫𝐞 𝐢𝐬𝐧’𝐭 𝐞𝐚𝐬𝐲 𝐨𝐫 𝐜𝐡𝐞𝐚𝐩 Not knowing how to scale models creates many unforeseen costs and headaches. This is true of both machine learning models and GenAI ones. While token prices drop, cloud costs are surging 30%+ annually, driven by AI scaling. Those shiny GPU clusters? That’ll cost you. One last thing to think about - today's token prices are subsidized by billions in investor capital. These large language model (LLM) companies will eventually need to monetize their massive R&D investments. The real question isn't about today's costs – it's about tomorrow's sustainability. Being AI-enabled isn't just about paying for tokens for a GenAI model. Success requires a comprehensive strategy that accounts for the full cost of implementation, optimization, and scale. Businesses need to navigate these hidden costs while delivering real value.

Stanford HAI just released the 2025 AI Index Report — and it’s a compelling snapshot of where AI is headed. If you're building, investing in, or regulating AI, this report is a must-read. It captures both mainstream momentum and emerging outliers that will shape the next wave of innovation. Here are the highlights that stood out to me — along with a few surprises: Model development is accelerating: The U.S. led with 40 notable models in 2024, while China developed 15. But what’s notable is that the performance gap is narrowing fast — Chinese models are now scoring near-parity with U.S. counterparts on benchmarks like MMLU and HumanEval. Private AI investment soared: U.S. – $67.2B China – $7.8B U.K. – $4.5B The capital flow shows no signs of slowing, and the geopolitical implications are hard to ignore. AI adoption surged: A full 78% of organizations reported using AI in 2024 — up from 55% the year before. AI has officially gone mainstream in enterprise. Massive efficiency gains: 40% improvement in AI hardware energy efficiency 280x drop in inference cost for GPT-3.5–level models (Nov 2022 to Oct 2024) This is reshaping the economics of AI at scale. The regulation wave is building: The U.S. issued 59 AI-related federal regulations in 2024 — double the previous year. AI legislative mentions rose 21.3% across 75 countries — a sign of how urgently governments are responding. Now for the outliers and trends that deserve your attention: DeepSeek’s R1 model in China hit near state-of-the-art performance using a fraction of the compute. This is especially striking given U.S. export restrictions — and challenges our assumptions about scale and access. AI is becoming a global movement. Nations in Southeast Asia, the Middle East, and Latin America are now building serious AI capabilities. This decentralization of innovation is just getting started. Open-weight models are surging. Llama (Meta), DeepSeek, and others are driving the shift toward open access — fueling grassroots experimentation and enterprise adoption alike. But risks are rising, too. The report documents a growing number of AI-related incidents and model failures — underscoring the urgency of safety, governance, and responsible deployment. Reasoning remains a challenge. Even the most advanced models still struggle with complex logic and contextual decision-making — making it clear that true autonomy is still a frontier, not a given. TL;DR? AI is scaling, spreading, and getting smarter — but the risks and responsibilities are scaling with it. And the next big breakthrough might not come from where we expect. Here’s the full report: https://lnkd.in/gUeYMWAv Which of these trends do you think will shape 2025 the most? Curious to hear your take.

The ‘Queen of the Internet’, Mary Meeker, published her first Trends report since 2019 - this time on AI. These are my favourite slides from the massive 340-page document capturing the unprecedented transformation AI is driving across technical, financial, social, physical & geopolitical landscapes. Some striking themes from the report: 𝟭. 𝗨𝗻𝗽𝗿𝗲𝗰𝗲𝗱𝗲𝗻𝘁𝗲𝗱 𝗦𝗽𝗲𝗲𝗱 𝗮𝗻𝗱 𝗦𝗰𝗮𝗹𝗲  • ChatGPT reached 800M weekly active users in just 17 mths  • ChatGPT hit 365B annual searches in 2 years vs Google's 11 years 𝟮. 𝗠𝗮𝘀𝘀𝗶𝘃𝗲 𝗖𝗮𝗽𝗶𝘁𝗮𝗹 𝗜𝗻𝘃𝗲𝘀𝘁𝗺𝗲𝗻𝘁 𝗗𝗲𝘀𝗽𝗶𝘁𝗲 𝗨𝗻𝗰𝗲𝗿𝘁𝗮𝗶𝗻 𝗥𝗲𝘁𝘂𝗿𝗻𝘀  • Big Six tech companies' CapEx surged 63% YoY to $212B in 2024  • AI model training costs exploding from ~$100M to potentially $10B  • OpenAI burning through capital - $5B in compute expenses vs $3.7B revenue  • High valuations (OpenAI at 33x revenue) despite losses 𝟯. 𝗗𝗿𝗮𝗺𝗮𝘁𝗶𝗰 𝗖𝗼𝘀𝘁-𝗣𝗲𝗿𝗳𝗼𝗿𝗺𝗮𝗻𝗰𝗲 𝗜𝗺𝗽𝗿𝗼𝘃𝗲𝗺𝗲𝗻𝘁𝘀  • AI inference costs plummeted 99.7% in two years  • NVIDIA GPUs now use 105,000x less energy per token than 10 years ago  • Yet total spending increasing due to Jevons Paradox - as costs fall, usage explodes 𝟰. 𝗨𝗦-𝗖𝗵𝗶𝗻𝗮 𝗔𝗜 𝗥𝗮𝗰𝗲 𝗜𝗻𝘁𝗲𝗻𝘀𝗶𝗳𝘆𝗶𝗻𝗴  • China rapidly closing the gap with models like DeepSeek achieving similar performance at lower cost  • China has more industrial robots than the rest of the world combined  • 83% of Chinese citizens view AI positively vs only 39% of Americans 𝟱. 𝗔𝗜 𝗧𝗿𝗮𝗻𝘀𝗳𝗼𝗿𝗺𝗶𝗻𝗴 𝗣𝗵𝘆𝘀𝗶𝗰𝗮𝗹 𝗪𝗼𝗿𝗹𝗱  • Waymo captured 27% of San Francisco rideshare market in 20 months  • Tesla's Full Self-Driving miles increased 100x over 33 months  • AI being deployed in agriculture, mining, defence with measurable impact 𝟲. 𝗪𝗼𝗿𝗸 𝗥𝗲𝘃𝗼𝗹𝘂𝘁𝗶𝗼𝗻 𝗔𝗰𝗰𝗲𝗹𝗲𝗿𝗮𝘁𝗶𝗻𝗴  • AI job postings up 448% while non-AI IT jobs down 9% over 7 years  • Companies like Shopify and Duolingo making AI use mandatory 𝟳. 𝗢𝗽𝗲𝗻 𝗦𝗼𝘂𝗿𝗰𝗲 𝘃𝘀 𝗖𝗹𝗼𝘀𝗲𝗱 𝗠𝗼𝗱𝗲𝗹 𝗖𝗼𝗺𝗽𝗲𝘁𝗶𝘁𝗶𝗼𝗻  • Open-source models rapidly closing performance gaps  • Meta's Llama downloads reached 1.2B in 8 months  • Developers gravitating toward open models for cost and flexibility 𝟴. 𝗜𝗻𝗳𝗿𝗮𝘀𝘁𝗿𝘂𝗰𝘁𝘂𝗿𝗲 𝗕𝗲𝗰𝗼𝗺𝗶𝗻𝗴 𝘁𝗵𝗲 𝗕𝗼𝘁𝘁𝗹𝗲𝗻𝗲𝗰𝗸  • Data centers now consuming 1.5% of global electricity  • xAI built a 750,000 sq ft data center in just 122 days 𝟵. 𝗡𝗲𝘄 𝗕𝘂𝘀𝗶𝗻𝗲𝘀𝘀 𝗠𝗼𝗱𝗲𝗹𝘀 𝗘𝗺𝗲𝗿𝗴𝗶𝗻𝗴  • Specialized AI companies achieving explosive growth (e.g., Cursor from $1MM to $300MM ARR in 25 months)  • Both horizontal platforms and vertical solutions competing for dominance  • Enterprise adoption accelerating with 50% of S&P 500 discussing AI on earnings calls 𝟭𝟬. 𝗔𝗜-𝗙𝗶𝗿𝘀𝘁 𝗜𝗻𝘁𝗲𝗿𝗻𝗲𝘁 𝗳𝗼𝗿 𝗡𝗲𝘅𝘁 𝟮.𝟲 𝗕𝗶𝗹𝗹𝗶𝗼𝗻 𝗨𝘀𝗲𝗿𝘀  • Satellite internet (Starlink at 5MM+ subscribers) enabling connectivity  • New internet users will experience AI as their primary interface