Writing this as an Indian who works on AI in leadership role for one the largest companies in the world (though strictly my personal opinion, but based on verifiable data). You heard it first here: —————————- First some more shocks: You heard DeepSeek. Wait till you hear about Qwen (Alibaba), MiniMax, Kimi, DuoBao (ByteDance) all from China. Within China, DeepSeek is not unique and their competition is close behind (not far behind). IMHO, China has 10 labs comparable to OpenAI/Anthropic and another 50 tier 2 labs. The world will discover them in coming weeks in awe and shock. AI is not hard (I am not high) ———————————— Ignore Sam Altman. Many teams that built foundation models are below 50 persons (e.g. Mixtral). In AI, LLM science part is actually quite easy. All these models are “Transformer Decoder only models”, an architecture that was invented in late 2017. There are improvements since then (flash attention, ROPE, MOE, PPO/DPO/GRPO), but they are relatively minor, open source and easy to implement. Since building foundation models is easy and Nvidia is there to help you (if not directly, then by sharing their software like “Megatron” that is assembly line to build AI models) there are so many foundation models built by Chinese labs as well as global labs. It is machines that learn by themselves…if you give them data & compute. This is unlike writing operating system or database software. Also, everyone trains on same data: internet archives, books, github code for the first stage called “pre-training”. What is part is hard then? ———————————- It is the parallel & distributed computing to run AI training jobs across thousands of GPUs that is hard. DeepSeek did lot of innovation here to save on “flops” and network calls. They used an innovative architecture called Mixture of Experts and a new approach called GRPO. with verifiable rewards both of which are in open domain through 2024. Also, there is lot of data curation needed particularly for “post training” to teach model on proper style of answering (SFT/DPO) or to teach them learn to reason (GRPO with verifiable reward). STF/DPO is where “stealing” from existing models to save cost of manual labor may happen. LLM building is nothing that Indian engineers living in India cannot pull off. Don’t worry about Indians who have left. There are plenty in the country as of today. Then why India does not have foundation models? ——————— It is for the same reason India does not have Google or Facebook of its own. You need to able to walk before you can run. There is no protected market to practice your craft in early days. You will get replaced by American service providers as they are cheaper and better every single time. That is not the case with Chinese player. They have a protected market and leadership who treats this skillset as existential due to geopolitics. So, even if Chinese models are not good in early days they will continue to get funding from their conglomerates as well as provincial governments. Darwinian competition ensures best rise to the top. Recall DeepSeek took 2 years to get here without much revenue. They were funded by their parent. Also, most of their engineers are not PHDs. There is nothing that engineers who built Ola/Swiggy/Flipkart cannot build. Remember these services are second to none when you compare them to their Bay Area counterparts. Also , don’t trivialize those services; there is brilliant engineering to make them work at the price points at which they work. Indian DARPA with 3B USD in funding over 3 years ———————- What we need is a mentality that treats this skillset as existential. We need a national fund that will fund such teams and the only expected output will be benchmark performance with benchmarks becoming harder every 6 months . No revenue needed to survive for first 3 years. That money will be loose change for GOI and world’s richest men living in India. @protosphinx @balajis @vikramchandra @naval

Excited to announce that advertisement for the Centre manager is now live. Please share among your network. eRecruit for UWS - Ref 4907/24 Centre Manager, ARC Training Centre for Smart & Sustainable Horticulture, Hawkesbury Institute for the Environment uws.nga.net.au/cp/index.cfm?…

Discussing the latest developments within #FFSCRC research program 2 projects & discovering the ground-breaking advances in #protectedcropping technologies. Another successful Program 2 PRG meeting yesterday at @westsyduhie. Thanks to all attendees, presenters & hosts.

Two fully funded PHD projects are available on sustainable approaches to improve cotton productivity. It can be any area of science linked to cotton farming. Soil science, pathology, nutrient management, plant physiology, plant-microbial interactions--- Funded jointly by @CottonResearch and @westernsydneyu. More details below westernsydney.edu.au/schools…

Two PhD Scholarships in Plant Molecular Biology and Horticultural Tree Genomics @westsyduhie, @EELaboratory to generate new knowledge of mechanisms controlling traits - flowering in almond and fruit colour in mango at a crop level tinyurl.com/bdexk5p2

The countdown is on to the #FFSCRC #ResearchShowcase! Interact with leading researchers & industry innovators, & discover the innovative tools, technologies & partnerships driving Australia's agrifood sector towards a more resilient & sustainable future. eventbrite.com.au/e/2024-ffs…

In this short clip from For Food’s Sake, Dr Sachin Chavan from @westernsydneyu delves into the purpose of utilising smart films in glasshouses and the benefits of the technology within protected cropping. Learn more: t.ly/NruNF #protectedcropping #smartfilms

Vasantrao Naik Marathwada Krishi Vidyapeeth (VNMKV), Parbhani, & Western Sydney University (WSU), Australia, have entered into a MoU at New Delhi on March 6, 2024 to establish an international partnership for agriculture research & education activities.

@craemaier from @westsyduhie shows how our "Light blocking film in a glasshouse impacts Capsicum annuum L. yield differentially across planting season" frontiersin.org/articles/10.…

It was great to see Ass Prof Han Lin and new post doc Jihong Han from RMIT in our glasshouse facility to discuss the installation of the new generation of new light blocking film. Looking forward to the crop trials under new generation of glasshouse films.

Exciting news! Countdown to For Food's Sake Summit on Feb 22 at Murdoch University. Meet our stellar speaker additions below. Tickets are selling fast. Don't miss the chance to be part of this transformative event. Secure your spot now: ffs.futurefoodsystems.com.au… #FFS24 @MurdochUni

Novel transcriptome networks are associated with adaptation of capsicum fruit development to a light-blocking glasshouse film @westsyduhie frontiersin.org/articles/10.…

Great news for #FFSCRC industry partner @LLEAFgreentech, with Vink König Deutschland (premium wholesaler distributer in Germany), offering the LLEAF polycarbonate film, an innovative product for accelerated plant growth. @westsyduhie hortidaily.com/article/95721…

Looking forward to presenting our research in FUTURE TOUR: SHAPING THE FUTURE OF FARMING as part of the Sydney Design Week at the National Vegetable Protected Cropping Center (NVPCC) on 17 Sept 2023. @powerhouse @westernsydneyu @westsyduhie @FutureFoodCRC powerhouse.com.au/program/sh…

India's Chandrayaan-3 becomes the first spacecraft to land near the south pole of the Moon. Congratulations @isro bbc.com/news/live/world-asia…

Chandrayaan-3 Mission: 'India🇮🇳, I reached my destination and you too!' : Chandrayaan-3 Chandrayaan-3 has successfully soft-landed on the moon 🌖!. Congratulations, India🇮🇳! #Chandrayaan_3 #Ch3

Looking forward to visit this exciting research facility from our collaborators!

Congratulations to #FFSCRC partner, @LLEAFgreentech, on the opening of their first solar laboratory in Sydney, designed to expand its product offerings. innovationaus.com/sun-shifti…

Thank you! 🙏🏽The video numbers are looking fantastic, I hope dearly that we do better!

Researchers at the @IISERPune, have developed new LEDs which emit light simultaneously in two different wavelength ranges, for a simpler and more comprehensive way to monitor the freshness of fruit and vegetables. perovskite-info.com/research…… #perovskite #LED @AngshumanNag4