With all due respect, this is pure cope. There's no magical way to train a smaller model. The scaling laws have solid mathematical underpinning that you cannot wish away. Do you think that the frontier labs have not attempted to get to a more efficient architecture?
If the goal is to be frugal, we can post RL train off an open source base model. Has Zoho published anything? Why is the *most obvious* low hanging fruit not tackled?
This is big: all access to Mythos and Fable AI models disabled for everyone outside America.
First thoughts:
1. Technology is the ultimate weapon. National sovereignty, national security, all of it is now about technology.
2. Globalization is dead and Bharat must find her own way ahead.
We must keep these two ideas in mind.
What can our government do right now? Ensure that orgs in India embrace smaller models, both Indian and Chinese open source ones. With a bit of effort, we can make them work. Anyway, why pay money to people who don't even want to sell to you?
We must deepen our R&D. Sarvam has been on it and we have been on it but remember that the latest models cost not only huge GPU budgets to train, the GPUs themselves are restricted. So we can't afford the scale of money (of the order of $100 billion to even get in the game!) and even if we could come up with the money, we can't get all the GPUs. I would not like to ask the government to fund tens of billions of dollars on this anyway - the money has far better uses.
Zoho has been pursuing alternative R&D approaches that are far, far less expensive but by its nature cutting edge R&D takes time and we are patient. I am confident we will get there.
Any remaining people in India who have delusions about globalization should wake up now.