Joined September 2015
283 Photos and videos
Vaclav Kosar retweeted
The Czech Republic has chosen UK firm @RollsRoyce SMR after assessing seven potential technology suppliers for its proposed small modular reactor programme #nuclear tinyurl.com/yc63hv23
1
36
90
9,526
Vaclav Kosar retweeted
18 Sep 2024
Today, we release several Moshi artifacts: a long technical report with all the details behind our model, weights for Moshi and its Mimi codec, along with streaming inference code in Pytorch, Rust and MLX. More details below 🧵 ā¬‡ļø Paper: kyutai.org/Moshi.pdf Repo: github.com/kyutai-labs/moshi HuggingFace: huggingface.co/kmhf

50
391
1,667
854,899
15 Sep 2024
Thiel at All-In Summit: "we probably tried to do too much investing in Europe over the years it's always sort of a junk it sort of it's a nice place to go on vacation as an investor...the US ...where people do new things"
1
3
216
Vaclav Kosar retweeted
14 Sep 2024
I’ve just finished reading the Draghi Report, and to my surprise, 4 out of the 5 policies I proposed in my EU/ACC open letter were included almost word-for-word. It's encouraging to see this alignment, but there’s still work to be done. Signing the open letter is a way to keep the pressure on decision-makers and ensure that these crucial ideas continue to gain momentum. Let’s make sure our push for progress doesn’t stop here. šŸ“„ Read and sign here: docs.google.com/document/d/1… My latest article: x.com/Duarteosrm/status/1835… #EUACC #Draghi #eu/acc

2
3
24
3,211
14 Sep 2024
Terence Tao's take on o1. TT is a mathematician won the Fields Medal in 2006 and is widely regarded as one of the greatest living mathematicians.
14 Sep 2024
Terence Tao’s grading: GPT-4o: Completely incompetent graduate student o1-preview: Mediocre but not completely incompetent graduate student A step change.
235
14 Sep 2024
"In summary, 01 represents a paradigm shift from memorize the answers to memorize the reasoning", but still "fitting a curve to a distribution" So, no gleam of AGI yet.
1
5
1,167
Vaclav Kosar retweeted
Thanks 🫶to all our sponsors for a more than generous amount of cloud GPU credits! (European mind can’t comprehend… šŸ˜‰).
$300K in cloud credits, a 10-node GH200 cluster, and a 4-node 8 H100 cluster. All available to attendees of CUDA MODE IRL Thanks to our amazing sponsors @anyscalecompute @FAL @LambdaAPI @modal_labs @nebiusai @Oracle @nvidia @PrimeIntellect @togethercompute
2
34
2,543
Vaclav Kosar retweeted
12 Sep 2024
OpenAI o1 — our first model trained with reinforcement learning to think hard about problems before answering. Extremely proud of the team! This is a new paradigm with vast opportunity. This is evident quantitatively (eg reasoning metrics are already a step function improved) and qualitatively (eg faithful chains of thought make models interpretable by letting you ā€œread the model’s mindā€ in plain English). One way to think about this is that our models do System I thinking, while chains of thought unlock System II thinking. People have discovered a while ago that prompting the model to ā€œthink step by stepā€ boosts performance. But training the model to do this, end to end with trial and error, is far more reliable and — as we’ve seem with games like Go or Dota — can generate extremely impressive results. It’s still early days for the o1 technology. It provides new safety opportunities which we are exploring actively, including on reliability, hallucinations, and robustness to adversarial attackers. For example, we’ve seen great uplift in our safety metrics by letting the model reason about policies via chain of thought. Its accuracy also has huge room for further improvement— for example, from our launch post, our model achieved 49th percentile / 213 points in this year’s competitive programming Olympiad (IOI) under human conditions of 50 submissions per problem. But with 10,000 submissions per problem, the model achieved a score of 362.14 — above the gold medal threshold. So the model is capable of even greater outputs than it appears at first glance.
12 Sep 2024
We're releasing a preview of OpenAI o1—a new series of AI models designed to spend more time thinking before they respond. These models can reason through complex tasks and solve harder problems than previous models in science, coding, and math. openai.com/index/introducing…
249
834
6,872
834,790
12 Sep 2024
Rowing, apart from cardio, seems to be indeed good for the back, too. Still rowing tiny 2 min sessions every day. Row! Row! 🚣
19 Jun 2024
Daily 2 mins on a rowing machine with max hardness and max speed have amazingly positive results for me. Is it HIT training? Row! Row! 🚣
66
Vaclav Kosar retweeted
9 Sep 2024
šŸ‡ŖšŸ‡ŗ eu/acc A few weeks ago Mario Draghi asked my recommendations for his report that came out today about European competitiveness I had a call with him and summarized my problems with doing business in the EU I wrote this which is included in the report presented to the European Union today: 1. Minimum revenue cut offs for current and new regulation Exempt small businesses with annual revenues below €10 million from complex regulations like VATMOSS, GDPR, the EU AI Act, and certain labor laws. This approach encourages innovation and growth by allowing startups to focus on product development and market validation without the heavy burden of regulatory compliance. Once these businesses surpass €10 million, they will have the resources to comply with regulations, ensuring that growth is not stifled. 2. Simplify starting a pan-EU business with an EU-wide Incorporation (Inc.) business form Currently, starting and operating a business across the EU is complex due to 27 member states, each with its own company registration requirements. To streamline this process and make it easier for entrepreneurs to operate across Europe, there should be a single, standardized business entity that applies uniformly across all EU countries. I call this the European Inc. 3. Start an EU business fully online, no physical offices, notaries, lawyers etc To continue, right now starting a business in most EU member states it’s complicated, very time and resource intensive, and often involves lawyers and notaries. Instead, it should be as simple as going online to a centralized EU website, where entrepreneurs can register their business and details in just a few clicks. The entire process should be streamlined and efficient, allowing businesses to start operating immediately. The EU government taxes and bookkeeping of this business should also be fully online in an EU portal/dashboard. 4. 0% corporate tax for first 3 years of any new business Countries like Singapore have successfully attracted new businesses from around the world by giving them a massive tax discount during the first 3 years of business. Because they know that’s the most difficult time of a business: figuring out what product it makes and if there’s a market for it. That takes pressure off startups and business founders that they can focus on creating a great product and innovating. 5. Change tax on stock options: don't tax when a stock option is exercised, but tax it when the stock is sold The current tax policy in the EU taxes stock options at the time they are exercised, creating a significant financial burden on employees who have not yet realized any tangible financial gain. This approach stifles innovation, discourages entrepreneurship, and places the EU at a competitive disadvantage compared to other regions like the United States. I propose a simple change: Tax stock options when the stock is sold, not when the option is exercised. 6. Don’t see tech or AI as an enemy, but as a burgeoning and essential industry The most popular companies in tech are focused on AI right now for a reason. It’s the next frontier of computing. The European Union seems to consider AI the enemy. Any technology can be used for good or bad. By regulating it even before Europe has made much contributions (Europe has almost no tech companies leading in AI), it has stifled any potential innovation in AI from the start. Apart from the regulation itself, the optics of it make the EU look bad on a global scale. Why would tech founders move to Europe to start a business if the EU is actively positioning itself as Anti-AI? AI has gigantic potential to be used for good: think of the medical field for diagnosis of diseases, generally in programming (it helps programmers to create software faster/better), etc. This goes further than AI. The same applies to tech in general. It seems the EU is on a crusade against technology while not being able to compete in it itself. It feels a case of sour grapes: if we can’t build great technology in EU, nobody is allowed to do so! 7. Teach tech/coding/AI topics in all schools and unis It would help a lot if the EU has a focus on teaching AI and tech in schools and universities. Making the new generation competitive in this field instead. To secure the future prosperity of the European Union, we must prioritize education in technology, coding, and AI across all levels of schooling, from primary education to universities. This strategic focus is not just an educational reform—it’s a critical investment in the future competitiveness, innovation, and economic resilience of the EU.
689
1,052
8,041
1,236,203
Vaclav Kosar retweeted
This is awesome and I fully support it. But I wager to say this is slightly inconsistent with his (and my own) AI timelines. Whether a self-sustaining Mars colony can be built before the singularity happens is questionable. But definitely worth trying anyway.
7 Sep 2024
The first Starships to Mars will launch in 2 years when the next Earth-Mars transfer window opens. These will be uncrewed to test the reliability of landing intact on Mars. If those landings go well, then the first crewed flights to Mars will be in 4 years. Flight rate will grow exponentially from there, with the goal of building a self-sustaining city in about 20 years. Being multiplanetary will vastly increase the probable lifespan of consciousness, as we will no longer have all our eggs, literally and metabolically, on one planet.
4
1
7
760
Vaclav Kosar retweeted
If the Sun does become a red giant, it will engulf and destroy the Earth. If any of our descendants, physical or intellectual, are still on the Earth at that time, they might not want that to happen. They might do everything in their power to prevent it. Is it obvious that they will not be able to? Certainly, our present technology is far too puny to do the job. But neither our theory of stellar evolution nor any other physics we know gives any reason to believe that the task is impossible. On the contrary, we already know, in broad terms, what it would involve (namely, removing matter from the Sun). And we have several billion years to perfect our half-baked plans and put them into practice. If, in the event, our descendants do succeed in saving themselves in this way, then our present theory of stellar evolution, when applied to one particular star, the Sun, gives entirely the wrong answer. And the reason why it gives the wrong answer is that it does not take into account the effect of life on stellar evolution. It takes into account such fundamental physical effects as nuclear and electromagnetic forces, gravity, hydrostatic pressure and radiation pressure — but not life. @DavidDeutschOxf
4
17
87
5,712
Vaclav Kosar retweeted
5 Sep 2024
The word is out.. @EnricoLetta officially speaks in favor of a ā€œEuropean Delawareā€ In line with what we’ve been saying: let’s make Europe attractive for tech headquarters As US Delaware is currently the leading place of incorporation for tech companies, time for šŸ‡ŖšŸ‡ŗ to lead
5 Sep 2024
Un 'Delaware europeo': @EnricoLetta spiega a Class CNBC la sua proposta di un "28esimo stato europeo virtuale con un suo diritto commerciale, opzionale, valido in tutta Ue" cosƬ che Pmi e multinazionali "non debbano cambiare tra i vari Paesi". Intervista di @IreneElisei
3
22
96
5,506
"physicists have also thrown out Einstein’s original idea...that matter is really just made of spacetime, curved in a particular way...It has been replaced by a different idea of unification, ... both made of something else, ..., for example, strings or loops or networks.
Pls enjoy my new essay for @NautilusMag about Einstein's attempt to explain everything as dips and bends in spacetime nautil.us/einsteins-other-th…
78
31 Aug 2024
Would you like some AI with that?
63
29 Aug 2024
LLM self-verification (reflection) may worsen results: "Across almost all of our domains, this self-verification system worsens performance... this kind of self-correction consistently degrades output quality." Interesting that some agent systems use it.
šŸ“¢ "On the self-verification limitations of LLMs in Reasoning and Planning Tasks" arxiv.org/abs/2402.08115 (lead by @karthikv792 and @kayastechly) šŸ‘‡ Investigates LLM self-verification in three formal benchmarks--Game of 24, Graph Coloring and Planning, and shows that accuracy consistently degrades when LLMs self-verify, but improves when external verifiers are used in a backprompting architecture. This combines and extends our studies from last October--arxiv.org/abs/2310.12397 and arxiv.org/abs/2310.08118--pr… at #FMDM workshop at #NeurIPS2023). 1/
1
1
458
27 Aug 2024
Cerebras speed vs price looks good. They are not on OpenRouter yet.
27 Aug 2024
Replying to @cerebras
Cerebras Inference is just 10c per million tokens for 8B and 60c per million tokens for 70B. Our price-performance is so strong, we practically broke the chart on Artificial Analysis.
1
191
29 Aug 2024
Cerebras latency is on par with Groq for llama 70b.
149
27 Aug 2024
OpenAI strict is too strict. More accurately: too restrictive tools API until they can expand to for example nullable property.
1
73
27 Aug 2024
Ok, it maybe possible with some Pydantic schema post-processing. > "Although all fields must be required (and the model will return a value for each parameter), it is possible to emulate an optional parameter by using a union type with null." ``` "type": ["string", "null"],```
50
Vaclav Kosar retweeted
27 Aug 2024
France, please save the world from this menace!
25 Aug 2024
I am calling for the immediate arrest of Gonzalve Bich, the CEO of BIC ballpoint pens. His pens have been used to write down all sorts of devilish plans and to create insensitive imagery for many years. He has done nothing to stop this. Time to hold him accountable.
1
1
23
2,266