programmer, former $sc ⛏️, hacker and sceptic. more knowledge, less understanding 🐳

Joined March 2017
8 Photos and videos
vertigo retweeted
LLMs struggle with performance in Retrieval Augmented Generation (RAG) when many documents are retrieved. Prior studies did not isolate if this is due to document quantity versus context length. This paper investigates how the number of documents affects LLM performance, while keeping context length constant. → The paper creates custom datasets from a multi-hop Question Answering dataset. → Document count is varied while context length and relevant information positions are kept constant. → Distractor documents are removed, and remaining documents are extended to maintain fixed context length. → Evaluations using Llama-3.1, Qwen2, and Gemma2 models show that increasing document count often degrades performance by up to 10 percent. → Qwen2 model is less impacted by document count. → Adding random, unrelated documents improves performance, unlike adding related but distracting documents. ---------------------------- Paper - arxiv. org/abs/2503.04388v1 Paper Title: "More Documents, Same Length: Isolating the Challenge of Multiple Documents in RAG"
2
7
32
4,033
vertigo retweeted
Major AI breakthrough: Diffusion Large Language Models are here! They're 10x faster and 10x cheaper than traditional LLMs. Here's everything you need to know:
148
377
3,026
429,095
vertigo retweeted
LLMs hallucinate, mixing truthful and false information. This makes factuality alignment noisy during training because response-level preference learning cannot isolate factual errors. This paper introduces Mask-DPO. It uses sentence-level factuality masks during Direct Preference Optimization. Mask-DPO learns only from factually correct parts of preferred responses. It avoids penalizing factual content in dispreferred responses. 📌 Sentence-level masks in Mask-DPO refine preference learning. This method reduces noise from mixed factuality responses. 📌 Mask-DPO's fine-grained DPO significantly boosts factuality and generalization. It achieves this by reducing noisy feedback. ---------- Methods Explored in this Paper 🔧: → Mask-DPO uses sentence-level factuality annotations as masks. → It constructs preference pairs by ranking responses based on their sentence-level factuality scores. → During training, Mask-DPO applies masks to the DPO loss function. → These masks ignore incorrect sentences in preferred responses and correct sentences in dispreferred responses. → This fine-grained approach focuses learning on factual correctness at the sentence level. ---------------------------- Paper - arxiv. org/abs/2503.02846 Paper Title: "Mask-DPO: Generalizable Fine-grained Factuality Alignment of LLMs"
1
12
1,553
vertigo retweeted
6 Feb 2025
Today, we are infusing the power of agentic AI into the GitHub Copilot experience, elevating Copilot from pair to peer programmer 🤖 (1/4) github.blog/news-insights/pr…
250
725
4,789
1,395,141
vertigo retweeted
New paper outlines the DH method for Quantum Computers, suggesting that there will be quantum demand for Diffie-Hellman Cyrptography in the post quantum world. There are already teams working on post Quantum Cryptography such as the Knot Diffie-Hellman from @quantdotbond which potentially offer a faster platform to secure Web3 transactions in a post Quantum world. The paper follows. arxiv.org/pdf/2501.09568

3
15
155
501,677
vertigo retweeted
With the release of $KNOT getting closer, the moment couldn't be better to announce our plan to integrate AI support to $KNOT. With the advent of AI being more present in cybersecurity, this would be essential for real-world implementations. This would help us during the second phase of $KNOT, that is, optimization of the implementation and further development by detecting security problems and anomalies. We will aim to use AIs commonly used for cryptographic verification and integration, and also new ones implemented by our team specifically for $KNOT, with the aim to integrate it and avoid vulnerabilities. The use of AI will be essential to identify potential cryptographic threats that may arrive with the advancement of quantum research.
3
8
32
1,823
vertigo retweeted
It will be amazing to be able to speak about $KNOT and @quantdotbond in the biggest Quantum Summit of the world!
We're heading to the Quantum Innovation Summit 2025! 🚀 This premier event brings together industry giants like Microsoft, IBM, D-Wave, Nvidia, and more. With @pauloaviana and @VOTSoul1929 representing us, we’re ready to: 💡 Connect with leaders shaping the quantum world 🤝 Explore partnerships and investment opportunities 🌐 Showcase Quant.Bond to the global quantum community The future of $KNOT and Quantum DeSci has begun. Stay tuned for updates from the summit floor!
2
6
29
2,548
vertigo retweeted
We're heading to the Quantum Innovation Summit 2025! 🚀 This premier event brings together industry giants like Microsoft, IBM, D-Wave, Nvidia, and more. With @pauloaviana and @VOTSoul1929 representing us, we’re ready to: 💡 Connect with leaders shaping the quantum world 🤝 Explore partnerships and investment opportunities 🌐 Showcase Quant.Bond to the global quantum community The future of $KNOT and Quantum DeSci has begun. Stay tuned for updates from the summit floor!
12
15
54
6,765
vertigo retweeted
🟩 @quantdotbond Joins the Rivalz Alliance! 🟩 We’re excited to welcome Quant.Bond as the newest member of the Alliance! Quant.Bond is transforming Quantum DeSci by enabling individuals to launch Quantum, Post-Quantum and Quantum AI algorithm experiments. With tokenized, community-driven funding, they empower quantum experimenters to raise capital while retaining usage rights for their commercial implementations. As part of the Rivalz Alliance, Quant.Bond will receive a compute grant, guidance, infrastructure access, and additional support to scale their vision for their platform and $KNOT within the quantum and DeSci space. This partnership also brings exciting opportunities for zNode holders, who will directly benefit from the innovations and initiatives introduced by Quant.Bond as part of the Alliance. We’re committed to helping Quant.Bond bring their groundbreaking ideas to life. Stay tuned for more as they take their next steps with Rivalz!
143
93
396
53,024
vertigo retweeted
We’re honoured to be part of the @Rivalz_AI Alliance! 🟩 We’ll be receiving a compute grant, guidance, infrastructure access, and additional support to take quantum innovation to new heights. Stay tuned as we scale $KNOT into the future of Quantum DeSci!
🟩 @quantdotbond Joins the Rivalz Alliance! 🟩 We’re excited to welcome Quant.Bond as the newest member of the Alliance! Quant.Bond is transforming Quantum DeSci by enabling individuals to launch Quantum, Post-Quantum and Quantum AI algorithm experiments. With tokenized, community-driven funding, they empower quantum experimenters to raise capital while retaining usage rights for their commercial implementations. As part of the Rivalz Alliance, Quant.Bond will receive a compute grant, guidance, infrastructure access, and additional support to scale their vision for their platform and $KNOT within the quantum and DeSci space. This partnership also brings exciting opportunities for zNode holders, who will directly benefit from the innovations and initiatives introduced by Quant.Bond as part of the Alliance. We’re committed to helping Quant.Bond bring their groundbreaking ideas to life. Stay tuned for more as they take their next steps with Rivalz!
7
21
76
11,305
vertigo retweeted
Cardano’s level of decentralization and security were the main factors in our decision to build the option for #Handshake top level domain owners to issue domains on #Cardano. $HNS $ADA
13
101
491
19,113
vertigo retweeted
If you haven't been following all of the discussions surrounding #Handshake $HNS, take a moment to read, vote, and comment with your thoughts: github.com/handshake-org/HIP… Super stoked about all of these conversations happening, it feels like we're continuing to mature 🤝
1
6
21
720
vertigo retweeted
PSA: #Handshake is an alt rootzone of the internet. ICANN/Verisign or govts can’t shut it down. @DigitalisDNS is bringing us .ada & .cardano domains (and others) anchored in this alt rootzone. This means real domain ownership. These can’t be censored. $HNS youtube.com/watch?v=lAv0ZCok…
8
18
48
1,317
vertigo retweeted
They are coming for you, and your website. Never been a better time to learn about $HNS @HNS handshake.org

10
43
621
vertigo retweeted
Almost 13,000,000 $HNS top level domains auctioned and minted. @HNS hns.cymon.de/stats

6
24
568
vertigo retweeted
Keep an eye on @digitalisDNS peeps. $ADA 🤝 $HNS Watch the full episode here: youtu.be/5ol72bOah9E?si=3lFS…
2
14
62
6,276
vertigo retweeted
Hey, #DNS homies 👋 We are intrigued with the Handshake(@HNS) blockchain's role in effectively decentralising the storage of domain names and serving as an alternative to the centralised authorities 💪 🗳️ Should we support $HNS by integrating with @bob_wallet_hns?
76% Waiting for this 🤝
13% No idea, but want it 🙌
11% Need more info? Read 🧵👇
245 votes • Final results
32
60
126
13,798