The longer people are in academia, the more they realize that when reading papers it's best to ignore Intro, Discussion etc. and just look at Methods and Results
journals.plos.org/plosone/ar…
I hit a bug in the Attention formula that’s been overlooked for 8 years. All Transformer models (GPT, LLaMA, etc) are affected.
Researchers isolated the bug last month – but they missed a simple solution…
Why LLM designers should stop using Softmax 👇
evanmiller.org/attention-is-…
Have you ever wondered how we can salvage federated learning?
27 March at 11:15am GMT, @realhamed will utilize Trusted Execution Environments on clients for local training, and on servers for secure aggregation, to hide model updates from adversaries.
Curious about novel risks that AI introduces for patients and healthcare providers?
We're hosting an #AIUK Fringe event to explore Privacy and Fairness in AI for Health – Register now!
private-fair-ai.github.io/
Date: 27 March, 10:00-16:30 GMT
Location: @turinginst, London
1/6
Federated Learning for constrained edge devices need to become more efficient and adaptive. In this preprint, we offer Centaur: a framework that adaptively partitions FL training across multiple clients owned by each user.
PDF: arxiv.org/abs/2211.04175
1/4
Too many attacks breaking the privacy-by-design principle in federated/collaborative learning? All-in-One. Check out our paper analyzing the private information leakage from neural network gradients using information theory. arxiv.org/pdf/2105.13929.pdf
Super excited to start my internship at Nokia Bell Labs Cambridge today! I will be working on device intelligence in @akhilmathurs and @raswak's team. (meanwhile, I have been using my Nokia phone for 15 years 😃)
Excited about our upcoming work on "battery-free machine learning for the ocean!", just accepted to @ACMHotMobile 2022 - a cross-pond collaboration between our groups @MIT_SK_Lab and @ImperialSysAL. Stay tuned!
Over the past 5 years, I’ve read >1,000 letters of recommendation to grad programs in MIT - mostly EECS, Media Lab, and MechE. Since it's letter-writing season, here is some concrete advice for anyone writing letters based on my experience
How to cope with paper rejection?
Rejection SUCKS! It feels awful that months of hard work did not pay off. 😭 How do we hold a positive outlook when dealing with rejection?
A thread of lessons (learned from many rejections) 🧵
@ACMSIGMOBILE MobiSys 2021 has started. Heartiest Congratulations to the author of the two best paper awards this year. Well done! 🍷Now, on to the first keynote by Shree K. Nayar (Columbia) on "Future Cameras: Redefining the Image." Nice start😀
Check our teaser video of our latest work "PPFL: Privacy-preserving Federated Learning with Trusted Execution" to be presented on June 30th at #MobiSys2021. Preprint (arxiv.org/abs/2104.14380) and Code (github.com/mofanv/PPFL) are both available online.