Joined March 2015
- Tweets 119
- Following 84
- Followers 239
- Likes 42
21 Photos and videos
Today, we released PEFT v0.19.0 and it's a big one. Not only did we add 9 new PEFT methods, the release also contains a bunch of improvements to make PEFT more useful. Check the thread for details:
2
2
13
551
We also added 9 new PEFT methods. There is not enough room here to describe them in detail, but here is a list:
- GraLoRA by github.com/yeonjoon-jung01
- BD-LoRA by github.com/Conzel
- Cartridges and TinyLoRA by @krasul
- PVeRA by @leofillioux
1
3
89
- PSOFT by github.com/fei407
- Lily and PEANut by @tmux_1
- AdaMSS by github.com/LonglongaaaGo
Find a short description of these PEFT methods and the full release notes here: github.com/huggingface/peft/…
1
2
124
Benjamin Bossan retweeted
Jan 7
We just merged support for Parameter Efficient Fine-Tuning (🤗PEFT) in LeRobot.
This means that you can now use methods like low-rank adapters (LoRA) for training your pre-trained policies like Pi0 and SmolVLA.
2
13
106
7,364
13 Nov 2025
PEFT has reached 20k GitHub stars ⭐⭐⭐⭐⭐
Right on time for the new PEFT release, v0.18.0. And it's not a small one at that, with lots of new PEFT methods and other improvements. Details in the 🧵
1
5
14
5,889
13 Nov 2025
github.com/NikhilNayak-debug added Orthogonal Fine-Tuning (OSF). It works by freezing the high-rank subspace of the targeted weight matrices and projecting gradient updates to a low-rank subspace. It is worth checking out on tasks where forgetting previously learned tasks is a concern
1
110
13 Nov 2025
Apart from these new PEFT methods, there have been many improvements and other additions, as well as bug fixes and other changes. The full release notes can be be found here: github.com/huggingface/peft/…
To give it a try, install the latest version with:
python -m pip install -U peft
83
10 Nov 2025
I was tinkering with a tool that lets AI coding agents query Python code bases with SQL. The idea is that using cat, grep, sed etc. is inefficient. LLMs are proficient with SQL, so they should pick it up easily. Here is an query to find all uses of `tqdm` in the PEFT code base.
1
69
10 Nov 2025
As I don't really have the time or knowledge to evaluate this on coding benchmarks involving tool use, I can't say if it really helps or not. In my anecdotal testing, OpenAI Codex can use it with the right instructions, but not consistently.
1
42
10 Nov 2025
If you're interested in using this or collaborating, hit me up. The repo can be found here:
github.com/BenjaminBossan/co…
34
Benjamin Bossan retweeted
31 Oct 2025
We cover a relatively untouched topic seen in conferences -- "Testing in ML Libraries".
@BenjaminBossan & I poured our learnings from maintaining two widely used libraries (PEFT & Diffusers) while working on the presentation.
Below is the overview:
* Revisiting the existing topic of tests 🤷
* A bit about ML libraries and their kinds
* Approaching tests for the OSS libraries at 🤗
* Practical concerns and how we address them (with concrete examples)
Benjamin recently had a chance to present this in person at @pydataamsterdam.
I will leave links to the full video and slides in the comments ⬇️
4
5
35
2,086
9 Sep 2025
I wanted to reduce the amount of code duplication in 🤗 PEFT. As I didn't find a tool to let me interactively explore code duplication hotspots, I vibe coded my own. End result: a net reduction of 3000 lines of code in PEFT.
1
2
84
9 Sep 2025
Besides duplication, this tool also determines type annotation coverage, finds TODO comments, calculates cyclomatic complexity etc. It is a bit rough around the edges and only supports Python, but can still be very useful. You can find it here:
github.com/BenjaminBossan/co…
1
51
9 Sep 2025
For me, this is a prime use case for coding with LLMs: Building small but specialized tools that you need in the situation. Without AI, I just wouldn't have bothered with writing such an app, especially when it comes to the UI, and the refactor would have been more difficult.
42