Super excited to announce Finetuning LLMs, a short-course made with my friend
@AndrewYNg !! 🎉
By importing open-source
@LaminiAI core &
@HuggingFace &
@PyTorch &
@Weights_Biases, you can:
✅ Gain an expert's intuition behind finetuning*
✅ Understand how finetuning fits in vs. prompt-engineering vs. RAG vs. pretraining. Or are they all layers of a cake? 🎂 Yes, always cake.
✅ Finetune your own LLM, continually teaching it new knowledge
✅ Pick up practical frameworks for compute & memory requirements needed to finetune vs. run LLMs
✅ Touch on advanced topics, such as parameter-efficient finetuning
*Honestly, "finetuning" could totally be named better, especially if you know the history of finetuning vision models! It involved freezing the model weights and changing the (classifier) head. For LLMs, we often keep the weights unfrozen and don't swap layers of the model, just the data.
Built with favorite AI libraries:
@HuggingFace - stay awesome, keep building
@PyTorch - thank you for saving me in grad school
@Weights_Biases - wish I had you in grad school, sorry Tensorboard
@LaminiAI - building this now, so grad school would've been just 1 line of code