Learn a development pattern to systematically improve the accuracy and reliability of LLM applications in our new short course, Improving Accuracy of LLM Applications, built in partnership with
@LaminiAI and
@Meta, and taught by Lamini’s CEO
@realSharonZhou, and Meta’s Senior Director of Partner Engineering,
@asangani7. (Disclosure: I am an investor in Lamini.)
The path to tuning an LLM application can be complex. In this course, you'll learn a systematic sequence of steps for improving accuracy by reducing hallucinations:
- Create an evaluation dataset to measure model accuracy
- Add prompt engineering and self-reflection
- Fine-tune your model including "memory-tuning" which is a new method of embedding facts in an LLM
Using the Llama 3-8B parameter model, you will:
- Build a text-to-SQL agent with a custom schema and simulate situations where it hallucinates
- Understand the difference between instruction fine-tuning, which gives pre-trained LLMs instructions to follow, and memory fine-tuning
- See how Performance-Efficient Fine-tuning (PEFT) techniques like Low-Rank Adaptation (LoRA) reduce training time by 100x and Mixture of Memory Experts (MoME) reduces it even further
I appreciate Meta releasing the Llama's family of open models -- this course gives an example of the unique type of work that developers can do with such models.
Please sign up here:
deeplearning.ai/short-course…