From f1fb29289364f84e3b7ed8e3d82339977a5bb856 Mon Sep 17 00:00:00 2001 From: Wirawan Purwanto Date: Mon, 2 Oct 2023 16:51:07 -0400 Subject: [PATCH] * Added notes on "fine tuning large language models" - initial content from a short course by Sharon Zhou with the same title. --- deep-learning/20231002.Finetuning-LLMs.md | 32 +++++++++++++++++++++++ 1 file changed, 32 insertions(+) create mode 100644 deep-learning/20231002.Finetuning-LLMs.md diff --git a/deep-learning/20231002.Finetuning-LLMs.md b/deep-learning/20231002.Finetuning-LLMs.md new file mode 100644 index 0000000..7a746f9 --- /dev/null +++ b/deep-learning/20231002.Finetuning-LLMs.md @@ -0,0 +1,32 @@ +Finetuning Large Language Models +================================ + + +"Finetuning Large Language Models" +https://www.deeplearning.ai/short-courses/finetuning-large-language-models/ +https://learn.deeplearning.ai/finetuning-large-language-models/lesson/1/introduction +Taught by Sharon Zhou + +Free course, registration required. + +From the course website: + +"Join our new short course, Finetuning Large Language Models! Learn +from Sharon Zhou, Co-Founder and CEO of Lamini, and instructor for the +GANs Specialization and How Diffusion Models Work. + +When you complete this course, you will be able to: + + * Understand when to apply finetuning on LLMs + * Prepare your data for finetuning + * Train and evaluate an LLM on your data + +With finetuning, you're able to take your own data to train the model +on it, and update the weights of the neural nets in the LLM, changing +the model compared to other methods like prompt engineering and +Retrieval Augmented Generation. Finetuning allows the model to learn +style, form, and can update the model with new knowledge to improve +results." + + +