Fine-tuning LLMs with PEFT and LoRA

Approved: Yes
Title: Fine-tuning LLMs with PEFT and LoRA
Category: Video
Skill Level:
Intermediate (305), Advanced (306)

Description:
As LLMs get larger fine-tuning to the full extent can become difficult to
train on consumer hardware. Storing and deploying these tuned models can also
be quite expensive and difficult to store. With PEFT (parameter -efficent
fine tuning), it approaches fine-tune on a smaller scale of model parameters
while freezing most parameters of the pretrained LLMs. Basically it is
providing full performance that which is similar if not better than full fine
tuning while only having a small number of trainable parameters. This source
explains that as well as going over LORA diagrams and a code walk through.


Link to Resource:
- Fine-tuning LLMs with PEFT and LoRA (https://www.youtube.com/watch?v=Us5ZFp16PaU)

Tags:
faster (713), optimization (509), performance-tuning (17), tuning (217)

Domain:
ACCESS CSSN (780), Campus Champions (572), CAREERS (323), CCMNet (835), Great Plains (311), Kentucky (322), Northeast (308)

Would you like to associate this resource with an Affinity Group?: {Empty}