Attention, Transformers, and LLMs: a hands-on introduction in Pytorch

Approved: Yes
Title: Attention, Transformers, and LLMs: a hands-on introduction in Pytorch
Category: Learning
Skill Level:
Intermediate (305)

Description:
This workshop focuses on developing an understanding of the fundamentals of
attention and the transformer architecture so that you can understand how
LLMs work and use them in your own projects.


Link to Resource:
- Landing Page (https://clemsonciti.github.io/rcde_workshops/pytorch_llm/00-index.html)
- Preparing data for LLM training (https://clemsonciti.github.io/rcde_workshops/pytorch_llm/01-data.html)
- Small Language Models: an introduction to autoregressive language modeling (https://clemsonciti.github.io/rcde_workshops/pytorch_llm/02-small_language_model.html)
- Attention is all you need (https://clemsonciti.github.io/rcde_workshops/pytorch_llm/03-attention_is_all_you_need.html)
- Other LLM Topics (https://clemsonciti.github.io/rcde_workshops/pytorch_llm/04-other_topics.html)

Tags:
ai (271), deep-learning (303), machine-learning (272), neural-networks (435), pytorch (471)

Domain:
ACCESS CSSN (780), Campus Champions (572), CAREERS (323), CCMNet (835), Great Plains (311), Kentucky (322), Northeast (308)

Would you like to associate this resource with an Affinity Group?: {Empty}