MLUGS

Protokoll

Christian: Wie GPT funktioniert

1. Jay Alammar's GPT blog posts

   • Alammar: Illustrated GPT-2
   • Alammar: How GPT-3 works

2. Andrej Karpathy's nanoGPT implementation

   • Karpathy: nanoGPT

Additional Links

• GPT architecture
• Original GPT paper
• Original GPT blog post by OpenAI
• ChatGPT blog post by OpenAI
• GPT-2 blog post by OpenAI
• Video Tutorial on nanoGPT by Karpathy
• CS224n Self-Attention and Transformers
• CS224n Transformers and Pretraining

next

• 2023-03-21

  • in-person in Stuttgart (Marienstrasse 23)
  • Tin hält einen Vortrag zu video super resolution