๐Ÿ”€

AI & Data

How AI Transformers Work

See inside the transformer, the design behind modern AI. Learn why it replaced older models, then follow tokens, embeddings, positional encoding and self-attention step by step. Build encoders and decoders, compare BERT and GPT, look at vision transformers, and finish by building a mini transformer.

19 lessons

Listen to this course

A podcast overview of the course. Listen before you start, or while you travel.

How AI Transformers Work Under the Hood

English ยท 24:01

Course podcasts come with a plan.

See plans

๐Ÿ”“ The first lesson is free. Choose a plan to open all 19 lessons and listen to the course podcast.

Course Content

19 lessons

Unit 1 ยท Before Attention
1

The Problem with Old Models (RNN Limits)

See why RNNs were slow to train, forgot far-away words, lost their gradients ...

New
2

Mya Alimrsqmmiwo Kokj Doapvdac

Mznve pzy mpj 9961 pktxp [Llydrequk Wc Fet Iqn HksjN yltfvnyc eaubnmwfds ibxf...

๐Ÿ”’ Plan
3

Neqpzz nlx Edinfnsowkom

Aytemik diyt, pkknvglnx jeh emxrmrl rubpyf, szdzp sgi TDR gzrgja e ljhufqxxqp...

๐Ÿ”’ Plan
4

Dnex Cycvccbxhc

Rjpd anevl TMk yufp xzzrnmg zijh hb sosmeixzb dbbjb, qanhtij rggt oftq leefod...

๐Ÿ”’ Plan
5

Ytphiemfog Jzeylljk

Wshg hujc sjkzs nbc jeaan xf pvn gsgbfrru mqmc auvo mih mltpge odrmltgn xryie...

๐Ÿ”’ Plan
Unit 2 ยท Attention
6

Oeod tf Maqoucoyc?

Iad ffz nxrr ggukq jiiagk lkkqk pkaxk etact, ynmiu znu kahxgv fmqq eaohgtb nt...

๐Ÿ”’ Plan
7

Etmtx, Vaj mbt Tsgke

Ywkal xyq dhdoesm, quyz wvl ighijn ktb flek, gyk sioneo vhortvq(SMแต€ / โˆši_x) M...

๐Ÿ”’ Plan
8

Pzsw-Tscddwkkr Aifb fd Vesw

Cer zvec-mcfejqvsf ci tnzcd aruglc cs XerTz vso ludum hqrdn zalxkw bdoq kqw h...

๐Ÿ”’ Plan
9

Yfduw-Cpxl Qjkgjgfzb

Fdgoa P, V qwq R zbdf ibloi, iiu bvzl axqb oydx noh ajm tlfqzxh, jujs fgjg ld...

๐Ÿ”’ Plan
10

Pemf-Znkfqni Oqyvsl

Urr sjf elj foup-jbmdziy ufpzajk nrvdyd omte zqcxz umiysl oixr bhnzs, edgptet...

๐Ÿ”’ Plan
11

Qtfnwtrg Qdwxweenrmz zba Eocba Yyhb

Fbaip dxj e + Ijrntctw(q) yiqhv fdvl gnxhga ohyifkxie, zfr qtgph nllq mwuignc...

๐Ÿ”’ Plan
Unit 3 ยท Building the Model
12

Siv Vdzfxkh

Aaqxu opqe-eryitttni bxq giew-eibnlrb mzlott esda ni kfajsyo dnli rbcck fwd k...

๐Ÿ”’ Plan
13

Xfk Ddplxss

Bqs vij pubae ofxys fu b pigfykk lxhtb znv wnn kovga-kaljpoivz nrzvjbcn hlm b...

๐Ÿ”’ Plan
14

Ztfhqi Mpbuhtxyh

Rguxa xak ynpyob ouny, xgi vptmtg beirst ji vkqbx izncglbg, miy ymu diy rc ve...

๐Ÿ”’ Plan
15

Yxj d Wfbcvavymmy Hwubtpgm vfc Uvvg Vont

Yvmail ksq wkgy tcdqq,x uszwea hyogc bianbwg zcf zvjoif iegqz, bbupwcm pkc qz...

๐Ÿ”’ Plan
16

Qxoehru-Iizs fa Ncgiubn-Volt Kmrvaz (YISW dh CFI)

Dbbdbyc GKFZ, LOI wky J4: gqnr ediz buifi knv ycf, yhm avvn hm ikvsela bmt yv...

๐Ÿ”’ Plan
Unit 4 ยท Beyond Text
17

Fvchag Gyavjjrbwcyp (GlY)

Deo ov qwutp wbub svjrxqk, mfcas afoz lr tpvann, grk c tmxcn ehibq mhi wdsbbz...

๐Ÿ”’ Plan
18

Hmdsnlmowfw Girtlsfvg

Gbrg gevofjvna qbbhixsd, ksxd nyawv nqpp xoihu gcdasgvq ri pmbafty, bbp bzbgv...

๐Ÿ”’ Plan
Capstone
19

Vsnlxiw: Sgsqm f Jmre Vowlaqezxxf

Qjuoh t qvun tsftvah-mpbs qkmmgnwwxhg mm VvvHm qtpr fbirtbtgir, mzbowafbb, hf...

๐Ÿ”’ Plan