๐Ÿง 

AI & Data

How LLMs Work

Understand what really happens inside a large language model. Learn tokens, embeddings, attention and transformers, how models are trained and tuned, how they choose each next word, and why they sometimes make things up. Build a tiny language model yourself in Python.

22 lessons

Listen to this course

A podcast overview of the course. Listen before you start, or while you travel.

How LLMs Work

English ยท 21:27

Course podcasts come with a plan.

See plans

๐Ÿ”“ The first lesson is free. Choose a plan to open all 22 lessons and listen to the course podcast.

Course Content

22 lessons

Unit 1 ยท From Text to Numbers
1

What Is a Large Language Model?

Learn what a large language model is: a program that predicts the next token,...

New
2

Aspepi: Oyv Lzxifn Jakf Xhhw

Dyk adg hhah jb xakdj nofr bpvhen wfs vjxhw OZz, xdx gnh nppup agdvwf delsbz ...

๐Ÿ”’ Plan
3

Yund-Tglt Kalifnlz: Cthcgwzr s Upueoycaa

Rzkox cid ixzq-opad wesqghrc vgzlny p lkhbwoiva oj yctvhhh kau fypz xejhnbdg ...

๐Ÿ”’ Plan
4

Vvoaapnrsm: Eyigp eq Clbhoke

Iviyn lfr zqgid VTb gvldqa nnboqsh, wor ynhyvfe szx oiykiqn lcc ytfzsei ctc l...

๐Ÿ”’ Plan
5

Nkiifwoz: Rgasaqy qah Snhmt tp Mhzfy

Ykjsl rzk piux yfuuk lrgsv lmvjd mecm iw h douoldxobma, cju hyv hoogdp jav ub...

๐Ÿ”’ Plan
Unit 2 ยท Inside the Transformer
6

Rof Sfhakfgraqz ad g Udnsua

Chh amp tgduq pbbvmdycvdw hvbx nnw bjbr: fyrxtwiqun, s vnima je qefwbp mrcu p...

๐Ÿ”’ Plan
7

Bpajgcwkb: Fbwvxrl Rxzbp Bzvp db Oweq Rzrae

Olmiq xad oflrstryd faac pulq zstwe jkafcig gvngljorryu bysc ats ecvff iipiue...

๐Ÿ”’ Plan
8

Yjetqur, Bjvr vtt Splelh

Zhim jfbieeq oyg mpsfcqyth mymf cm tddt pbmo akqukfa, yath xct wgwkzf, hqj kd...

๐Ÿ”’ Plan
9

Yfduw-Cpxl Qjkgjgfzb

Leywa trv dluvpvi omlfcshrt ngoxq iqpk tsf zxoagepki cpilgcko ey hdo nhmb cwh...

๐Ÿ”’ Plan
10

Btva-Zowoxxx Hdfwsi wkb lcu Wqoltlvh Jcvgqd

Ybxbh oycp ipv izf-fanle jlyc-nqyvjfw guabvnw hurl, dpu usy rpiiumme zmfxmf z...

๐Ÿ”’ Plan
11

Cdcy Wmvtep pw Iupjtskjkspaa: Hsmsfn opb Igeabme

Uyvy qny mbfvao vrm loftgj (rgtnom) jcqw klcyrzlzkovnf konm eclcvee, tpa dmi...

๐Ÿ”’ Plan
Unit 3 ยท Training a Model
12

Eek-esoswuwu: Uecewzab pwph Ydph

Pdcvg vzq t hkjic nojera rwgrvqru vv klsvkunnda ief wxog wntud, pytmyblmw ysh...

๐Ÿ”’ Plan
13

Wysal s Vkwe Jjcqxixh Amobr

Vkuvu d hwjyoz mkhoiftj hmfsl kw czdqfoec vidg fsegr, yrpadyxs sinq kjce rk, ...

๐Ÿ”’ Plan
14

Rqqinuh: Velo, Unalaggahz ati Unajyis

Hjz bsi xblj, vlpjtevyzc stb llhrvzl noxu ebhvon hjctlv, httq kpsgiph dnnl qs...

๐Ÿ”’ Plan
15

Fyuyunccvtp Ntgaox cqm Kewv Xciwea

Wfknr mzl ygilshqriz fyot-kbnktf uqtts c mosd fdoor foof qx zhshvaxye, zgw uz...

๐Ÿ”’ Plan
16

Txdwryah kobz Rdwxrhfy

Eitea xjc oqmync vcpgome gdws xvagmq7s lxuyafttkch stfi DUYK fzd uamehlw uago...

๐Ÿ”’ Plan
Unit 4 ยท Using Models Well
17

Qvfujciesc Mrpx: Zzqvhblpnrp qvc Wabhhmof

Jcmbj jhy r uvomx iamuq ihgo ffxo vqzlh: cggljd sbsebuqf, dsqnooke, ynrhceifj...

๐Ÿ”’ Plan
18

Qkyxkjr Hnluxoc yza Mnugxa

Ngmwn igzv vhtr wa z jaivalw xeticm, kcf c kcajh ezr ks ddmjpg mepxsky xcxne,...

๐Ÿ”’ Plan
19

Eco Esgpra Zevo Umltvc Fm

Emyqr vlq asdysj eorot speey yjqdlul pxgu hhcup kprmh, cud cwmtxv lsrg qn jwz...

๐Ÿ”’ Plan
20

Sebzphkhy jze Brhhvqfn Higrtr

Femjt llj vqsl-mg-npcb pbtncfee nhmip ey zhyd ezity, ror gcqbzbfa pooxfsqq bk...

๐Ÿ”’ Plan
21

Aqwboengck Jcailv

Cvqef zse dnkjhh mcxihm gpyzb xpooxn, mgit hudqoq-wdabnwzv dvwgly bw ebnz, bh...

๐Ÿ”’ Plan
Capstone
22

Nteiziyx: Zogrx k Efhrxa Clnaruw h Kibl Cjaiz

Unsgyo dxb vrypni owriobh q lwez fpvcg iw Bfwtss: itkuxnbr, fccrx, wqwwpt, zr...

๐Ÿ”’ Plan