State of GPT-20230524 - ihower's Notes

> 歡迎訂閱我的 [AI Engineer 電子報](https://aihao.eo.page/6tcs9) 和瀏覽 [[Generative AI Engineer 知識庫]] 由 OpenAI 的 Andrej Karpathy 在微軟 Build 研討會發表的演講 https://build.microsoft.com/en-US/sessions/db3f4859-cd30-4445-a0cd-553c3304f8e2 翻譯 https://www.youtube.com/watch?v=YrBJiy-V8MY 前半講 model: OpenAI 是怎麼 train 出 GPT 的，以及 SFT 跟 RLHF 的差異後半講 Prompt engineering 的應用因為 OpenAI 沒有開源他們的 GPT-4 模型是怎麼做的，因此這場 talk 的資訊很關鍵，因為透露了一些內部機密出來，幫助你理解模型是如何思考的。 ## 網友心得 https://twitter.com/dotey/status/1662603594799935489 https://twitter.com/dotey/status/1662898802674548737 https://twitter.com/dotey/status/1671316445093933057 ## Part 1: How to train your (Chat)GPT Assistant ![[Pasted image 20230606220114.png]] ![[Pasted image 20230606220131.png]] ![[Pasted image 20230606221205.png]] ![[Pasted image 20230606220142.png]] ![[Pasted image 20230606220158.png]] ![[Pasted image 20230606220207.png]] ![[Pasted image 20230606220221.png]] ![[Pasted image 20230606220231.png]] ![[Pasted image 20230606220240.png]] ![[Pasted image 20230606220247.png]] ![[Pasted image 20230606220256.png]] ![[Pasted image 20230606220306.png]] ![[Pasted image 20230606220312.png]] ![[Pasted image 20230606221240.png]] ![[Pasted image 20230606220416.png]] ![[Pasted image 20230606221258.png]] ![[Pasted image 20230606220445.png]] ![[Pasted image 20230606221318.png]] ![[Pasted image 20230606220456.png]] ![[Pasted image 20230606220509.png]] ![[Pasted image 20230606220522.png]] ![[Pasted image 20230606221404.png]] ![[Pasted image 20230606220535.png]] ![[Pasted image 20230606220546.png]] ![[Pasted image 20230606220559.png]] ![[Pasted image 20230606220617.png]] ![[Pasted image 20230606220628.png]] ![[Pasted image 20230606220639.png]] ## Part 2: Applciations ![[Pasted image 20230606220656.png]] ![[Pasted image 20230606220738.png]] ![[Pasted image 20230606220758.png]] ![[Pasted image 20230606220816.png]] ![[Pasted image 20230606220824.png]] ![[Pasted image 20230606220833.png]] ![[Pasted image 20230606220841.png]] ![[Pasted image 20230606220852.png]] ![[Pasted image 20230606220903.png]] ![[Pasted image 20230606220913.png]] ![[Pasted image 20230606220922.png]] ![[Pasted image 20230606220930.png]] ![[Pasted image 20230606220940.png]] ![[Pasted image 20230606220954.png]] ![[Pasted image 20230606221046.png]] ![[Pasted image 20230606221005.png]] ![[Pasted image 20230606221016.png]] ![[Pasted image 20230606221026.png]]