| 1 | Nov 18, '23 | OK everyone's asking me for my take on the OpenAI stuff, so here it is. I have a strong feeling about what's going on, but no internal info so this is just me talking. The first po | 54.4× | 2.5M | 4.8k | 520 | 2.7k |
| 2 | Aug 10, '23 | Now that ChatGPT has rolled out custom instructions to most users, try out this instruction -- it makes GPT 4 far more accurate for me: (Concat the rest of this 🧵 together and put | 44.1× | 2M | 6.4k | 696 | 11k |
| 3 | Jul 10, '25 | I replicated this result, that Grok focuses nearly entirely on finding out what Elon thinks in order to align with that, on a fresh Grok 4 chat with no custom instructions. | 37.3× | 1.7M | 4.6k | 662 | 979 |
| 4 | Nov 20, '24 | Wow! What on earth happened here? (I don't mean "why did so many people move to a different social network," but "why did they all go to 🦋") | 29.3× | 1.4M | 5.8k | 465 | 1.1k |
| 5 | Apr 15, '24 | "transformers or diffusion" Ummm.... who's gonna tell him that that makes no sense at all? (Transformers is an architecture, and it's quite common to use it *with* diffusion.) | 25.9× | 1.2M | 3.6k | 131 | 567 |
| 6 | Jul 19, '24 | Wtf? The CrowdStrike file that broke everything was entirely full of null characters. How does this happen? | 25.7× | 1.2M | 6.6k | 498 | 1.1k |
| 7 | Oct 13, '23 | If you're like me and find it easier to read *code* than *math*, and you have access to @OpenAI GPT 4V (or use @bing or @google Bard), try pasting a image of an equation you wanna | 24.7× | 1.1M | 1.8k | 245 | 828 |
| 8 | Jul 10, '25 | Here's a complete unedited video of asking Grok for its views on the Israel/Palestine situation. It first searches twitter for what Elon thinks. Then it searches the web for Elon's | 23.8× | 1.1M | 7.1k | 810 | 1.4k |
| 9 | Apr 9, '23 | Lots of folks misunderstanding how GPT 3.5 & 4 work, such as in the take below. "Predict text" is the *pre-training* objective, but it's not what's used for the final model. Th | 23.5× | 1.1M | 1.7k | 208 | 877 |
| 10 | May 4, '23 | There's a new programming language in town - it's Mojo! I'm more than a little excited about it. It's Python, but with none of Python's problems. You can write code as fast as C, a | 23.3× | 1.1M | 4.6k | 864 | 2.5k |
| 11 | Apr 5, '23 | Our new course, "From Deep Learning Foundations to Stable Diffusion", is finally done after 8 months of work!!! With >30 hours of video content (all free, no ads!), you'll learn | 22.5× | 1M | 4.6k | 1.1k | 3k |
| 12 | Jun 29, '24 | For those that hope (or worry) that LLMs will do breakthrough scientific research, I've got good (or bad) news: LLMs are particularly, exceedingly, marvellously ill-suited to this | 21.8× | 1M | 3.9k | 568 | 3.1k |
| 13 | Sep 24, '23 | I just uploaded a 90 minute tutorial, which is designed to be the one place I point coders at when they ask "hey, tell me everything I need to know about LLMs!" It starts at the ba | 20.7× | 958k | 6.2k | 1.1k | 7.4k |
| 14 | Sep 28, '23 | Here, in full directly on Twitter, is "A Hackers' Guide to Language Models". This 90 minute tutorial is designed to be the one place I point coders at when they ask "hey, tell me e | 16.8× | 777k | 5.9k | 1k | 8k |
| 15 | Apr 10, '23 | Don't listen to me. I don't understand language model fine tuning. I'm merely the 1st author of the paper "Universal Language Model Fine Tuning", which explained 5 years ago how to | 16.7× | 775k | 2.5k | 169 | 339 |
| 16 | Jul 11, '23 | I've spent the last few months interviewing >60 experts in law, economics, AI, alignment, etc, on the impacts of AI, and safety interventions. Today I'm publishing my first arti | 16.4× | 761k | 2.2k | 522 | 1.3k |
| 17 | Jul 7, '25 | Study by my genius friend to CURE DEAFNESS cancelled because, I shit you not: "Research programs based primarily on artificial and non-scientific categories, including amorphous eq | 16.4× | 759k | 3.6k | 204 | 487 |
| 18 | Nov 18, '23 | Screw this shitty credentialist arrogant take. Helen Toner is one of the most brilliant people I've ever chatted to. I'm not sure I've ever dealt with anyone else who was so inform | 15.2× | 706k | 1.6k | 65 | 278 |
| 19 | Jun 19, '20 | So do these non-medical masks we're all meant to be wearing actually do anything? Well yes, yes they almost certainly do. Here's a thread about the current science. Let's start by | 15.1× | 0 | 14k | 8.1k | 1.6k |
| 20 | Jul 29, '24 | Announcing FastHTML. A new way to create modern interactive web apps. Scales down to a 6-line python file; scales up to complex production apps. Auth, DBs, caching, styling, etc bu | 14.4× | 667k | 5k | 655 | 4.4k |
| 21 | Feb 12, '24 | Also unfortunately not satire | 13.4× | 623k | 5.2k | 120 | 255 |
| 22 | Apr 3, '23 | There's a lot of folks under the misunderstanding that it's now possible to run a 30B param LLM in <6GB, based on this GitHub discussion. This is not the case. Understanding why | 13.3× | 614k | 2.4k | 390 | 1.7k |
| 23 | Apr 24, '24 | In Australia we have a computational thinking competition for kids each year called Bebras. You get a certificate if you get all of them right. Here's one of the "easy" level quest | 13.2× | 610k | 3.9k | 207 | 815 |
| 24 | Aug 1, '24 | I spent quite a lot of time and energy building something and releasing it for free as open source software. Someone posted a link to it on reddit. This is how some guy on reddit d | 12.5× | 579k | 4.2k | 57 | 265 |
| 25 | Sep 7, '23 | I was chatting on Discord with an anon account ,who had just come up with a really smart new approach to model merging and had some encouraging results to show. But then he had to | 12.1× | 562k | 3.9k | 304 | 483 |
| 26 | Sep 29, '23 | Wow somehow I've been completely erased from the history of Kaggle. For the record, the US company that was funded, Kaggle Inc, was owned equally by Anthony Goldbloom and I with a | 10.9× | 503k | 1.9k | 128 | 154 |
| 27 | Oct 13, '23 | If you're like me and find it easier to read math than code, and you have access to @OpenAI GPT 4V, try pasting a image of an equation you wanna understand in there. It might just | 10× | 463k | 2.4k | 305 | 764 |
| 28 | Mar 7, '24 | Today, with @Tim_Dettmers, @huggingface, & @mobius_labs, we're releasing FSDP/QLoRA, a new project that lets you efficiently train very large (70b) models on a home computer wi | 9.6× | 445k | 3.4k | 623 | 2.2k |
| 29 | Mar 25, '20 | The Czech Republic went from zero mask usage to 100% in 10 days, and in the process they halted the growth of new covid-19 cases. How? They made their own! They didn't need governm | 9.5× | 0 | 8k | 4.4k | 1.3k |
| 30 | Dec 19, '24 | I'll get straight to the point. We trained 2 new models. Like BERT, but modern. ModernBERT. Not some hypey GenAI thing, but a proper workhorse model, for retrieval, classification, | 9.5× | 438k | 4.7k | 650 | 3.1k |
| 31 | Aug 9, '25 | For many years, I've been looking for the perfect replacement for @jQuery. Modern vanilla js has many of the features that made jQuery popular, but often with worse ergonomics. Tod | 9.2× | 426k | 4.3k | 213 | 665 |
| 32 | Jan 17, '25 | We tried really really hard to make Devin (the coding agent) work for us. But it didn't. Check out Hamel's detailed writeup blog linked below, describing the many tasks of many typ | 9.0× | 418k | 2.3k | 203 | 1.4k |
| 33 | Nov 18, '23 | I could barely watch the keynote. It was just another bland corp-speak bunch of product updates. For those researchers I know that were involved from the beginning, this must have | 8.7× | 402k | 1.5k | 51 | 152 |
| 34 | Jul 8, '24 | Many PhD students have told me most earnestly that they could win Kaggle competitions any time they wanted. On the vanishingly rare occasions they've put their money where their mo | 8.3× | 383k | 1.8k | 89 | 931 |
| 35 | Mar 28, '25 | @levelsio Dude. I created the first LLM. | 7.7× | 357k | 1.7k | 43 | 187 |
| 36 | Aug 8, '23 | I was curious about what @OpenAI GPT 3.5 would do if I used `function_call` to force it to call a function, but passed in a prompt that didn't make sense for that function. As it t | 7.7× | 357k | 1.6k | 111 | 210 |
| 37 | Feb 6, '24 | GitHub banned their own co-founder, because something "went wrong with our automations". Please folks, do NOT use automated decision making tools to make decisions that can harm pe | 7.7× | 355k | 2.2k | 212 | 214 |
| 38 | Nov 23, '23 | Bitcoin-turned-AI bros updating their profiles right now. ❤️ b̵i̵t̵c̵o̵i̵n̵ n̵f̵t̵ w̵e̵b̵3̵ A̵I̵ g̵e̵n̵e̵r̵a̵t̵i̵v̵e̵ RL/q-learning | 7.6× | 353k | 2.1k | 174 | 103 |
| 39 | Sep 6, '23 | It looks like @johnowhitaker & I may have found something crazy: LLMs can nearly perfectly memorise from just 1-2 examples! We're written up a post explaining what we've seen, | 7.5× | 348k | 1.7k | 290 | 1k |
| 40 | Dec 30, '24 | SW eng manager: No real work gets done in Jupyter notebooks. Alex Radford: I invented GPT and CLIP in Jupyter notebooks. | 7.2× | 333k | 3k | 176 | 733 |
| 41 | Aug 10, '25 | Now that the era of the scaling "law" is coming to a close, I guess every lab will have their Llama 4 moment. Grok had theirs. OpenAI just had theirs too. | 7.0× | 325k | 2.2k | 97 | 326 |
| 42 | Jan 16, '25 | Lots of OpenAI employees have been dropping hints recently that they've developed ASI internally. But OpenAI's latest product is a buggy mess. This strongly suggests to me that Ope | 6.8× | 316k | 3.4k | 157 | 683 |
| 43 | Apr 16, '23 | The @karpathy approach to LLMops is the correct way | 6.7× | 311k | 1.6k | 77 | 231 |
| 44 | Aug 14, '25 | The vast gulf between all of our actual daily experience with LLM improvements plateauing, vs what some researchers claim is going on, is pretty interesting. You can't properly und | 6.6× | 304k | 1.9k | 112 | 394 |
| 45 | Apr 5, '25 | Just read through the Llama 4 release announcement. I'm really grateful they've released this with open weights. But tbh I'm also pretty disappointed. The models are both giant MoE | 6.5× | 299k | 1.9k | 97 | 546 |
| 46 | Apr 23, '24 | Today at @answerdotai we've got something new for you: FSDP/QDoRA. We've tested it with @AIatMeta Llama3 and the results blow away anything we've seen before. I believe that this c | 6.4× | 296k | 1.8k | 279 | 1.5k |
| 47 | Sep 24, '25 | Chris stopped coding for a few weeks to raise $250m, then straight back to coding!🚀 | 6.3× | 293k | 1.9k | 77 | 326 |
| 48 | Nov 9, '25 | Side effect of blocking Chinese firms from buying the best NVIDIA cards: top models are now explicitly being trained to work well on older/cheaper GPUs. The new SoTA model from @Ki | 6.3× | 290k | 2.8k | 286 | 733 |
| 49 | Mar 9, '20 | As data scientists, we (with @math_rachel) have done our best to look at the data around covid-19, and what it means to you and your community. Our view: it is appropriate to be ve | 6.2× | 0 | 5.8k | 3.1k | 790 |
| 50 | Feb 5, '25 | Wow, actual grown men are still doing the "I asked the LLM about itself and it said" thing. In 2025. Folks, LLMs don't know anything about how they themselves are built or deployed | 5.9× | 272k | 4.3k | 232 | 253 |
| 51 | Feb 3, '25 | Imagine if this was a Chinese company. | 5.6× | 259k | 2.3k | 117 | 228 |
| 52 | Jan 29, '24 | I used to find writing CUDA code rather terrifying. But then I discovered a couple of tricks that actually make it quite accessible. In this video I introduce CUDA in a way that wi | 5.3× | 245k | 2.5k | 347 | 2.7k |
| 53 | Jun 8, '20 | New analysis. Texas re-opened early, without requiring masks. Things are looking bad. NB: chart shows hospitalizations, not cases, so this is not a side-effect of increased testing | 4.9× | 0 | 4.4k | 2.6k | 228 |
| 54 | Jul 8, '22 | I led the team that studied mask efficacy in early 2020 and published our results in the Proceedings of the National Academy of Science. I spent three months earlier this year revi | 4.8× | 0 | 3.9k | 1.7k | 1.6k |
| 55 | Jul 21, '22 | After 2 years, Practical Deep Learning for Coders v5 is finally ready! 🎊 This is a from-scratch rewrite of our most popular course. It has a focus on interactive explorations, &am | 4.6× | 0 | 4.6k | 1k | 2k |
| 56 | Jan 28, '25 | Y’all do understand, I hope, that the reason for the NVIDIA collapse is that the US announced massive tariffs on imported chips, which would destroy NVIDIA’s business entirely, if | 4.6× | 212k | 1.9k | 89 | 247 |
| 57 | Jan 30, '24 | I used to find writing CUDA code rather terrifying. But then I discovered a couple of tricks that actually make it quite accessible. In this video I introduce CUDA in a way that wi | 4.6× | 211k | 2.4k | 378 | 2.6k |
| 58 | Oct 19, '25 | til some folks nowadays consider running a normal linux web server like we've all done for decades to be a "non-standard stack" feels like some kind of learned helplessness or some | 4.5× | 206k | 2.7k | 142 | 314 |
| 59 | Oct 14, '25 | Interesting experience from @karpathy on this new LLM training repo. | 3.9× | 178k | 2.7k | 101 | 560 |
| 60 | Jan 21, '24 | If you're a Python programmer looking to get started with CUDA, this weekend I'll be doing a free 1 hour tutorial on the absolute basics. Thanks to @neurosp1ke, @marksaroufim, and | 3.7× | 169k | 2k | 261 | 1.4k |
| 61 | Feb 20, '20 | This is huge. The creator of the YOLO algorithms, which (along with SSD) set much of the path of modern object detection, has stopped doing any computer vision research due to ethi | 3.6× | 0 | 4.1k | 1.9k | 254 |
| 62 | Oct 16, '25 | 18 months ago, @karpathy set a challenge: "Can you take my 2h13m tokenizer video and translate [into] a book chapter". We've done it! It includes prose, code & key images. It's | 3.5× | 161k | 3.1k | 331 | 2.5k |
| 63 | Jan 25, '25 | R1 reasoning stronger than many humans on this one: | 3.3× | 151k | 1.6k | 84 | 252 |
| 64 | Jan 11, '21 | Our paper, "An evidence review of face masks against COVID-19", written by a cross-disciplinary team of 19 international experts, was published in the Proceedings of the National A | 3.2× | 0 | 3.1k | 1.3k | 585 |
| 65 | Oct 20, '22 | I got a special surprise for you all... We just released the first 5.5 hours of our new course "From Deep Learning Foundations to Stable Diffusion", for free! | 2.9× | 0 | 2.8k | 556 | 1.4k |
| 66 | Jan 7, '20 | I completed my 1st data science project ~30 years ago. Since then I've been continuously developing a questionnaire I use for all new data projects, to ensure the right info is ava | 2.9× | 0 | 3.2k | 891 | 867 |
| 67 | Aug 21, '20 | Today is ’s biggest day in our four year history. We are releasing our new course, fastai v2, fastcore, fastscript, fastgpu, and the official launch of the book. 1/ | 2.9× | 0 | 3.7k | 927 | 499 |
| 68 | Oct 22, '24 | CEO of Microsoft getting ratioed by an anime pfp account... | 2.7× | 127k | 1.9k | 73 | 185 |
| 69 | Sep 16, '22 | Big news: we're launching a new course in <4 weeks. "From Deep Learning Foundations to Stable Diffusion". Bigger news: for this course, we're teaming up with @StabilityAI! AFAIK | 2.7× | 0 | 3.1k | 597 | 1.1k |
| 70 | Jul 24, '24 | Woohoo gpu.cpp has now been officially released! This is a really exciting project which provides a device-independent way to use GPU compute. No more writing separate code for CUD | 2.6× | 121k | 1.6k | 220 | 614 |
| 71 | Feb 28, '20 | We've made a draft of our deep learning book available as @ProjectJupyter notebooks. Important: This is for personal use, and not licensed for any redistribution or change of forma | 2.5× | 0 | 2.8k | 835 | 688 |
| 72 | Mar 24, '20 | This is one of the most amazing and hopeful things I've read. How the Czech Republic, through community effort, got to 100% mask usage in 10 days, nearly all thru home DIY effort. | 2.4× | 0 | 2.5k | 1.1k | 143 |
| 73 | Jan 5, '21 | Wow. @OpenAI has trained a model that can create new images - you just describe them in English. 🤯 | 2.3× | 0 | 3.1k | 778 | 279 |
| 74 | Jul 23, '22 | I've just published over 20 hours of tutorials and live coding showing how to: install python the right way; set up a terminal; write shell scripts; use vim; use a remote Jupyter s | 2.2× | 0 | 2.1k | 404 | 1.1k |
| 75 | Jan 27, '19 | This single line of code solves a years-old bug that has caused problems for thousands of people. No one had figured it out before. It took @StasBekman, one of the best programmers | 2.1× | 0 | 2.9k | 907 | 83 |
| 76 | Jan 25, '19 | Practical Deep Learning for Coders, 2019 edition, is now available. With a shiny new video player with searchable transcripts. This course is 100% new material, including some new | 2.0× | 0 | 2.4k | 852 | 258 |
| 77 | Feb 27, '20 | In our book we always show code equivalents for any math notation. So often, the Python & @PyTorch code is clearer and simpler. And you can actually execute it and try it! For | 2.0× | 0 | 3k | 454 | 314 |
| 78 | Aug 15, '19 | "New State of the Art AI Optimizer: Rectified Adam (RAdam). Improve your AI accuracy instantly versus Adam, & why it works" It's been a long time since we've seen a new optimiz | 2.0× | 0 | 2.3k | 797 | 354 |
| 79 | Apr 13, '20 | We've just completed a 19-author analysis of the effectiveness of mask wearing, with 84 references. To explain what the science shows, I teamed up with the wonderful Prof @trishgre | 2.0× | 0 | 1.6k | 988 | 180 |
| 80 | May 31, '24 | @GrantSlatton I did the same thing in America when Americans couldn't understand my Australian accent. I used a ridiculous caricature of a US accent and then folks understood me. | 2.0× | 91k | 1.9k | 8 | 27 |
| 81 | Mar 25, '20 | What's happening here? Does this masks thing really make sense, scientifically? Yes, it does! Here's 34 scientific papers that all point to the same thing: masks (even home made on | 1.9× | 0 | 1.7k | 924 | 260 |
| 82 | Sep 20, '21 | I'm the lead author of the first and largest academic evidence review of masks, published in the Proceedings of the National Academy of Sciences, with 141 references. The claim tha | 1.9× | 0 | 2.1k | 877 | 188 |
| 83 | Jan 26, '19 | Wow wow wow! @GoogleColab now supports the fastai library directly :D That means you can run all the lessons at , and do your own research and development with fastai, all for free | 1.9× | 0 | 2.6k | 664 | 202 |
| 84 | Feb 24, '20 | We're launching `fastpages`, a platform which allows you to host a blog for free, with no ads. You can blog with @ProjectJupyter notebooks, @office Word, directly from @github's ma | 1.8× | 0 | 2.1k | 606 | 395 |
| 85 | Feb 3, '25 | There's only 5 grok icons on my home screen? C'mon folks you can fit on *way* more than that. | 1.8× | 83k | 2.4k | 56 | 51 |
| 86 | Sep 26, '18 | Proud to be launching "Introduction to Machine Learning for Coders" today. If you're looking for a modern, code-first, opinionated introduction to machine learning, I think you mig | 1.7× | 0 | 2.2k | 697 | 240 |
| 87 | Oct 12, '18 | Learn: - Intro Machine Learning - Practical Deep Learning - Cutting Edge Deep Learning - Computational Linear Algebra | 1.7× | 0 | 2.1k | 603 | 325 |
| 88 | Aug 1, '24 | My recording studio for the FastHTML video :D | 1.7× | 78k | 1.9k | 19 | 70 |
| 89 | May 12, '22 | TIL it's this easy to plot math functions in Python, thanks to @SymPy. No more mucking about manually with np.linspace and matplotlib and friends... | 1.6× | 0 | 2.2k | 305 | 399 |
| 90 | Jun 28, '19 | Learn: - Practical Deep Learning - Deep Learning Foundations - Computational Linear Algebra - Intro Machine Learning | 1.4× | 0 | 1.7k | 423 | 403 |
| 91 | Mar 4, '22 | I am over the moon to announce: 1) I'm now a professor at University of Queensland (UQ), the top institute in my home state! 2) I'll be teaching a brand new deep learning course at | 1.4× | 0 | 2.6k | 169 | 137 |
| 92 | Jul 18, '20 | I'm happy this little-known data scientist helped make a difference! 😊 | 1.4× | 0 | 2.5k | 235 | 83 |
| 93 | Feb 24, '21 | I'm really excited to say that I'm sending this tweet from Australia - our new home!😃 I learned lots in SF and had a great experience, but we've decided that long-term the US isn' | 1.4× | 0 | 2.8k | 65 | 30 |
| 94 | Jun 19, '20 | The picture above shows speech droplets, which are believed to be the key transmission vector for COVID-19, with vs without a paper towel face cover. As you see, nearly all droplet | 1.2× | 0 | 1.5k | 520 | 60 |
| 95 | Oct 11, '18 | Every week I get asked "what's 's business model?" Our business model is: we spend our personal money to do stuff that helps people use deep learning. That's it. We're totally inde | 1.1× | 0 | 1.9k | 314 | 16 |
| 96 | Jun 19, '20 | So if masks look so good on paper, do they work in practice? They sure seem to! In countries with universal mask-wearing, per-capita coronavirus mortality increased by just 5.4% ea | 1.1× | 0 | 1.3k | 550 | 53 |
| 97 | Jan 25, '19 | Practical Deep Learning for Coders, 2019 edition, will be released tomorrow. It's looking amazing. | 1.1× | 0 | 1.7k | 304 | 84 |
| 98 | Feb 21, '20 | We have a *lot* of really great news to share with you regarding our forthcoming book, "Deep Learning for Coders", thanks to the amazing @OReillyMedia content team. 1: We're expand | 1.1× | 0 | 1.5k | 287 | 216 |
| 99 | Dec 5, '22 | I remember well when Google was first released. I felt confident that it would become a critical tool that we'd all rely on. I haven't felt that way again, until now: ChatGPT. In j | 1.0× | 0 | 1.8k | 145 | 111 |
| 100 | Feb 12, '24 | The actual reason that it's oriented at 3 o'clock and goes anti clockwise is because that's the correct orientation. If you're gonna criticise someone for promoting learning, you s | 0.6× | 27k | 1.5k | 8 | 11 |