Nando de Freitas

@NandoDF112k followers

I seek to understand intelligence & agency and build AI aligned with compassion, freedom & universal human empowerment through progress in science & engineering

Open on X
Top outlier
43.5×
Best organic post
Peak views
683k
Single post
Bookmarks
16k
Across 97 organic posts
Last scan
Oct 16
Community cache
Posts 97 posts
#DatePost↓ OutlierViewsLikesRepostsBookmarks
1Oct 19, '24I’ve walked through poor neighbourhoods in India, Africa and LatAm many times. Yet, I recently walked through one of the most depressing ones in terms of poverty, drug abuse, and s43.5×683k1.8k121363
2Aug 17, '24Hmmm, from what I see my colleagues in AI at Google London work bloody long ours and are extremely committed. This guy once came to London and told us to abandon Torch and use Tens26.4×416k2.4k95402
3Mar 25, '24There appears to be a mismatch between publishing criteria in AI conferences and "what actually works". It is easy to publish new mathematical constructs (e.g. new models, new laye19.9×313k1k188710
4Nov 12, '25I still remember that 2013 @NeurIPSConf party with Mark Zuckerberg. He had a bottle of water at that first Neurips corporate party. I thought it was out of character for a Neurips 17.5×275k1.2k86379
5Feb 4, '23Nvidia released the megatron language model before the pandemic. It’s amazing how influential this paper became. A must read for people wanting to learn about AI.16.1×254k872128592
6Sep 1, '24Some companies can turn the most motivated scientists and engineers into unproductive, complacent hamsters. They do this by introducing a large number of levels and process-heavy p15.6×245k60767235
7Oct 30, '25We are hiring star research and data engineers to invent the future of AI. JoinAITeam@microsoft.com If you’re finishing your undergrad or PhD at Imperial, Cambridge, Oxford, UCL, T14.2×223k67167717
8Sep 27, '25The only bitter lesson is that LLMs have succeeded beyond any expert expectations. Underpinning LLMs is the idea of scaling, which is too often misunderstood as more parameters. Sc12.5×196k67671429
9Dec 15, '24Let us please talk more about mental health in the AI community. I was shocked and reminded of this by the sad and tragic death of this young colleague with so much talent. Many of12.1×190k64976147
10Apr 9, '24This is by far the best non-technical Natural and Artificial Intelligence book anyone could read. This comprehensive, well-researched, crisply clear, sharply focused and illuminati12×188k8331261k
11Sep 14, '25If you have 10K data instances, would you: 1. SFT an LLM with 10K data, or 2. Learn a reward with 5K, and RL the LLM on the remaining 5K with the learned reward 3. Other (explain)?11.3×177k44620391
12Oct 12, '25Machines that can predict what their sensors (touch, cameras, keyboard, temperature, microphones, gyros, …) will perceive are already aware and have subjective experience. It’s all11.1×175k37358256
13Sep 7, '24The Llama 3 paper is a must-read for anyone in AI and CS. It’s an absolutely accurate and authoritative take on what it takes to build a leading LLM, the tech behind ChatGPT, Gemin10.2×160k1.8k2751.5k
15Feb 18, '24I agree with @DrJimFan. Life, with all its midblowing structure, is about creating order in a universe of increasing disorder, see e.g. for an easy intro. Like a cell, a neural net9.9×155k32964224
16Dec 18, '23I’m with @ylecun and @AndrewYNg on this. I feel it is more responsible to devote greater effort to solving today’s problems (e.g. climate, health, energy, poverty, safety, communic9.4×148k4775448
17Mar 29, '24Predicting the next word "only" is sufficient for language models to learn a large body of knowledge that enables then to code, answer questions, understand many topics, chat, and 8.6×134k640125580
18Sep 13, '24It’s time to say thank you and goodbye to @GoogleDeepMind. I had the immense fortune of working there for 10 years. They were undoubtedly the most exciting years in the history of 8.2×130k1.4k31147
19Apr 20, '25RL is not all you need, nor attention nor Bayesianism nor free energy minimisation, nor an age of first person experience. Such statements are propaganda. You need thousands of peo7.3×115k1.4k189471
20Apr 4, '24Thanks @osanseviero and @huggingface for inviting me to a wonderful AI dinner, where I had the pleasure of catching up with old friends, @sarahookr @neilzegh @laurentsifre @ylecun,6.9×109k3141527
21Sep 16, '24I’ve joined @Microsoft AI to advance the frontier of large scale multimodal AI research and to build products for people to achieve meaningful goals and dreams. The MAI team is sma6.9×109k95446207
22May 8, '25Why don’t you compete with ChatGPT? Last time I checked Gemini app was an order of magnitude behind. More seriously, this arrogance and comparative disparaging is toxic and not nee6.5×103k331854
23Sep 9, '19I believe I have written more papers than Alan Turing + John Nash! Numbers of papers alone is a wrong misleading metric. Please focus instead on writing good papers that advance th6.3×01.8k35843
24Oct 8, '24For the first time in my life I can explain what the physics @NobelPrize is about! In fact, if you’d like to learn what is a Hopfield net and how it relates to NP hard satisfiabili6.2×97k57469495
25Sep 21, '25Most RL for LLMs involves only 1 step of RL. It’s a contextual bandit problem and there’s no covariate shift because the state (question, instruction) is given. This has many impli6.1×97k69759709
26Oct 7, '25I would like to hire exceptional engineers (code, math, science, games, video) . Essential: people who want to transform the world in positive ways by advancing AI. Email me at: Jo5.9×93k75949801
27Dec 19, '20Can AI researchers please tweet: I am against racism, sexism, bullying and cancelling, and I believe in improving diversity, equity and inclusion in our AI community. We need to he5.8×01.3k32626
28Nov 22, '24The OpenAI letters: Some of what is said here is absolutely shocking. The politics, hysteria, incompetence, power hunger, gaslighting, etc are beyond any HBO show. I was a leading 5.6×88k71990494
29Mar 26, '25Dear @GoogDeepMind ers, First, congrats on the new impressive models. Every week one of you reaches out to me in despair to ask me how to escape your notice periods and noncompetes5.5×87k45640201
30May 14, '22Someone’s opinion article. My opinion: It’s all about scale now! The Game is Over! It’s about making these models bigger, safer, compute efficient, faster at sampling, smarter memo5.2×0830207261
31Jul 1, '24It amazes me that so many (even tech) people still don't get the transformative power of generative AI. The best text to image and video models in existence today all use synthetic5.1×79k31853261
32Sep 20, '24The @OpenAI o1 models represent one of the smartest advances in AI in a long time. Having just joined @Microsoft AI, one of the things I really look forward to is being able to con5.0×78k3641453
33Nov 30, '24I used a metaphor that upset some people. I welcomed the feedback, and I have deleted the tweet. I also apologise to anyone I might have offended. The rest of the tweet is about so4.9×77k2873273
34Oct 21, '25One of the most important papers of the year.4.6×72k38025147
35Jul 7, '19View point invariance is an important inductive bias in how we perceive objects - here tested to the limit by a smart artist.4.4×01.1k31066
36Jan 25, '23This video on distributed neural net training should be part of every machine learning & AI course in the world. It is brilliantly done. Thanks ⁦@gbarthmaron⁩ for pointing me t4.4×69k36872307
37Dec 10, '23Once upon a time at a #NeurIPS party. So much changed. Thanks @sirbayes for finding this.3.7×59k283216
38Apr 3, '21Mike Jordan defending ML engineering! Good engineering gave us the GPU convnets, the transformers, torch, numpy, etc. The popular diminishing meme “it’s-just-engineering” is silly,3.5×097514492
39May 5, '19Beautiful explanation of transformer neural networks3.5×0736211137
40Aug 7, '25Work life balance is a top priority. Yes, there was nearly a decade in my life when I worked 98 hours, but I did it out of need and aspiration, not because anyone forced me. During3.2×50k46221240
41May 9, '22Game over. Scale is essential to AI.3.2×08578396
43Sep 3, '24It is remarkable that anyone can now train a 124M parameter LLM in about real-time on a MacBook M3. So easy to experiment. This would have been the stuff of dreams when I was in sc3.0×47k52027138
44Sep 21, '19Last decade in AI was about solving big associative learning: Language models, image labelling, speech recognition, lipreading, Starcraft, etc. A triumph! The recipe was always the2.8×071115948
45Mar 11, '23Diffusion as a neural net, a language model in jax, attention and transformers — some slides from my ⁦@Khipu_AI⁩ tutorial2.7×43k34052134
46Jun 28, '20Our field lacks diversity. This is the biggest danger of AI. As we witnessed this week, it is not easy to tear the chains of history. Few of us are able to rise above our environme2.5×062615135
47Jun 8, '25Many people work through the weekend, without time to announce it on Twitter. I spent my Sunday happily with my family and friends, supporting and sharing love. I feel as a result 2.5×39k3681136
48Jun 6, '18Building a Deep Neural Network to play FIFA 182.5×057618130
49Dec 31, '18For anyone wanting to make their lectures freely available to everyone . It’s highly rewarding when people approach me at conferences and tell me they got into machine learning by 2.4×07049931
50Jun 18, '20This is such an important tweet for new researchers: A Turing award winner’s public admission that failure is ok. It’s through trying and failing (ie falsifying some hypotheses) th2.3×071111510
51Feb 24, '22What role can the AI community play in a world where bullies attack peaceful democratic countries 🇺🇦 and threaten the world? I’m really curious to hear from everyone.2.3×05344744
52Oct 3, '1927,600 GPUs, 1/2 PB data, and a neural net with 220,000,000 weights. More please!2.2×054410244
53Sep 6, '25I loved this research paper on Flow Matching, the most popular approach for video gen. TLDR: More data means harder to fit any specific data (say image), better generalisation, gre2.2×35k30824332
54Oct 26, '19A neural net solves the three-body problem 100 million times faster2.1×048413060
55Jun 16, '18Solving the Rubik's Cube Without Human Data2.1×046117129
56Dec 7, '19Dear friends, this year I will not attend #NeurIPS2019. This is the last year before my littlest daughter starts going to school. It is important for dads to spend time with their 2.1×0838122
57Mar 2, '18It is beyond any doubt that over the next few years we will perfect the technology for automatically generating a video of anyone saying anything we type, with the right voice too.2.1×03871708
58Jul 6, '21The future of deep learning, according to its pioneers – Wise insights.2.0×040789122
59Feb 9, '19Ptolemy was a genius, but alas! a simpler model came along. Keep it simple and ensure it makes good testable predictions.2.0×046311670
60Dec 14, '18“I think the brain isn’t concerned with squeezing a lot of knowledge into a few connections, it’s concerned with extracting knowledge quickly using lots of connections.” Geoff Hint2.0×046813238
61Jul 1, '19Machine learning to automatically translate long-lost languages2.0×042115432
62Feb 21, '25Feeling pressure to work more than 5 days per week? Don’t. I’ve been super productive all my life and I never worked on the weekend unless I was excited about something. I don’t re2.0×31k4852363
63Sep 13, '19I recommend this paper with theoretical and algorithmic insights on metalearning to researchers interested in hierarchical Bayes, MAML, and Reptile. It addresses the idea of learni2.0×043410688
65Dec 21, '18Our meta-learning approach is state-of-the-art in Text-2-Speech, and does it in 5mins instead of 4 hours. This shows that neural nets can work with few data, when we embrace many t1.8×042711935
66Dec 20, '18My slides for the #NeurIPS2018 Meta-Learning are now up. Big thanks to the organisers!1.8×039811451
67Sep 14, '17Deep learning and TF, without a Ph.D. by Martin Görner. Brilliant teaching resource @DeepIndaba1.7×04341440
68Mar 10, '19⁦Yann @ylecun⁩ is a visionary who advocated for SGD, GANs, convnets, contrastive losses, deep nonlinear models, autodiff modular software, etc when most thought he was joking. As a1.7×04968922
69Feb 10, '18Why do we label emotions as positive and negative? It’s unsatisfactory that such a key component of cognition is modelled with such a crass binary classifier. In AI we need to get 1.7×04191080
70Dec 28, '19It would help the discussion if everyone first 1. reads a causal inference book, eg , 2. watches a deep learning course emphasising modularity, compositionality and automatic diffe1.7×032468125
71Aug 24, '19I agree. This was a phenomenal paper. I’m hoping it will inspire researchers to probe further.1.7×04197569
72Sep 30, '18ICLR 2019 lessons thus far: The deep neural nets have to be BIGGER and they’re hungry for data, memory and compute. GANs, Res-blocks, LSTMs, convnets, & multiagent tricks are d1.7×041011119
73Jan 28, '17I'm agnostic and not a fan of religion, but I refuse to visit a country that introduces bans on Muslims and refugees. #nips2016 #nips2venues1.7×04091160
74Sep 26, '25After 55, one reflects on life. For me, mathematics was the most beautiful world I encountered.1.6×26k283623
75Jun 24, '20This is a superb and inspiring artificial intelligence talk. The best I’ve heard this year. Anyone interested in vision, control, robotics or managing AI projects should watch this1.6×028870124
76Oct 23, '19The @OpenAI paper is excellent. It is an achievement and it highlights the biggest AGI challenges (perception, long-horizon, exploration, motor control, compositionality, meta and 1.6×04029233
77Mar 13, '17Google Brain’s new super fast and highly accurate AI: the Mixture of Experts Layer.1.6×03411550
78Mar 2, '19Where can we find other cool examples of continuous systems like this one being used to output discrete symbols? Could be potentially nice for neural networks. Thanks!1.5×04076637
79Nov 12, '19The poster has no affiliation because in Guatemala AI research is what committed researchers do at night on their own, after a day of work. Touching and inspiring ⁦@Khipu_AI⁩1.5×0470626
80Dec 7, '20This will be a long thread. It represents my views solely. Many are puzzled by why I feel it possible to support both @JeffDean and @timnitGebru so I’d like to explain. I will star1.5×04253348
81May 29, '19The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning)1.4×02977263
82Jan 10, '19Neural Ordinary Differential Equations .... blog explains1.4×03038346
83Dec 7, '16What a amazing authoritative tutorial on deep reinforcement learning at #nips2016 - a must read set of slides!1.3×03091231
84Mar 13, '19For anyone interested in meta-learning / learning to learn / continual learning / robotics / imitation, I’ll be giving a talk covering these topics at the Turing Institute in Londo1.3×03816321
85Mar 31, '17One-Shot Imitation Learning - This paper is excellent.1.3×03251032
86Mar 14, '18At 17 from Caracas to Joburg, I stopped in Rio for 3 days. I bought a book. It changed me. It was my company in dark hardworking days selling beer for a living. At 21 I went to uni1.3×0434550
87Oct 22, '21Shaking the foundations: delusions in sequence models for interaction and control. I learned so much from Pedro Ortega in this thought-provocative AI project. Great way to spend ti1.3×02713189
88Jun 6, '17One of the most important deep learning papers of the year, thus far.1.2×0299990
89Dec 3, '19This type of intelligence always amazes me.1.2×03216414
90Dec 9, '20This is EPIC!! It will go in history as one of the best #neurips talks of all times. ⁦@isbellHFh⁩ and colleagues 💜💙💚💛🧡❤️ on: Can’t Escape Hyperparameters and Latent Variables:1.2×02713571
91May 12, '22Two years in the making by a talented, collaborative, and fun team, and with enormous help and support from many others at @DeepMind. No better place to be! Congrats @scott_e_reed 1.1×03282629
92Sep 17, '20So glad to see the value of scientific software frameworks being properly recognised.1.1×03464413
93Jun 22, '18Adobe is using machine learning to make it easier to spot Photoshopped images1.1×0273797
94Oct 20, '19I find it funny folks are focusing on the symbolic challenge. The big challenge is attaching that hand to a moving controllable robot arm, and preferably having two coordinated han1.1×02954723
95Jan 15, '22Here is a great challenge for quadruped robotics — Super Cat Intelligence. 🐭 risky, but nonetheless good benchmark tasks1.1×02984324
96Jan 25, '18#ICLR 2019 could happen in Cape Town, South Africa. It’s time for an ML conference to go to Africa. It’s the right thing to do, and we all know it.1.1×0307570
97Oct 20, '21If you’re advertising a machine learning or AI scholarship or job on Twitter, please consider announcing it to @QueerinAI @AiDisability @black_in_ai @Khipu_AI @DeepIndaba @_LXAI @W1.0×02735122
98Nov 15, '19It is incredibly transformative when a tech leader like @JeffDean participates at events like @Khipu_AI and @DeepIndaba He gives hope, builds confidence, and helps create new oppor1.0×0333385
99Nov 5, '17This is one of the most thought provoking and transforming books I have read recently. Solid research, heart-warming. Highly recommend it.1.0×0310441
100Mar 10, '19Today I felt very positive about the work I’ve been doing with students at UBC and Oxford, and with colleagues at DeepMind when (1) a complete stranger approached me at a Camden gy0.8×0291125

Scan another creator

@

Run this on any account.

XOutlier builds this table for every public profile you open on x.com, with live data and every post, not just the top 50.