Georgi Gerganov

@ggerganov73k followers

24th at the Electrica puzzle challenge | building | engineer @huggingface

Open on X

Top outlier

1298×

Best organic post

Peak views

17.6M

Single post

Bookmarks

70k

Across 95 organic posts

Last scan

Oct 16

Community cache

Posts 95 posts

#	Date	Post	↓ Outlier	Views	Likes	Reposts	Bookmarks
1	Feb 24, '25	Today I was sent the following cool demo: Two AI agents on a phone call realize they’re both AI and switch to a superior audio signal ggwave	1298×	17.6M	90k	13k	38k
2	Mar 26, '23	Introducing LLaMA voice chat! 🦙 You can run this locally on an M1 Pro	124×	1.7M	7.8k	1.3k	3.6k
3	Aug 31, '23	Full F16 precision 34B Code Llama at >20 t/s on M2 Ultra	85.6×	1.2M	2.1k	244	676
4	Feb 24, '25	The developers (Anton and Boris) used the ggwave library to make the AIs communicate faster over a phone call	83×	1.1M	4k	243	1k
5	Jun 6, '23	I've started a company: From a fun side project just a few months ago, ggml has now become a useful library and framework for machine learning with a great open-source community	80.5×	1.1M	3.3k	358	664
6	Jan 27, '25	pack it up boys, it's over	52.1×	706k	7.3k	590	2.6k
7	Sep 7, '23	Casually running a 180B parameter LLM on M2 Ultra	50.5×	683k	3.7k	367	850
8	Feb 24, '25	The "gibberlink" project is hosted here: They won 1st place in a hackaton competition! Congrats!	45×	609k	2.3k	127	706
9	Feb 24, '25	You can actually decode the audio messages from the video above using the waver webpage:	32.8×	444k	1.1k	58	264
10	Mar 27, '23	LLaMA voice chat + Siri TTS This example is now truly 100% offline since we are now using the built-in Siri text-to-speech available on MacOS through the "say" command	30.5×	413k	2.4k	344	867
11	Jun 4, '23	The future of on-device inference is ggml + Apple Silicon You heard it here first!	25.6×	346k	1.6k	166	298
12	Oct 10, '23	👀 What is this black magic!?	22.8×	309k	981	127	552
13	Aug 6, '25	LMStudio are using the upstream ggml implementation which is significantly better and well optimized. Looking at ollama's modifications in ggml, they have too much branching in the	22.5×	305k	1.4k	98	435
14	Mar 5, '23	I think I can make 4-bit LLaMA-65B inference run on a 64 GB M1 Pro 🤔 Speed should be somewhere around 2 tokens/sec. Is this useful for anything?	21.6×	293k	430	17	92
15	Mar 10, '23	Simultaneously running LLaMA-7B (left) + Whisper Small (right) on M1 Pro	20.9×	284k	1.4k	173	413
16	Jul 29, '23	guys it’s real	20.7×	281k	1.6k	60	21
17	Mar 22, '24	Causally running Grok-1 at home	20.5×	277k	1.6k	149	294
18	Mar 3, '25	Here is another Gibberlink experiment: Two AI agents autonomously encrypt their audio chat (video by Anton Pidkuiko)	20×	271k	2.2k	318	1.2k
19	Jul 23, '23	llama2.c running in a web-page Compiled with Emscripten and modified the code to predict one token per render pass. The page auto-loads 50MB of model data - sorry about that 😄	19.8×	268k	844	136	321
20	Sep 5, '23	sam.cpp 👀 Inference of Meta's Segment Anything Model on the CPU Project by @YavorGI - powered by	19.6×	265k	1.9k	262	684
21	Jan 28, '25	DeepSeek-R1 on Mac Studio 192GB 🪄	19.2×	260k	1.5k	152	762
22	Aug 24, '23	Here are some inference numbers for Code Llama on M2 Ultra at different quantum levels using latest llama.cpp pp - prompt processing tg - text generation Code Llama 7B	18.9×	256k	527	60	138
23	Jan 20, '25	Make your Mac think 🧠 Tomorrow I'll show you how to enable speculative decoding for extra speed.	17.5×	237k	931	76	592
24	Dec 9, '23	ggml will soon run on billion devices @apple don't sleep on it 🙃	17.2×	232k	1.2k	120	159
25	Nov 4, '25	A detailed look into the new WebUI of llama.cpp	17×	231k	751	79	276
26	Jan 21, '25	Make your Mac think faster 🧠🧠 Tomorrow I'll show you how to cancel your copilot subscription.	16.5×	224k	1.2k	112	1.2k
27	Mar 11, '23	Just added support for all LLaMA models I'm out of disk space, so if someone can give this a try for 33B and 65BB would be great 😄 See updated instructions in the Readme Here is L	15.8×	214k	970	128	325
28	Aug 7, '23	Let’s see what this rock can do	15.5×	210k	1.3k	24	64
29	Nov 27, '23	Wrote a short tutorial for setting up llama.cpp on AWS instances For example, you can use one of the cheapest 16GB VRAM (NVIDIA T4) instances to serve a quantum Mistral 7B model to	15.1×	204k	1.4k	166	1.2k
30	Jul 12, '23	ggtag : data-over-sound is back ! Please checkout our latest geeky side project -- An e-paper badge that can be programmed with sound Here is how it works 🔊	15×	203k	2k	232	588
31	May 28, '24	llama.cpp is now in Homebrew Core 🍺	14.6×	198k	2.2k	216	402
32	Apr 1, '23	Announcing the Local LLaMA podcast 🎙️🦙 In today's episode we have LLaMA, GGaMA, SSaMA and RRaMA joining us to discuss the future of AI	14.4×	195k	1.3k	178	392
33	Mar 19, '23	The llama.cpp repo is buzzing with activity today. Here are some highlights Added Alpaca model support and usage instructions	14×	190k	912	70	240
34	Aug 11, '25	whisper.cpp is coming to ffmpeg	13.1×	178k	1.5k	171	504
35	Apr 15, '23	whisper.cpp v1.3.0 now with Core ML support Currently, the Encoder runs on the ANE, while the Decoder remains on the CPU. Check the linked PR 566 for implementation details and usa	12.9×	175k	735	114	180
36	Nov 21, '23	Native whisper.cpp server with OAI-like API is now available $ make server && ./server This is a very convenient way to run an efficient local transcription service locally	12.7×	172k	1.2k	146	789
37	Jun 23, '25	LlamaBarn (sneak peek 👀)	12.7×	172k	1k	58	306
38	Dec 11, '23	Adding support for the new Mixtral models Runs on CPU, CUDA and Metal with quantization support and partial GPU offloading. Very interesting architecture to play with!	12×	162k	1.3k	138	364
39	Jun 23, '23	shower thought : drop the position embeddings, rewrite the transformer using complex numbers, encode the position information in the complex phase ref : see how MRI phase encoding	12×	162k	595	22	162
40	Mar 28, '23	llama.cpp just got access to the new Copilot for Pull Request technical preview by @github Just add tags like "copilot:all" / "copilot:summary" / "copilot:walkthrough" to your PR c	11.9×	161k	941	88	218
41	Aug 19, '25	The ultimate guide for using gpt-oss with llama.cpp - Runs on any device - Supports NVIDIA, Apple, AMD and others - Support for efficient CPU offloading - The most lightweight infe	10.6×	143k	723	95	508
42	Nov 21, '23	Here is how to deploy and serve any LLM on HF with a single command in less than 3 minutes with llama.cpp $ bash -c "$(curl -s )"	10.6×	143k	828	133	746
43	Dec 15, '23	Running some LLM benches on iPhone 13 Mini This is 1.1B TinyLlama. Speed looks quite reasonable. Wonder what would be some cool applications that we can try out 🤔 P.S. Forget abou	10.3×	140k	698	63	274
44	Jun 25, '23	Took the time to prepare a ggml development roadmap in the form of a Github Project This sets the priorities for the short/mid term and will offer a good way for everyone to keep t	10.1×	137k	472	38	99
45	Mar 14, '23	Here is what a properly built llama.cpp looks like Running 7B on 2 years old Pixel 5 at 1 token/sec. Would be interesting to see how an interactive session feels like	10×	136k	432	63	87
46	Apr 18, '23	Initial low-rank adaptation support has been added to llama.cpp We now have the option to apply LoRA adapters to a base model at runtime. Lots of room for improvements and opens up	9.8×	132k	523	81	107
47	Mar 26, '23	This is the prompt for anyone interested:	9.3×	126k	408	48	138
48	Jul 10, '23	llama.cpp now supports distributed inference across multiple devices via MPI This is possible thanks to @EvMill's work. Looking for people to give this a try and attempt to run a 6	9.2×	124k	831	130	187
49	Oct 23, '23	llama.cpp server now support multimodal (LLaVA) 🎉 Huge shoutout to FSSRepo and monatis	8.7×	118k	1.1k	126	234
50	Apr 3, '25	Google is taking local AI to the next level with Gemma 3 QAT GGUF models Uncompromised quality with quantization-aware training and uncompromised on-device performance with ggml. T	8.6×	116k	1.3k	148	627
51	Mar 10, '23	Here is 4-bit inference of LLaMA-7B using ggml: Pure C/C++, runs on the CPU at 20 tokens/sec (M1 Pro) Generated text looks coherent, but quickly degrades - not sure if I have a bug	8.6×	116k	704	118	246
52	Mar 28, '23	I'm thinking about making an open-source local iOS voice chat app running Whisper Base + 4-bit Cerebras-GPT 2.7B. Should be able to run quite real-time on newer iPhones Pretty sure	8.6×	116k	702	39	112
53	Jul 16, '23	Very cool experiment by @chillgates_ Distributed MPI inference using llama.cpp with 6 Raspberry Pis - each one with 8GB RAM "sees" 1/6 of the entire 65B model. Inference starts aro	8.4×	114k	417	70	127
54	Aug 5, '25	Llama.cpp supports the new gpt-oss model in native MXFP4 format The ggml inference engine (powering llama.cpp) can run the new gpt-oss model with all major backends, including CUDA	8.4×	114k	1k	139	334
55	Apr 11, '23	Will be cancelling my Github Copilot subscription soon 🙃	8.4×	114k	431	31	155
56	Mar 14, '23	I'm trying to figure out what this means Any ideas?	8.4×	114k	486	31	23
57	Jun 6, '23	2,3,4,5 and 6-bit quantization methods are now available in llama.cpp Efficient inference implementation with ARM NEON, AVX2 and CUDA - see sample numbers in the screenshots Big th	8.1×	109k	547	73	104
58	Oct 8, '23	M2 Ultra serving Q8_0 LLaMA-v2 70B to 4 clients in parallel	8.0×	109k	615	62	184
59	Aug 31, '23	The ggml roadmap is progressing as expected with a lot of infrastructural development already completed We now enter the more interesting phase of the project - applying the framew	7.8×	106k	506	41	76
60	Apr 4, '24	Challenge accepted! 😀	7.7×	104k	537	32	68
61	Sep 3, '23	Experimenting with speculative decoding + grammar sampling This is an example of summarizing a short story into a structured JSON. We again utilize speculative decoding, but this t	7.3×	98k	640	65	233
62	Apr 11, '23	Can't help but feel the AI hype is oriented in a non-optimal direction It's almost as if we had just discovered the FFT algorithm and instead of revolutionizing telecommunications,	7.2×	98k	487	29	51
63	Sep 25, '24	Llama 3.2 3B & 1B GGUF	7.0×	94k	426	80	123
64	Oct 24, '23	Serving 8 clients in parallel on A100 with llama.cpp Model: Codellama 7B F16 System prompt: 305 tokens Requests: 128 Max sequence length: 100 Continuous batching: enabled Average s	6.8×	92k	575	61	163
65	Aug 28, '25	To run gpt-oss-20b on a 16GB Mac use these commands: brew install llama.cpp llama-server -hf ggml-org/gpt-oss-20b-GGUF --n-cpu-moe 12 -fa -c 32768 --jinja --no-mmap Then open the b	6.7×	90k	912	110	723
66	Aug 28, '25	gpt-oss is a great model IMO OpenAI showed us the blueprint for winning local AI: - Interleaved SWA - Small head sizes in the attention - Attention sinks - Mixture of Experts FFN -	6.1×	82k	977	74	377
67	Nov 15, '23	whisper.cpp v1.5.0	6.0×	81k	564	68	117
68	Nov 21, '23	Very clever stuff! Will be adding a llama.cpp example soon	5.9×	80k	433	37	154
69	Mar 12, '23	Interactive chat mode added to 🦙.cpp It actually works surprisingly well from the few tests that I tried! Kindly contributed by GH user Blackhole89	5.9×	80k	457	41	83
70	Mar 29, '23	I'm color-coding Whisper tokens based on their probs -- green means confident. All models behave in a similar way (first 3 images), except for Large V2. The probs are all over the	5.8×	79k	425	27	116
71	Jan 22, '25	llama.vscode (powered by Qwen Coder)	5.7×	78k	466	64	327
72	Nov 2, '23	llama.cpp is standing ground against the behemoths The CUDA backend is contained in a single C++ file so it allows for very easy deployment and custom modifications (pp - prefill,	5.7×	77k	554	46	113
73	May 28, '23	The plan for adding full-fledged GPU support in ggml is starting to take shape Today I finally finished the ggml computation graph export / import functionality and demonstrated a	5.6×	76k	421	59	75
74	Mar 15, '24	The GGUF file format is a great example of the cool things that an open-source community can achieve. Props to @philpax_ and everyone else involved in the design and implementation	5.4×	73k	485	61	113
75	Jul 4, '23	whisper.cpp now supports @akashmjn's tinydiarize models These fine-tuned models offer experimental support for speaker segmentation by introducing special tokens for marking speake	5.1×	69k	487	62	178
76	Feb 21, '24	Run @Google's Gemma Open Models with llama.cpp	5.0×	68k	606	71	134
77	May 23, '23	Top quality post on r/LocalLLaMA today 😅 Btw, great subreddit!	4.8×	65k	604	51	65
78	Oct 21, '24	llama.vim : Neovim plugin for local text completion (powered by llama.cpp)	4.8×	65k	527	65	244
79	Apr 5, '24	GGUF My Repo by @huggingface Create quantum GGUF models fully online - quickly and secure. Thanks to @reach_vb, @pcuenq and team for creating this HF space! In the video below I gi	4.8×	65k	439	84	247
80	Sep 19, '23	Initial tests with parallel decoding in llama.cpp A simulated server processing 64 client requests with 32 decoding streams on M2 Ultra. Supports hot-plugging of new sequences. Mod	4.7×	64k	452	52	109
81	Aug 25, '23	ROCm support in llama.cpp 4 months community effort enables AMD devices to run quantum LLMs with high efficiency. Really great to see the strong collaboration in this work!	4.6×	62k	431	61	53
82	Mar 7, '23	Progress update on adding Core ML support to whisper.cpp We can now run the small model with a 400ms time step quite efficiently thanks to evaluating the Encoder on the ANE	4.5×	61k	469	41	122
83	May 1, '23	New release: whisper.cpp v1.4 - Added 4-bit, 5-bit and 8-bit integer quantization - Added partial GPU support via cuBLAS	4.5×	61k	489	62	94
84	Nov 2, '24	ggml inference tech making its way into this week’s @apple M4 announcements is a great testament to this. IMO, Apple Silicon continues to be the best consumer-grade hardware for lo	4.4×	59k	531	44	96
85	Jan 27, '25	jk we are just starting	4.3×	59k	527	15	136
86	Sep 12, '23	Full GPU Metal inference with whisper.cpp This is the Medium model on M2 Ultra, greedy decoding	4.3×	58k	542	51	121
87	Oct 18, '23	Some of llama.cpp's features	4.2×	57k	464	34	83
88	Jan 27, '25	Here is the most cost effective way to deploy (the real) R1 in the cloud - use llama.cpp-powered inference endpoints @huggingface The @UnslothAI quantizations fit neatly in 4x L40S	4.2×	57k	705	97	490
89	Apr 8, '25	Retweet if you want llama.cpp added here 👇	3.5×	48k	549	213	50
90	Mar 21, '24	llama.cpp releases now ship with pre-built macOS binaries This should reduce the entry barrier for llama.cpp on Apple devices Thanks to @huggingface for the friendly support 🙏	3.4×	46k	708	65	123
91	Sep 3, '25	VS Code adds support for custom OAI-compatible endpoints This a big win for local AI as it allows us to use any local model provider without vendor lock-in. Big thanks to the VS Co	3.3×	44k	428	62	99
92	Aug 21, '25	llama.cpp is on fire today! It's amazing to see this open-source collaboration getting stronger every day	3.3×	44k	559	45	60
93	Dec 19, '24	Open the pod bay doors, HAL.	3.2×	44k	584	40	239
94	Feb 27, '23	4-bit integer quantisation in whisper.cpp / ggml You can now run the Large Whisper model locally in a web page via WebAssembly SIMD	3.2×	43k	425	64	159
95	Jan 28, '25	CPU is all you need	2.9×	39k	411	34	80
96	May 31, '24	LBDL + llama for scale. thx @francoisfleuret	2.8×	38k	435	11	179
97	Jul 28, '25	AMD teams contributing to the llama.cpp codebase. Great support from the community with the review process. Exciting to see this open-source collaboration!	2.6×	35k	468	38	27
98	May 10, '25	Son has been doing an outstanding job at maintaining the llama-server implementation and now bringing full-blown vision input support to llama.cpp! Massive kudos and thanks for you	1.9×	26k	481	43	68
99	Dec 15, '22	Apparently, Stable Diffusion can be used to generate images of spectrograms from text prompts. The spectrograms can in turn be converted to audio using STFT and some tricks Mind is	1.7×	0	635	118	116
100	Feb 3, '25	this is what a happy llama.cpp user looks like	1.6×	22k	457	22	46

Scan another creator

Run this on any account.

XOutlier builds this table for every public profile you open on x.com, with live data and every post, not just the top 50.

Add to Chrome Download .zip