Local AI just leveled up… Llama.cpp vs Ollama
Share

Post Contenthttps://www.youtube.com/shorts/i3Kanun46cgΒ 

Β [[{“value”:”Llama.cpp Web UI + GGUF Setup Walkthrough and Ollama comparisons.

My USB-C portable hub: https://amzn.to/4kw0hrf
πŸ‘€ My favorite external drive (dependable): https://amzn.to/3Os9Wi3
πŸ‘€ Thunderbolt 4 dock: https://amzn.to/3yVRicC

⚑ *Other gear I use:* https://www.amazon.com/shop/alexziskind

▢️ M2 MacBook Air | INSTANTLY connect 4K monitors – https://youtu.be/KLI65HnvNMg
▢️ Unity on Steroids M3 Max and RTX 4090m – https://youtu.be/COpEtHzdPG0
▢️ INSANE Machine Learning on Neural Engine – https://youtu.be/Y2FOUg_jo7k
▢️ Ultimate Web Developer MacBook – https://youtu.be/72fneIUHXyY
▢️ This is what spending more on a MacBook Pro gets you – https://youtu.be/iLHrYuQjKPU

▢️ Apple Silicon and Developers Playlist – https://youtube.com/playlist?list=PLPwbI_iIX3aR88msMh-cHoJiBqS6YMUUH

Developer productivity Playlist – https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX

β€” β€” β€” β€” β€” β€” β€” β€” β€”

❀️ SUBSCRIBE TO MY YOUTUBE CHANNEL πŸ“Ί

Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1

β€” β€” β€” β€” β€” β€” β€” β€” β€”

πŸ“±LET’S CONNECT ON SOCIAL MEDIA

ALEX ON TWITTER: https://twitter.com/digitalix

β€” β€” β€” β€” β€” β€” β€” β€” β€”

Join this channel to get access to perks:
https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join

⏱️ Chapters
00:00 – Local LLMs, many stacks
01:05 – Building from source
04:15 – Picking a GGUF model
07:56 – New Llama.cpp Web UI
09:06 – Ollama UI & speed check
10:44 – Ollama’s concurrency limit
11:48 – Llama.cpp parallel chats

#llm #llamacpp #macbook”}]]Β Read MoreΒ Alex ZiskindΒ 

#Techno #AlexZiskind

By ali