Post Contenthttps://www.youtube.com/shorts/i3Kanun46cgΒ
Β [[{“value”:”Llama.cpp Web UI + GGUF Setup Walkthrough and Ollama comparisons.
My USB-C portable hub: https://amzn.to/4kw0hrf
π My favorite external drive (dependable): https://amzn.to/3Os9Wi3
π Thunderbolt 4 dock: https://amzn.to/3yVRicC
β‘ *Other gear I use:* https://www.amazon.com/shop/alexziskind
βΆοΈ M2 MacBook Air | INSTANTLY connect 4K monitors – https://youtu.be/KLI65HnvNMg
βΆοΈ Unity on Steroids M3 Max and RTX 4090m – https://youtu.be/COpEtHzdPG0
βΆοΈ INSANE Machine Learning on Neural Engine – https://youtu.be/Y2FOUg_jo7k
βΆοΈ Ultimate Web Developer MacBook – https://youtu.be/72fneIUHXyY
βΆοΈ This is what spending more on a MacBook Pro gets you – https://youtu.be/iLHrYuQjKPU
βΆοΈ Apple Silicon and Developers Playlist – https://youtube.com/playlist?list=PLPwbI_iIX3aR88msMh-cHoJiBqS6YMUUH
Developer productivity Playlist – https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX
β β β β β β β β β
β€οΈ SUBSCRIBE TO MY YOUTUBE CHANNEL πΊ
Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1
β β β β β β β β β
π±LET’S CONNECT ON SOCIAL MEDIA
ALEX ON TWITTER: https://twitter.com/digitalix
β β β β β β β β β
Join this channel to get access to perks:
https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join
β±οΈ Chapters
00:00 β Local LLMs, many stacks
01:05 β Building from source
04:15 β Picking a GGUF model
07:56 β New Llama.cpp Web UI
09:06 β Ollama UI & speed check
10:44 β Ollamaβs concurrency limit
11:48 β Llama.cpp parallel chats
#llm #llamacpp #macbook”}]]Β Read MoreΒ Alex ZiskindΒ
#Techno #AlexZiskind