This 744GB Model Shouldn’t Fit on Your Laptop. It Does
Share

Post Content

 

 [[{“value”:”Colibri: Run GLM 5.2 on 25GB of RAM on consumer hardware!

A 744B Mixture-of-Experts model activates only ~40B parameters per token — and only ~11 GB of those change from token to token (the routed experts).

LINKS:
https://github.com/JustVugg/colibri
https://z.ai/blog/glm-5.2
DwarfStar-4 Video: https://youtu.be/9gHcmhUDJfw
DSpark video: https://youtu.be/eFgknPFK-g0

My voice to text App: whryte.com
Website: https://engineerprompt.ai/
RAG Beyond Basics Course:
https://prompt-s-site.thinkific.com/courses/rag
Signup for Newsletter, localgpt:
https://tally.so/r/3y9bb0

Let’s Connect:
🦾 Discord: https://discord.com/invite/t4eYQRUcXB
☕ Buy me a Coffee: https://ko-fi.com/promptengineering
|🔴 Patreon: https://www.patreon.com/PromptEngineering
💼Consulting: https://calendly.com/engineerprompt/consulting-call
📧 Business Contact: engineerprompt@gmail.com
Become Member: http://tinyurl.com/y5h28s6h

💻 Pre-configured localGPT VM: https://bit.ly/localGPT (use Code: PromptEngineering for 50% off).

Signup for Newsletter, localgpt:
https://tally.so/r/3y9bb0″}]] Read More Prompt Engineering 

#Promptengineering #AI

By ali