
Destroying all Local AI trends
A 744B model, 25 GB of RAM, and one small question: how long until I get my answer? I followed the numbers behind Colibrì, AirLLM and FlexGen.
No labels found.

A 744B model, 25 GB of RAM, and one small question: how long until I get my answer? I followed the numbers behind Colibrì, AirLLM and FlexGen.

I wanted faster text from Ollama. I gave three vision models a haircut, timed every change, and found out why my first theory about swap was wrong.
Try a different search or clear the selected labels.