Loading...
Calculate exactly how much GPU VRAM a local LLM needs at any quantization and context length. Enter a model and see i...
Based on shared tags
Check whether your GPU can run a given local LLM before downloading gigabytes. Compares your available VRAM against the model's requirements at each quantization level.
Pick the right GGUF quantization for your hardware. Compare Q4, Q5, Q6, Q8 and more on quality vs. VRAM so you fit the largest model your GPU can hold.
Work out how much VRAM a model's context window consumes and the maximum context length your GPU can handle for a given local LLM.