Nodegrove VRAM: can I run it? vs Codegraphcontext

Nodegrove VRAM: can I run it? tools 4

• can_i_runFits, tight or no; the memory split; a speed ceiling; the longest context that fits; and on a no, every change that would make it fit
• what_fitsEvery model checked on one card, with a recommended everyday pick, the largest that fits, the best at Q8 and the first out of reach
• estimate_vramWeights, KV cache and overhead at each quantisation, and the smallest common card that holds each
• estimate_from_hf_repoAny Hugging Face repo, read from its `config.json`: the attention layout, the cost of each 1,000 tokens of context, and memory at every quantisation

Codegraphcontext tools

No tool names declared yet. Check the project README from the listing page.