Local LLM model page

Yi Coder (9B)

Yi code specialist under 10B. Strong coding performance for its size. 132K downloads.

Find the best model for my hardwareBrowse all 183 LLMs
Parameters
9B
Minimum RAM
8 GB
Model size
5.5 GB
Quantization
Q5_K_M

Can Yi Coder (9B) run locally?

Yi Coder (9B) is best suited for entry-level laptops and desktops. LocalClaw recommends Q5_K_M as the default quantization, with at least 8 GB RAM.

Search term for LM Studio or compatible runtimes: yi-coder-9b-chat

Hugging Face repository: 01-ai/Yi-Coder-9B-Chat-GGUF

codestandard

Strengths

  • Yi code specialist under 10B. Strong coding performance for its size. 132K downloads.

Limitations

  • Performance depends heavily on quantization, RAM bandwidth and runtime support.

Best use cases

  • code
  • standard

Benchmarks

Speed: 7/10

Quality: 6/10

Coding: 8/10

Reasoning: 6/10

Technical details

Developer: yi

License: See model repository

Context window: Unknown tokens

Architecture: See model card

Released: 2024-09