Local LLM model page

Command R+ (104B)

Cohere's flagship open model. CC BY-NC 4.0 license (non-commercial; commercial license available). Unmatched 128K context. Perfect for RAG.

Find the best model for my hardwareBrowse all 183 LLMs
Parameters
104B
Minimum RAM
72 GB
Model size
65 GB
Quantization
Q4_K_M

Can Command R+ (104B) run locally?

Command R+ (104B) is best suited for large-memory workstations. LocalClaw recommends Q4_K_M as the default quantization, with at least 72 GB RAM.

Search term for LM Studio or compatible runtimes: command-r-plus-104b

Hugging Face repository: lmstudio-community/c4ai-command-r-plus-GGUF

chatcodepowerqualitygeneral

Strengths

  • Cohere's flagship open model. CC BY-NC 4.0 license (non-commercial; commercial license available). Unmatched 128K context. Perfect for RAG.

Limitations

  • Performance depends heavily on quantization, RAM bandwidth and runtime support.

Best use cases

  • chat
  • code
  • power
  • quality
  • general

Benchmarks

Speed: 2/10

Quality: 9/10

Coding: 8/10

Reasoning: 9/10

Technical details

Developer: cohere

License: See model repository

Context window: Unknown tokens

Architecture: See model card

Released: 2024-04