arcflare_
Chat9B official

gemma2

by Google

Google's instruction-tuned Gemma 2 9B, trained on 8T tokens of web documents, code and mathematics; no system prompt support.

#chat#instruct
arcflare pull bartowski/gemma-2-9b-it-GGUF:Q4_K_M

[ 01 ] // quickstart

┌─ arcflare — zsh // tty1
$ 

[ 02 ] // readme

gemma2

Google's instruction-tuned Gemma 2 9B, trained on 8T tokens of web documents, code and mathematics; no system prompt support.

Get it

arcflare pull bartowski/gemma-2-9b-it-GGUF:Q4_K_M
arcflare run gemma-2-9b-it

ArcFlare reads the GGUF header and loads it at the largest context your free VRAM can actually hold. Use arcflare fit to see that before downloading anything else, or arcflare use opencode to code with it.

Highlights

  • Downloads the Q4_K_M file by default: 5.8 GB. Also published: Q8_0 (9.8 GB), Q6_K (7.6 GB), Q5_K_M (6.6 GB)
  • Trained for a 8K context
  • Licence: Gemma. Read it before commercial use

Sizes

  • 9b · 5.8GB

Other sizes live in sibling repos: swap the size in the repo name when pulling.

[ 03 ] // relatedmore →

llama3.2

Meta

Chat

Meta's 3B multilingual instruction-tuned text model, optimized for dialogue, agentic retrieval and summarization tasks.

size
3B
vram
~3 GB
license
Llama 3.2 Community

13% of a 24 GB card

#chat #instruct #small

llama3.2-1b

Meta

Chat

Meta's 1B multilingual instruction-tuned text model, optimized for dialogue, agentic retrieval and summarization tasks.

size
1B
vram
~2 GB
license
Llama 3.2 Community

8% of a 24 GB card

#chat #instruct #small

llama3.1

Meta

Chat

Meta's 8B multilingual instruction-tuned text model with 128k context, optimized for assistant-like chat.

size
8B
vram
~6 GB
license
Llama 3.1 Community

25% of a 24 GB card

#chat #instruct