arcflare_
Chat12B official

mistral-nemo-12b

by Mistral AI / NVIDIA

12B instruct model trained jointly by Mistral AI and NVIDIA with a 128k context window on multilingual and code data.

#chat#instruct
arcflare pull unsloth/Mistral-Nemo-Instruct-2407-GGUF:Q4_K_M

[ 01 ] // quickstart

┌─ arcflare — zsh // tty1
$ 

[ 02 ] // readme

mistral-nemo-12b

12B instruct model trained jointly by Mistral AI and NVIDIA with a 128k context window on multilingual and code data.

Get it

arcflare pull unsloth/Mistral-Nemo-Instruct-2407-GGUF:Q4_K_M
arcflare run mistral-nemo-instruct-2407

ArcFlare reads the GGUF header and loads it at the largest context your free VRAM can actually hold. Use arcflare fit to see that before downloading anything else, or arcflare use opencode to code with it.

Highlights

  • Downloads the Q4_K_M file by default: 7.5 GB. Also published: Q8_0 (13 GB), Q6_K (10.1 GB), Q5_K_M (8.7 GB)
  • Trained for a 128K context
  • Licence: Apache-2.0. Read it before commercial use

Sizes

  • 12b · 7.5GB

Other sizes live in sibling repos: swap the size in the repo name when pulling.

[ 03 ] // relatedmore →

llama3.2

Meta

Chat

Meta's 3B multilingual instruction-tuned text model, optimized for dialogue, agentic retrieval and summarization tasks.

size
3B
vram
~3 GB
license
Llama 3.2 Community

13% of a 24 GB card

#chat #instruct #small

llama3.2-1b

Meta

Chat

Meta's 1B multilingual instruction-tuned text model, optimized for dialogue, agentic retrieval and summarization tasks.

size
1B
vram
~2 GB
license
Llama 3.2 Community

8% of a 24 GB card

#chat #instruct #small

llama3.1

Meta

Chat

Meta's 8B multilingual instruction-tuned text model with 128k context, optimized for assistant-like chat.

size
8B
vram
~6 GB
license
Llama 3.1 Community

25% of a 24 GB card

#chat #instruct