arcflare_
Chat7B official

mistral

by Mistral AI

Instruct fine-tuned Mistral-7B-v0.3 with extended 32768-token vocabulary, v3 tokenizer and function calling support.

#chat#instruct
arcflare pull bartowski/Mistral-7B-Instruct-v0.3-GGUF:Q4_K_M

[ 01 ] // quickstart

┌─ arcflare — zsh // tty1
$ 

[ 02 ] // readme

mistral

Instruct fine-tuned Mistral-7B-v0.3 with extended 32768-token vocabulary, v3 tokenizer and function calling support.

Get it

arcflare pull bartowski/Mistral-7B-Instruct-v0.3-GGUF:Q4_K_M
arcflare run mistral-7b-instruct-v0.3

ArcFlare reads the GGUF header and loads it at the largest context your free VRAM can actually hold. Use arcflare fit to see that before downloading anything else, or arcflare use opencode to code with it.

Highlights

  • Downloads the Q4_K_M file by default: 4.4 GB. Also published: Q8_0 (7.7 GB), Q6_K (5.9 GB), Q5_K_M (5.1 GB)
  • Trained for a 32K context
  • Licence: Apache-2.0. Read it before commercial use

Sizes

  • 7b · 4.4GB

Other sizes live in sibling repos: swap the size in the repo name when pulling.

[ 03 ] // relatedmore →

llama3.2

Meta

Chat

Meta's 3B multilingual instruction-tuned text model, optimized for dialogue, agentic retrieval and summarization tasks.

size
3B
vram
~3 GB
license
Llama 3.2 Community

13% of a 24 GB card

#chat #instruct #small

llama3.2-1b

Meta

Chat

Meta's 1B multilingual instruction-tuned text model, optimized for dialogue, agentic retrieval and summarization tasks.

size
1B
vram
~2 GB
license
Llama 3.2 Community

8% of a 24 GB card

#chat #instruct #small

llama3.1

Meta

Chat

Meta's 8B multilingual instruction-tuned text model with 128k context, optimized for assistant-like chat.

size
8B
vram
~6 GB
license
Llama 3.1 Community

25% of a 24 GB card

#chat #instruct