arcflare_
Chat8B official

hermes-3-llama-3-1-8b

by Nous Research

Generalist Llama-3.1 8B fine-tune with ChatML format, function calling, structured output, roleplay and reasoning improvements.

#chat#instruct
arcflare pull NousResearch/Hermes-3-Llama-3.1-8B-GGUF:Q4_K_M

[ 01 ] // quickstart

┌─ arcflare — zsh // tty1
$ 

[ 02 ] // readme

hermes-3-llama-3-1-8b

Generalist Llama-3.1 8B fine-tune with ChatML format, function calling, structured output, roleplay and reasoning improvements.

Get it

arcflare pull NousResearch/Hermes-3-Llama-3.1-8B-GGUF:Q4_K_M
arcflare run hermes-3-llama-3.1-8b

ArcFlare reads the GGUF header and loads it at the largest context your free VRAM can actually hold. Use arcflare fit to see that before downloading anything else, or arcflare use opencode to code with it.

Highlights

  • Downloads the Q4_K_M file by default: 4.9 GB. Also published: Q8_0 (8.5 GB), Q6_K (6.6 GB), Q5_K_M (5.7 GB)
  • Trained for a 128K context
  • Licence: Llama 3. Read it before commercial use

Sizes

  • 8b · 4.9GB

Other sizes live in sibling repos: swap the size in the repo name when pulling.

[ 03 ] // relatedmore →

llama3.2

Meta

Chat

Meta's 3B multilingual instruction-tuned text model, optimized for dialogue, agentic retrieval and summarization tasks.

size
3B
vram
~3 GB
license
Llama 3.2 Community

13% of a 24 GB card

#chat #instruct #small

llama3.2-1b

Meta

Chat

Meta's 1B multilingual instruction-tuned text model, optimized for dialogue, agentic retrieval and summarization tasks.

size
1B
vram
~2 GB
license
Llama 3.2 Community

8% of a 24 GB card

#chat #instruct #small

llama3.1

Meta

Chat

Meta's 8B multilingual instruction-tuned text model with 128k context, optimized for assistant-like chat.

size
8B
vram
~6 GB
license
Llama 3.1 Community

25% of a 24 GB card

#chat #instruct