Models.
your gpu
your browser keeps the card private. Pick the closest below35 results · “Chat”
qwen3.5
Alibaba Qwen
Qwen3.5: Qwen's 2026 generation, 2B to 35B-A3B, with a 256K native context and strong coding for a general model.
- size
- 27B
- vram
- ~18 GB
- license
- Apache-2.0
75% of a 24 GB card
#chat #code #reasoning
olmo-3-7b-instruct
Ai2
Open language model from Ai2, pre-trained on Dolma 3 and post-trained on the Dolci datasets; all code and checkpoints are released.
- size
- 7B
- vram
- ~6 GB
- license
- Apache-2.0
25% of a 24 GB card
#chat #instruct
lfm2-8b-a1b
Liquid AI
Liquid AI on-device hybrid MoE with 8.3B total and 1.5B active parameters and a 32,768-token context.
- size
- 8B-A1B
- vram
- ~6 GB
- license
- LFM Open License v1.0
25% of a 24 GB card
#chat #instruct #moe
granite-4-0-h-tiny
IBM
IBM 7B-parameter (1B active) hybrid long-context instruct model with improved instruction following and tool calling.
- size
- 7B-A1B
- vram
- ~6 GB
- license
- Apache-2.0
25% of a 24 GB card
#chat #instruct #moe
granite-4.0-h-small
IBM
32B-parameter long-context instruct model with improved instruction following and tool calling, finetuned from Granite-4.0-H-Small-Base.
- size
- 32B
- vram
- ~21 GB
- license
- Apache-2.0
88% of a 24 GB card
#chat #instruct #large
gemma3-270m
Gemma 3 270M: a tiny model built to be fine-tuned for one narrow job. Runs on anything, including a CPU.
- size
- 270M
- vram
- ~0.5 GB
- license
- Gemma
2% of a 24 GB card
#tiny #fine-tuning #cpu
qwen3-4b-instruct-2507
Alibaba Qwen
Updated Qwen3-4B non-thinking model with better instruction following, reasoning and coding; 256K native context, no think blocks.
- size
- 4B
- vram
- ~4 GB
- license
- Apache-2.0
17% of a 24 GB card
#chat #instruct #small
qwen3-30b-a3b-instruct-2507
Alibaba Qwen
Qwen3-30B-A3B non-thinking update: 30.5B-parameter MoE with 3.3B active, 128 experts and 256K native context.
- size
- 30B-A3B
- vram
- ~20 GB
- license
- Apache-2.0
83% of a 24 GB card
#chat #instruct #moe
smollm3
Hugging Face
SmolLM3 3B: a fully open small model with switchable reasoning, multilingual output and long context. Its training recipe is published too.
- size
- 3B
- vram
- ~2.5 GB
- license
- Apache-2.0
10% of a 24 GB card
#small #reasoning #multilingual
ernie-4-5-21b-a3b
Baidu
Text MoE post-trained model with 21B total and 3B activated parameters per token and a 131072-token context length.
- size
- 21B-A3B
- vram
- ~15 GB
- license
- Apache-2.0
63% of a 24 GB card
#chat #instruct #moe
gemma3n-e4b
Google's Gemma 3n E4B instruction-tuned model for low-resource devices, effective 4B parameters, 32K context; this GGUF is text-only.
- size
- E4B
- vram
- ~6 GB
- license
- Gemma
25% of a 24 GB card
#chat #instruct #small
mistral-small-3.2-24b
Mistral AI
Mistral Small 3.1 update with better instruction following, fewer repetitive outputs and more robust function calling; text and image input.
- size
- 24B
- vram
- ~17 GB
- license
- Apache-2.0
71% of a 24 GB card
#chat #instruct #vision
qwen3
Alibaba Qwen
Qwen3 runs from 0.6B to 235B, dense and MoE, with thinking and non-thinking modes in one model. Apache-2.0 across the board.
- size
- 8B
- vram
- ~6 GB
- license
- Apache-2.0
25% of a 24 GB card
#chat #reasoning #tools
mellum
JetBrains
Mellum 4B: JetBrains' completion model. A base model built for fill-in-the-middle autocomplete, not chat.
- size
- 4B
- vram
- ~5 GB
- license
- Apache-2.0
21% of a 24 GB card
#code #autocomplete #fim
qwen3-0-6b
Alibaba Qwen
Qwen3 0.6B causal language model with switchable thinking and non-thinking modes, 32K context and 100+ languages.
- size
- 0.6B
- vram
- ~2 GB
- license
- Apache-2.0
8% of a 24 GB card
#chat #instruct #small
qwen3-1-7b
Alibaba Qwen
Qwen3 1.7B causal language model with switchable thinking and non-thinking modes, 32K context and 100+ languages.
- size
- 1.7B
- vram
- ~3 GB
- license
- Apache-2.0
13% of a 24 GB card
#chat #instruct #small
qwen3-14b
Alibaba Qwen
Qwen3 14.8B dense model switching between thinking and non-thinking modes; 32K context, 131K with YaRN, 100+ languages.
- size
- 14B
- vram
- ~10 GB
- license
- Apache-2.0
42% of a 24 GB card
#chat #instruct
qwen3-32b
Alibaba Qwen
Qwen3 32.8B dense model switching between thinking and non-thinking modes; 32K context, 131K with YaRN, 100+ languages.
- size
- 32B
- vram
- ~21 GB
- license
- Apache-2.0
88% of a 24 GB card
#chat #instruct #large
chatterbox
Resemble AI
Chatterbox: clones a voice from a few seconds of audio, with 23 languages in its multilingual model. MIT.
- size
- 0.5B
- vram
- ~4 GB
- license
- MIT
17% of a 24 GB card
#tts #speech #voice-cloning
mistral-small3.1
Mistral AI
Mistral Small 3.1 24B: fast general model with image understanding and 128K context, under Apache-2.0.
- size
- 24B
- vram
- ~16 GB
- license
- Apache-2.0
67% of a 24 GB card
#vision #chat #tools
gemma3
Gemma 3: 1B to 27B, with image understanding from 4B up, 128K context and 140+ languages.
- size
- 12B
- vram
- ~9 GB
- license
- Gemma
38% of a 24 GB card
#vision #chat #multilingual
gemma3-4b
Google's multimodal Gemma 3 4B instruction-tuned model: text and image input, text output, 128K context, 140+ languages.
- size
- 4B
- vram
- ~5 GB
- license
- Gemma
21% of a 24 GB card
#chat #instruct #vision
gemma3-27b
Google's multimodal Gemma 3 27B instruction-tuned model: text and image input, text output, 128K context, 140+ languages.
- size
- 27B
- vram
- ~19 GB
- license
- Gemma
79% of a 24 GB card
#chat #instruct #vision
phi4
Microsoft
14B dense decoder-only Transformer trained on synthetic and filtered public data, built for high-quality reasoning in constrained environments.
- size
- 14B
- vram
- ~10 GB
- license
- MIT
42% of a 24 GB card
#chat #instruct
llama3.3-70b
Meta
Meta's 70B multilingual instruction-tuned text model with 128k context, optimized for multilingual dialogue use cases.
- size
- 70B
- vram
- ~44 GB
- license
- Llama 3.3 Community
1.8× a 24 GB card
#chat #instruct #large
smollm2-1-7b-instruct
Hugging Face
1.7B compact instruct model trained on 11T tokens with SFT and DPO; supports rewriting, summarization and function calling.
- size
- 1.7B
- vram
- ~3 GB
- license
- Apache-2.0
13% of a 24 GB card
#chat #instruct #small
llama3.2
Meta
Meta's 3B multilingual instruction-tuned text model, optimized for dialogue, agentic retrieval and summarization tasks.
- size
- 3B
- vram
- ~3 GB
- license
- Llama 3.2 Community
13% of a 24 GB card
#chat #instruct #small
llama3.2-1b
Meta
Meta's 1B multilingual instruction-tuned text model, optimized for dialogue, agentic retrieval and summarization tasks.
- size
- 1B
- vram
- ~2 GB
- license
- Llama 3.2 Community
8% of a 24 GB card
#chat #instruct #small
qwen2.5
Alibaba Qwen
Instruction-tuned 7B Qwen2.5 model with improved coding, maths, instruction following and JSON output; 29+ languages.
- size
- 7B
- vram
- ~6 GB
- license
- Apache-2.0
25% of a 24 GB card
#chat #instruct
yi-coder-9b-chat
01.AI
Open-source 9B code chat model with a 128K maximum context length, supporting 52 major programming languages.
- size
- 9B
- vram
- ~7 GB
- license
- Apache-2.0
29% of a 24 GB card
#code #instruct
hermes-3-llama-3-1-8b
Nous Research
Generalist Llama-3.1 8B fine-tune with ChatML format, function calling, structured output, roleplay and reasoning improvements.
- size
- 8B
- vram
- ~6 GB
- license
- Llama 3
25% of a 24 GB card
#chat #instruct
llama3.1
Meta
Meta's 8B multilingual instruction-tuned text model with 128k context, optimized for assistant-like chat.
- size
- 8B
- vram
- ~6 GB
- license
- Llama 3.1 Community
25% of a 24 GB card
#chat #instruct
mistral-nemo-12b
Mistral AI / NVIDIA
12B instruct model trained jointly by Mistral AI and NVIDIA with a 128k context window on multilingual and code data.
- size
- 12B
- vram
- ~9 GB
- license
- Apache-2.0
38% of a 24 GB card
#chat #instruct
gemma2
Google's instruction-tuned Gemma 2 9B, trained on 8T tokens of web documents, code and mathematics; no system prompt support.
- size
- 9B
- vram
- ~7 GB
- license
- Gemma
29% of a 24 GB card
#chat #instruct
mistral
Mistral AI
Instruct fine-tuned Mistral-7B-v0.3 with extended 32768-token vocabulary, v3 tokenizer and function calling support.
- size
- 7B
- vram
- ~6 GB
- license
- Apache-2.0
25% of a 24 GB card
#chat #instruct