Skip to content

Commit 81ab62e

Browse files
localai-botmudler
andauthored
chore(model gallery): 🤖 add 1 new models via gallery agent (#10298)
chore(model gallery): 🤖 add new models via gallery agent Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
1 parent 0413fc0 commit 81ab62e

1 file changed

Lines changed: 44 additions & 0 deletions

File tree

gallery/index.yaml

Lines changed: 44 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,48 @@
11
---
2+
- name: "dark-scarlett-v0.3-26b-a4b"
3+
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
4+
urls:
5+
- https://huggingface.co/ReadyArt/Dark-Scarlett-v0.3-26B-A4B-GGUF
6+
description: |
7+
Hugging Face |
8+
GitHub |
9+
Launch Blog |
10+
Documentation
11+
12+
License: Apache 2.0 | Authors: Google DeepMind
13+
14+
Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on small models) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants. Gemma 4 features a context window of up to 256K tokens and maintains multilingual support in over 140 languages.
15+
16+
Featuring both Dense and Mixture-of-Experts (MoE) architectures, Gemma 4 is well-suited for tasks like text generation, coding, and reasoning. The models are available in four distinct sizes: **E2B**, **E4B**, **26B A4B**, and **31B**. Their diverse sizes make them deployable in environments ranging from high-end phones to laptops and servers, democratizing access to state-of-the-art AI.
17+
18+
Gemma 4 introduces key **capability and architectural advancements**:
19+
20+
* **Reasoning** – All models in the family are designed as highly capable reasoners, with configurable thinking modes.
21+
22+
...
23+
license: "apache-2.0"
24+
tags:
25+
- llm
26+
- gguf
27+
icon: https://ai.google.dev/gemma/images/gemma4_banner.png
28+
overrides:
29+
backend: llama-cpp
30+
function:
31+
automatic_tool_parsing_fallback: true
32+
grammar:
33+
disable: true
34+
known_usecases:
35+
- chat
36+
options:
37+
- use_jinja:true
38+
parameters:
39+
model: llama-cpp/models/Dark-Scarlett-v0.3-26B-A4B-GGUF/Dark-Scarlett-v0.3-26B-A4B-Q4_K_M.gguf
40+
template:
41+
use_tokenizer_template: true
42+
files:
43+
- filename: llama-cpp/models/Dark-Scarlett-v0.3-26B-A4B-GGUF/Dark-Scarlett-v0.3-26B-A4B-Q4_K_M.gguf
44+
sha256: 88956c71d20444d3ebf890e4495afed3257c6be877d4e82f0c26ce58e79b340f
45+
uri: https://huggingface.co/ReadyArt/Dark-Scarlett-v0.3-26B-A4B-GGUF/resolve/main/Dark-Scarlett-v0.3-26B-A4B-Q4_K_M.gguf
246
- name: "qwopus3.6-27b-coder-mtp"
347
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
448
urls:

0 commit comments

Comments
 (0)