Skip to content

Commit c3e30ac

Browse files
benironsidemergify[bot]
authored andcommitted
Update llm-performance-matrix.asciidoc (#6787)
(cherry picked from commit ac6ee71) # Conflicts: # docs/AI-for-security/llm-performance-matrix.asciidoc
1 parent 92b04c1 commit c3e30ac

File tree

1 file changed

+16
-0
lines changed

1 file changed

+16
-0
lines changed

docs/AI-for-security/llm-performance-matrix.asciidoc

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -11,18 +11,25 @@ Models from third-party LLM providers.
1111

1212
[cols="1,1,1,1,1,1,1,1", options="header"]
1313
|===
14+
<<<<<<< HEAD
1415
| *Feature* | | *Assistant - General* | *Assistant - {esql} generation* | *Assistant - Alert questions* | *Assistant - Knowledge retrieval* | *Attack Discovery* | *AI-powered SIEM migration*
1516
| *Model* |*Claude 3: Opus* | Excellent | Excellent | Excellent | Good | Great | Good
1617
| |*Claude 3.7: Sonnet* | Excellent | Excellent | Excellent | Excellent | Excellent | Excellent
18+
=======
19+
| *Feature* | | *Assistant - General* | *Assistant - {esql} generation* | *Assistant - Alert questions* | *Assistant - Knowledge retrieval* | *Attack Discovery* | *Automatic Migration*
20+
| *Model* |*Claude 3.7: Sonnet* | Excellent | Excellent | Excellent | Excellent | Excellent | Excellent
21+
>>>>>>> ac6ee710 (Update llm-performance-matrix.asciidoc (#6787))
1722
| |*Claude 3.5: Sonnet v2*| Excellent | Excellent | Excellent | Excellent | Great | Excellent
1823
| |*Claude 3.5: Sonnet* | Excellent| Excellent | Excellent | Excellent | Excellent | Excellent
1924
| |*Claude 3.5: Haiku* | Excellent| Excellent | Excellent | Excellent | Poor | Poor
2025
| |*Claude 3: Haiku* | Excellent| Excellent | Excellent | Excellent | Poor |Poor
2126
| |*GPT-4o* | Excellent| Excellent | Excellent | Excellent | Great |Great
2227
| |*GPT-4o-mini* | Excellent| Great | Great | Great | Poor |Good
28+
| | **GPT-4.1** | Excellent| Excellent | Excellent | Excellent | Excellent | Excellent
2329
| |**Gemini 1.5 Pro 002** | Excellent| Excellent | Excellent | Excellent | Excellent | Great
2430
| |**Gemini 1.5 Flash 002**|Excellent| Poor | Good | Excellent | Poor | Excellent
2531
| |**Gemini 2.0 Flash 001**|Excellent| Excellent | Excellent | Excellent | Excellent | Excellent
32+
| | **Gemini 2.5 Pro** |Excellent| Excellent | Excellent | Excellent | Excellent | Excellent
2633
|===
2734
2835
[discrete]
@@ -31,9 +38,18 @@ Models you can <<connect-to-byo-llm, deploy yourself>>.
3138
3239
[cols="1,1,1,1,1,1,1", options="header"]
3340
|===
41+
<<<<<<< HEAD
3442
| *Feature* | | *Assistant - General* | *Assistant - {esql} generation* | *Assistant - Alert questions* | *Assistant - Knowledge retrieval* | *Attack Discovery*
3543
| *Model* | *Mistral Nemo* | Good | Good | Great | Good | Poor
3644
| | *LLama 3.2* | Good | Poor | Good | Poor | Poor
3745
| | *LLama 3.1 405b* | Good | Great | Good | Good| Poor
3846
| | *LLama 3.1 70b* | Good | Good | Poor | Poor | Poor
47+
=======
48+
| *Feature* | | *Assistant - General* | *Assistant - {esql} generation* | *Assistant - Alert questions*| *Assistant - Knowledge retrieval*| *Attack Discovery* | *Automatic Migration*
49+
| *Model* | *Mistral Nemo* | Good | Good | Great | Good | Poor | Poor
50+
| | **Mistral-Small-3.1-24B-Instruct-2503** | Excellent | Poor | Excellent | Excellent | Good | N/A
51+
| | *LLama 3.2* | Good | Poor | Good | Poor | Poor | Good
52+
| | *LLama 3.1 405b* | Good | Great | Good | Good | Poor | Poor
53+
| | *LLama 3.1 70b* | Good | Good | Poor | Poor | Poor | Good
54+
>>>>>>> ac6ee710 (Update llm-performance-matrix.asciidoc (#6787))
3955
|===

0 commit comments

Comments
 (0)