@@ -11,18 +11,25 @@ Models from third-party LLM providers.
11
11
12
12
[cols="1,1,1,1,1,1,1,1", options="header"]
13
13
|===
14
+ <<<<<<< HEAD
14
15
| *Feature* | | *Assistant - General* | *Assistant - {esql} generation* | *Assistant - Alert questions* | *Assistant - Knowledge retrieval* | *Attack Discovery* | *AI-powered SIEM migration*
15
16
| *Model* |*Claude 3: Opus* | Excellent | Excellent | Excellent | Good | Great | Good
16
17
| |*Claude 3.7: Sonnet* | Excellent | Excellent | Excellent | Excellent | Excellent | Excellent
18
+ =======
19
+ | *Feature* | | *Assistant - General* | *Assistant - {esql} generation* | *Assistant - Alert questions* | *Assistant - Knowledge retrieval* | *Attack Discovery* | *Automatic Migration*
20
+ | *Model* |*Claude 3.7: Sonnet* | Excellent | Excellent | Excellent | Excellent | Excellent | Excellent
21
+ >>>>>>> ac6ee710 (Update llm-performance-matrix.asciidoc (#6787))
17
22
| |*Claude 3.5: Sonnet v2*| Excellent | Excellent | Excellent | Excellent | Great | Excellent
18
23
| |*Claude 3.5: Sonnet* | Excellent| Excellent | Excellent | Excellent | Excellent | Excellent
19
24
| |*Claude 3.5: Haiku* | Excellent| Excellent | Excellent | Excellent | Poor | Poor
20
25
| |*Claude 3: Haiku* | Excellent| Excellent | Excellent | Excellent | Poor |Poor
21
26
| |*GPT-4o* | Excellent| Excellent | Excellent | Excellent | Great |Great
22
27
| |*GPT-4o-mini* | Excellent| Great | Great | Great | Poor |Good
28
+ | | **GPT-4.1** | Excellent| Excellent | Excellent | Excellent | Excellent | Excellent
23
29
| |**Gemini 1.5 Pro 002** | Excellent| Excellent | Excellent | Excellent | Excellent | Great
24
30
| |**Gemini 1.5 Flash 002**|Excellent| Poor | Good | Excellent | Poor | Excellent
25
31
| |**Gemini 2.0 Flash 001**|Excellent| Excellent | Excellent | Excellent | Excellent | Excellent
32
+ | | **Gemini 2.5 Pro** |Excellent| Excellent | Excellent | Excellent | Excellent | Excellent
26
33
|===
27
34
28
35
[discrete]
@@ -31,9 +38,18 @@ Models you can <<connect-to-byo-llm, deploy yourself>>.
31
38
32
39
[cols="1,1,1,1,1,1,1", options="header"]
33
40
|===
41
+ <<<<<<< HEAD
34
42
| *Feature* | | *Assistant - General* | *Assistant - {esql} generation* | *Assistant - Alert questions* | *Assistant - Knowledge retrieval* | *Attack Discovery*
35
43
| *Model* | *Mistral Nemo* | Good | Good | Great | Good | Poor
36
44
| | *LLama 3.2* | Good | Poor | Good | Poor | Poor
37
45
| | *LLama 3.1 405b* | Good | Great | Good | Good| Poor
38
46
| | *LLama 3.1 70b* | Good | Good | Poor | Poor | Poor
47
+ =======
48
+ | *Feature* | | *Assistant - General* | *Assistant - {esql} generation* | *Assistant - Alert questions*| *Assistant - Knowledge retrieval*| *Attack Discovery* | *Automatic Migration*
49
+ | *Model* | *Mistral Nemo* | Good | Good | Great | Good | Poor | Poor
50
+ | | **Mistral-Small-3.1-24B-Instruct-2503** | Excellent | Poor | Excellent | Excellent | Good | N/A
51
+ | | *LLama 3.2* | Good | Poor | Good | Poor | Poor | Good
52
+ | | *LLama 3.1 405b* | Good | Great | Good | Good | Poor | Poor
53
+ | | *LLama 3.1 70b* | Good | Good | Poor | Poor | Poor | Good
54
+ >>>>>>> ac6ee710 (Update llm-performance-matrix.asciidoc (#6787))
39
55
|===
0 commit comments