Skip to content

Commit d5d5f97

Browse files
committed
fix(ab_test): ignore api_time and fc_time metrics for memory hotplug
These metrics are a subset of the customer-visible total_time and are flaky in our CI. Keep only total_time in the A/B. Signed-off-by: Riccardo Mancini <[email protected]>
1 parent 951002f commit d5d5f97

File tree

1 file changed

+9
-0
lines changed

1 file changed

+9
-0
lines changed

tools/ab_test.py

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -128,6 +128,15 @@ def format_with_reduced_unit(value, unit):
128128
# block throughput on m8g
129129
{"fio_engine": "libaio", "vcpus": "2", "instance": "m8g.metal-24xl"},
130130
{"fio_engine": "libaio", "vcpus": "2", "instance": "m8g.metal-48xl"},
131+
# memory hotplug metrics: ignore api_time and fc_time metrics, keeping only total_time.
132+
*[
133+
{
134+
"performance_test": "test_memory_hotplug_latency",
135+
"metric": f"{prefix}_{metric}",
136+
}
137+
for prefix in ["hotplug", "hotunplug", "hotplug_2nd"]
138+
for metric in ["api_time", "fc_time"]
139+
],
131140
]
132141

133142

0 commit comments

Comments
 (0)