Skip to content
android-perf

android-perf #931

Sign in to view logs

android-perf

android-perf #931

Triggered via schedule November 3, 2025 01:48
@shewu-quicshewu-quic
⁠ 3485495
main
Status Cancelled
Total duration 5d 0h 0m 26s
Artifacts –

android-perf.yml

on: schedule
set-parameters
8s
set-parameters
Matrix: export-models
Matrix: prepare-test-specs
build-benchmark-app  /  linux-job
0s
build-benchmark-app / linux-job
Matrix: benchmark-on-device
upload-benchmark-results
0s
upload-benchmark-results
Fit to window
Zoom out
Zoom in

Annotations

65 errors
prepare-test-specs (allenai/OLMo-1B-hf, hf_xnnpack_custom_spda_kv_cache_8da4w, samsung_galaxy_s22...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (mv3, xnnpack_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:308...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (Qwen/Qwen3-0.6B, hf_xnnpack_custom_spda_kv_cache_8da4w, samsung_galaxy_s22, p...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (meta-llama/Llama-3.2-1B-Instruct-QLORA_INT4_EO8, llama3_qlora, samsung_galaxy...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (ic3, xnnpack_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:308...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (mv2, qnn_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:308535385114... / linux-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (mv3, qnn_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:308535385114... / linux-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (mv2, qnn_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:3085353...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (mobilebert, xnnpack_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-wes...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (meta-llama/Llama-3.2-1B, hf_xnnpack_custom_spda_kv_cache_8da4w, samsung_galax...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (meta-llama/Llama-3.2-1B-Instruct-QLORA_INT4_EO8, llama3_qlora, samsung_galaxy_s22,... / linux-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
build-benchmark-app / linux-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (meta-llama/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8, llama3_spinquant, samsun...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (google/gemma-3-1b-it, hf_xnnpack_custom_spda_kv_cache_8da4w, samsung_galaxy_s...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (resnet50, xnnpack_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (ic3, qnn_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:3085353...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (Qwen/Qwen3-0.6B, et_xnnpack_custom_spda_kv_cache_8da4w, samsung_galaxy_s22, p...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (ic4, xnnpack_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:308...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (meta-llama/Llama-3.2-1B, et_xnnpack_custom_spda_kv_cache_8da4w, samsung_galaxy_s22... / linux-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (mobilebert, xnnpack_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:3... / linux-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (mv3, qnn_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:3085353...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (google/gemma-3-1b-it, hf_xnnpack_custom_spda_kv_cache_8da4w, samsung_galaxy_s22, p... / linux-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (HuggingFaceTB/SmolLM2-135M, hf_xnnpack_custom_spda_kv_cache_8da4w, samsung_galaxy_... / linux-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (meta-llama/Llama-3.2-1B, hf_xnnpack_custom_spda_kv_cache_8da4w, samsung_galaxy_s22... / linux-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (w2l, xnnpack_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:30853538... / linux-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (meta-llama/Llama-3.2-1B, et_xnnpack_custom_spda_kv_cache_8da4w, samsung_galax...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (allenai/OLMo-1B-hf, hf_xnnpack_custom_spda_kv_cache_8da4w, samsung_galaxy_s22, pub... / linux-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (w2l, xnnpack_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:308...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (mv3, xnnpack_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:30853538... / linux-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (Qwen/Qwen3-0.6B, hf_xnnpack_custom_spda_kv_cache_8da4w, samsung_galaxy_s22, public... / linux-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (resnet50, xnnpack_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:308... / linux-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (meta-llama/Llama-3.2-1B, llama3_fb16, samsung_galaxy_s22, public, arn:aws:devicefa... / linux-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (ic3, qnn_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:308535385114... / linux-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (HuggingFaceTB/SmolLM2-135M, hf_xnnpack_custom_spda_kv_cache_8da4w, samsung_ga...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (ic4, xnnpack_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:30853538... / linux-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (mv2, xnnpack_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:30853538... / linux-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (ic3, xnnpack_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:30853538... / linux-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (Qwen/Qwen3-0.6B, et_xnnpack_custom_spda_kv_cache_8da4w, samsung_galaxy_s22, public... / linux-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (mv2, xnnpack_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:308...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (meta-llama/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8, llama3_spinquant, samsung_gal... / linux-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (meta-llama/Llama-3.2-1B, llama3_fb16, samsung_galaxy_s22, public, arn:aws:dev...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (ic4, qnn_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:308535385114... / linux-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (ic4, qnn_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:3085353...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (mv3, xnnpack_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:30... / mobile-job (android)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (ic4, qnn_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:308535... / mobile-job (android)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (meta-llama/Llama-3.2-1B, hf_xnnpack_custom_spda_kv_cache_8da4w, samsung_gala... / mobile-job (android)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (Qwen/Qwen3-0.6B, et_xnnpack_custom_spda_kv_cache_8da4w, samsung_galaxy_s22, ... / mobile-job (android)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (ic4, xnnpack_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:30... / mobile-job (android)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (mv3, qnn_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:308535... / mobile-job (android)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (ic3, xnnpack_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:30... / mobile-job (android)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (meta-llama/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8, llama3_spinquant, samsu... / mobile-job (android)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (allenai/OLMo-1B-hf, hf_xnnpack_custom_spda_kv_cache_8da4w, samsung_galaxy_s2... / mobile-job (android)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (mv2, qnn_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:308535... / mobile-job (android)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (meta-llama/Llama-3.2-1B-Instruct-QLORA_INT4_EO8, llama3_qlora, samsung_galax... / mobile-job (android)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (meta-llama/Llama-3.2-1B, et_xnnpack_custom_spda_kv_cache_8da4w, samsung_gala... / mobile-job (android)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (ic3, qnn_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:308535... / mobile-job (android)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (meta-llama/Llama-3.2-1B, llama3_fb16, samsung_galaxy_s22, public, arn:aws:de... / mobile-job (android)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (mobilebert, xnnpack_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-we... / mobile-job (android)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (Qwen/Qwen3-0.6B, hf_xnnpack_custom_spda_kv_cache_8da4w, samsung_galaxy_s22, ... / mobile-job (android)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (mv2, xnnpack_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:30... / mobile-job (android)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (HuggingFaceTB/SmolLM2-135M, hf_xnnpack_custom_spda_kv_cache_8da4w, samsung_g... / mobile-job (android)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (resnet50, xnnpack_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west... / mobile-job (android)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (google/gemma-3-1b-it, hf_xnnpack_custom_spda_kv_cache_8da4w, samsung_galaxy_... / mobile-job (android)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (w2l, xnnpack_q8, samsung_galaxy_s22, public, arn:aws:devicefarm:us-west-2:30... / mobile-job (android)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
upload-benchmark-results
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s