apple-perf (private devices) #1160
shewu-quicapple-perf-private-device-experiment.yml
on: schedule
apple
/
set-parameters
8s
Matrix: apple / export-models
Matrix: apple / prepare-test-specs
Matrix: apple / benchmark-on-device
apple
/
upload-benchmark-results
Annotations
28 errors
|
apple / build-benchmark-app / macos-job
The job was not started because recent account payments have failed or your spending limit needs to be increased. Please check the 'Billing & plans' section in your settings
|
|
apple / prepare-test-specs (Qwen/Qwen3-0.6B, et_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15, pro_...
Canceling since a higher priority waiting request for apple-perf-private-devices-main-ca4c5759cf8f09e2179a8833085eeeb481aa4153-false-true exists
|
|
apple / prepare-test-specs (meta-llama/Llama-3.2-1B, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_...
Canceling since a higher priority waiting request for apple-perf-private-devices-main-ca4c5759cf8f09e2179a8833085eeeb481aa4153-false-true exists
|
|
apple / export-models (meta-llama/Llama-3.2-1B, llama3_fb16, apple_iphone_15, pro_private, arn:aws:device... / macos-job
Canceling since a higher priority waiting request for apple-perf-private-devices-main-ca4c5759cf8f09e2179a8833085eeeb481aa4153-false-true exists
|
|
apple / prepare-test-specs (Qwen/Qwen3-0.6B, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15, pro_...
Canceling since a higher priority waiting request for apple-perf-private-devices-main-ca4c5759cf8f09e2179a8833085eeeb481aa4153-false-true exists
|
|
apple / export-models (meta-llama/Llama-3.2-1B, et_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15, p... / macos-job
Canceling since a higher priority waiting request for apple-perf-private-devices-main-ca4c5759cf8f09e2179a8833085eeeb481aa4153-false-true exists
|
|
apple / prepare-test-specs (meta-llama/Llama-3.2-1B, et_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_...
Canceling since a higher priority waiting request for apple-perf-private-devices-main-ca4c5759cf8f09e2179a8833085eeeb481aa4153-false-true exists
|
|
apple / export-models (meta-llama/Llama-3.2-1B, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15, p... / macos-job
Canceling since a higher priority waiting request for apple-perf-private-devices-main-ca4c5759cf8f09e2179a8833085eeeb481aa4153-false-true exists
|
|
apple / prepare-test-specs (google/gemma-3-1b-it, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15,...
Canceling since a higher priority waiting request for apple-perf-private-devices-main-ca4c5759cf8f09e2179a8833085eeeb481aa4153-false-true exists
|
|
apple / export-models (HuggingFaceTB/SmolLM2-135M, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15... / macos-job
Canceling since a higher priority waiting request for apple-perf-private-devices-main-ca4c5759cf8f09e2179a8833085eeeb481aa4153-false-true exists
|
|
apple / prepare-test-specs (meta-llama/Llama-3.2-1B, llama3_fb16, apple_iphone_15, pro_private, arn:aws:d...
Canceling since a higher priority waiting request for apple-perf-private-devices-main-ca4c5759cf8f09e2179a8833085eeeb481aa4153-false-true exists
|
|
apple / export-models (allenai/OLMo-1B-hf, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15, pro_pr... / macos-job
Canceling since a higher priority waiting request for apple-perf-private-devices-main-ca4c5759cf8f09e2179a8833085eeeb481aa4153-false-true exists
|
|
apple / export-models (meta-llama/Llama-3.2-1B, llama3_coreml_ane, apple_iphone_15, ios_18_public, arn:aw... / macos-job
Canceling since a higher priority waiting request for apple-perf-private-devices-main-ca4c5759cf8f09e2179a8833085eeeb481aa4153-false-true exists
|
|
apple / prepare-test-specs (meta-llama/Llama-3.2-1B, llama3_coreml_ane, apple_iphone_15, ios_18_public, a...
Canceling since a higher priority waiting request for apple-perf-private-devices-main-ca4c5759cf8f09e2179a8833085eeeb481aa4153-false-true exists
|
|
apple / export-models (Qwen/Qwen3-0.6B, et_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15, pro_priva... / macos-job
Canceling since a higher priority waiting request for apple-perf-private-devices-main-ca4c5759cf8f09e2179a8833085eeeb481aa4153-false-true exists
|
|
apple / export-models (Qwen/Qwen3-0.6B, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15, pro_priva... / macos-job
Canceling since a higher priority waiting request for apple-perf-private-devices-main-ca4c5759cf8f09e2179a8833085eeeb481aa4153-false-true exists
|
|
apple / prepare-test-specs (HuggingFaceTB/SmolLM2-135M, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_ipho...
Canceling since a higher priority waiting request for apple-perf-private-devices-main-ca4c5759cf8f09e2179a8833085eeeb481aa4153-false-true exists
|
|
apple / export-models (google/gemma-3-1b-it, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15, pro_... / macos-job
Canceling since a higher priority waiting request for apple-perf-private-devices-main-ca4c5759cf8f09e2179a8833085eeeb481aa4153-false-true exists
|
|
apple / prepare-test-specs (allenai/OLMo-1B-hf, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15, p...
Canceling since a higher priority waiting request for apple-perf-private-devices-main-ca4c5759cf8f09e2179a8833085eeeb481aa4153-false-true exists
|
|
apple / benchmark-on-device (meta-llama/Llama-3.2-1B, et_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
|
|
apple / benchmark-on-device (meta-llama/Llama-3.2-1B, llama3_fb16, apple_iphone_15, pro_private, arn:aws:... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
|
|
apple / benchmark-on-device (google/gemma-3-1b-it, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
|
|
apple / benchmark-on-device (meta-llama/Llama-3.2-1B, llama3_coreml_ane, apple_iphone_15, ios_18_public, ... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
|
|
apple / benchmark-on-device (Qwen/Qwen3-0.6B, et_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15, pro... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
|
|
apple / benchmark-on-device (Qwen/Qwen3-0.6B, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15, pro... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
|
|
apple / benchmark-on-device (allenai/OLMo-1B-hf, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15, ... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
|
|
apple / benchmark-on-device (meta-llama/Llama-3.2-1B, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
|
|
apple / benchmark-on-device (HuggingFaceTB/SmolLM2-135M, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iph... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
|