[Web] Support iOS devices

[AvivSham]

Describe the issue

From other discussions and the npm release page, onnxruntime-web (WebGPU) is not supported in iOS devices regardless of browser type.
Is there an estimation on when this feature will be released it is really important for developers!!

To reproduce

Useful links:

• [Web] The ONNX model cannot be loaded via WASM in the IOS17 browser. #22086
• https://www.npmjs.com/package/onnxruntime-web
• Out-of-memory error in Safari (iOS/macOS) when reloading a page emscripten-core/emscripten#19374

Urgency

No response

ONNX Runtime Installation

Released Package

ONNX Runtime Version or Commit ID

1.20.0

Execution Provider

'webgpu' (WebGPU)

[gyagp]

On iOS, we have to wait for Apple to implement WebGPU. In the recent WebGPU F2F on Oct 29, Apple updated their status as "Functionally, largely complete. In Safari preview for several months. No comment on ship date. Functionally, there are a few missing CTS features we haven't seen used (like importing texture formattings is known not to work). HDR support on WebKit main is added, expect to see in preview soon. Otherwise, looking into iOS memory usage issues and various security issues. Hope to ship soon."

[AvivSham]

@gyagp Thank you for the clarification!
There is something I'm missing, if WebGPU has been in preview for several months why onnxruntime-web cannot be supported on Safari?
Are you waiting for the official release?

[gyagp]

My understanding is Safari Technology Preview can only be installed on macOS, but not iOS. So you couldn't run WebGPU on iOS now.
For onnxruntime-web, it can run everywhere that WebGPU is supported. This means you can run onnxruntime-web on macOS now with Safari Technology Preview, in addition to Chrome.

[AvivSham]

@gyagp Got it, thanks!
How do you suggest to follow the updates around this? i.e. when WebGPU will be available on iOS.

[guschmue]

Seems to be under feature flags in iOS/Safari to turn it on:
Settings -> Apps -> Safari -> Advanced -> Feature Flags -> Webgpu

You can go to https://webgpureport.org/ and see if that worked.

[gyagp]

Someone mentioned WebGPU is enabled by default in iOS 18.2: https://news.ycombinator.com/item?id=42110252.

[AvivSham]

Thanks for the update @gyagp, have you tried it?

[gyagp]

I don't have an iPhone :(

[github-actions]

This issue has been automatically marked as stale due to inactivity and will be closed in 30 days if no further activity occurs. If further support is needed, please provide an update and/or more details.

[ohnobug]

work for me

important!!!

yarn add [email protected] or npm install [email protected]

import * as ort from 'onnxruntime-web';
ort.env.wasm.wasmPaths = "https://cdnjs.cloudflare.com/ajax/libs/onnxruntime-web/1.17.3/"
ort.env.wasm.simd = false;
ort.env.wasm.numThreads = 1;
ort.env.debug = true;