Support BFloat16 dtype in Android Tensor API #9881
Labels
module: android
Issues related to Android code, build, and execution
triaged
This issue has been looked at a team member, and triaged and prioritized into an appropriate module
🚀 The feature, motivation and pitch
Currently, the ExecuTorch Android Java tensor class does not support BFloat16 dtype tensors. This prevents Java users from passing BFloat16 tensors in or out of the model. BFloat16 is increasingly common for GenAI, so this will be a useful feature to have.
To implement support, we will need to logic to Tensor.java. This task will require the following:
Tensor_bfloat16
implementation, similar to the existingTensor_int8
andTensor_float32
.CC #6571
Alternatives
No response
Additional context
No response
RFC (Optional)
No response
cc @kirklandsign @cbilgin
The text was updated successfully, but these errors were encountered: