Closed
Description
🚀 The feature, motivation and pitch
Currently, the ExecuTorch Android Java tensor class does not support BFloat16 dtype tensors. This prevents Java users from passing BFloat16 tensors in or out of the model. BFloat16 is increasingly common for GenAI, so this will be a useful feature to have.
To implement support, we will need to logic to Tensor.java. This task will require the following:
- Create a
Tensor_bfloat16
implementation, similar to the existingTensor_int8
andTensor_float32
. - Update the dtype switches in Tensor.java to support bfloat16.
- Add corresponding tests to TestTensor.java.
CC #6571
Alternatives
No response
Additional context
No response
RFC (Optional)
No response
Metadata
Metadata
Assignees
Labels
Type
Projects
Status
Done