The s3 backend currently does not support assuming a role with web identity.
This is currently supported by the aws provider and it would be good to have feature parity across the aws provider configurations.
Personally, I'd like to use this with github actions to federate access to a state backend from deployment pipelines whilst using a separate federated role for running terraform plan and apply operations.