`Failed to build tokenizers` when installing 2.5.1 version.

[xieyu0214]

Failed to build tokenizers when i try to install transformers==2.5.1

Failed to build tokenizers when i try to install tokenizers == 0.5.2

so, i want to know tokenizers == 0.5.2 is must ?

thanks~

[BramVanroy]

tokenizers is only required when you wish to use the new, fast tokenizers. By default, though, the standard (slower) tokenizers are used. So you do not actually need the tokenizers library to run the transformers library.

Related:
#2980
#2831

[julien-c]

Can you please open an issue over at https://github.com/huggingface/tokenizers with your OS/Python details?

[GuruPavanKalyan]

while I am installing transformer==4.4, I am facing issue: Failed to build tokenizers.