Remove dist": "loadfile" for pytest for CircleCI jobs

[ydshieh]

What does this PR do?

This pytest option forces all tests from a test file to be run in the same CPU process when using -n X (from pytest-xdist pluging) to distribute tests across multiple CPU processes.

However, this leads some worker(s) to run much longer if a test file have tests that are slower. Removing dist": "loadfile" allows those tests are also being distributed to multiple processes.

Results:

tests_tokenization: main | 1 run on PR

• the longest runtime among 8 paralle CircleCI runners: 8m30s | 5m
• total runtime from all 8 paralle CircleCI runners: 43m | 27m
• total idle time from 8 parallel CircleCI runners: 25m40s | 12m

tests_torch: main | 2 runs on PR

• the longest runtime among 8 paralle CircleCI runners: 6m40s | (6m | 5m10s)
• total runtime from all 8 paralle CircleCI runners: 31m15s | (30m | 28m)
• total idle time from 8 parallel CircleCI runners: 22m 10s | (18m | 13m15s)

tests_non_model: main | 1 run on PR

• the longest runtime among 8 paralle CircleCI runners: 6m | 2m50
• total runtime from all 8 paralle CircleCI runners: 21m20 | 14m50
• total idle time from 8 parallel CircleCI runners: 26m 50s | 7m 55s

[github-actions]

Hi 👋, thank you for opening this pull request! The pull request is converted to draft by default. When it is ready for review, please click the Ready for review button (at the bottom of the PR page).

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[ArthurZucker]

🚀