Skip to content

Shard mypy_primer more #9443

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from
Closed

Conversation

AlexWaygood
Copy link
Member

Might help reduce the performance impact of #9433 on mypy_primer CI runs.

@AlexWaygood
Copy link
Member Author

Yeah, doesn't look like this helps

@AlexWaygood AlexWaygood closed this Jan 2, 2023
@AlexWaygood AlexWaygood deleted the primer-shards branch January 2, 2023 17:47
@github-actions
Copy link
Contributor

github-actions bot commented Jan 2, 2023

According to mypy_primer, this change has no effect on the checked open source code. 🤖🎉

@AlexWaygood
Copy link
Member Author

AlexWaygood commented Jan 2, 2023

It looks like we had:

  1. A 6:01 shard
  2. An 8:18 shard
  3. A 5:45 shard
  4. A 6:23 shard
  5. A 17:02 shard(!!)
  6. A 5:35 shard

For shard 4, it took 8 minutes for each run of mypy checking manticore, far exceeding any of the other projects in that shard. No other project in shard 4 took >1 minute to be checked once by mypy.

Whether or not we decide to revert #9433, that's quite interesting! Cc. @hauntsaninja.

@hauntsaninja
Copy link
Collaborator

That is interesting. I took a closer look, should be a simple fix to improve perf on manticore.

hauntsaninja added a commit to hauntsaninja/mypy that referenced this pull request Jan 3, 2023
When checking manticore with `--check-untyped-defs`, this is a 4x total
speedup from master, from ~320s to ~80s.

I looked into this because of python/typeshed#9443 (comment)
hauntsaninja added a commit to python/mypy that referenced this pull request Jan 3, 2023
When checking manticore with `--check-untyped-defs`, this is a 4x total
speedup from master, from ~320s to ~80s (uncompiled).

I looked into this because of
python/typeshed#9443 (comment)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants