Skip to content

Create a dummy Zuban configuration for isolation (same as Mypy) - #164

Open
sharkdp wants to merge 1 commit into
lolpack:mainfrom
sharkdp:codex/fix-zuban-benchmark-config
Open

sharkdp wants to merge 1 commit into
lolpack:mainfrom
sharkdp:codex/fix-zuban-benchmark-config

Conversation

@sharkdp

@sharkdp sharkdp commented Nov 3, 2026 •

Copy link
Copy Markdown

Zuban currently runs without the generated benchmark config, so project-specific mypy settings can exclude benchmark targets or disable checks. Pass a dedicated zuban.benchmark.ini via --config-file, with the selected paths in files and check_untyped_defs = True, matching the mypy benchmark setup.

The separate config filename also keeps Zuban's config independent of mypy.benchmark.ini.

This addresses the configuration problem reported in #160.

With this fix, these are the results I get for Zuban 0.10.1:

Project Original config: files Fixed config: files Mypy for comparison
Salt Exit 2, no files 960 960
SQLAlchemy Panic, exit 101 258 258
Matplotlib 108 263 263
setuptools 125 329 329
Dask 286 360 360
SymPy 1,554 1,570 1,570

@sharkdp
sharkdp marked this pull request as draft November 3, 2026 10:24
@sharkdp sharkdp changed the title Fix Zuban benchmark configuration isolation Create a dummy Zuban configuration for isolation (same as Mypy) Nov 3, 2026
@sharkdp
sharkdp marked this pull request as ready for review November 3, 2026 10:28

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant