Skip to content

Add ppc64le power9, power10, and power11 optimized build targets - #1220

Open
veenious wants to merge 1 commit into
astral-sh:mainfrom
veenious:ppc64le-power9-power10-power11
Open

veenious wants to merge 1 commit into
astral-sh:mainfrom
veenious:ppc64le-power9-power10-power11

Conversation

@veenious

@veenious veenious commented Aug 18, 2026 •

Copy link
Copy Markdown

Adds three new ppc64le architecture variant targets, mirroring the existing
x86_64_v2/v3/v4 pattern:

  • ppc64le_power9-unknown-linux-gnu — compiled with -mcpu=power9 -mtune=power9
  • ppc64le_power10-unknown-linux-gnu — compiled with -mcpu=power10 -mtune=power10
  • ppc64le_power11-unknown-linux-gnu — compiled with -mcpu=power11 -mtune=power11

The existing generic ppc64le-unknown-linux-gnu artifact is untouched.

Power9 support is based on Christy Norman's work (clnperez#1).
Power10 uses Debian Bookworm's GCC 12. Power11 uses GCC 14 from Debian Trixie because
GCC 12 does not support -mcpu=power11.

Note: ppc64le_power10 and ppc64le_power11 require glibc ≥ 2.36 at runtime
(enforced in validation.rs). This is a consequence of using Debian Bookworm as the
build base. The existing ppc64le-unknown-linux-gnu and ppc64le_power9 targets
retain glibc 2.17 compatibility.

Closes #1215

@jjhelmus

Copy link
Copy Markdown
Contributor

As mentioned in #1215 before considering adding these targets I would like to see benchmarks which should that there is a benefit to building this microarchitecture specific distributions.

Additional the change to bookworm likely raises the minimum glibc version required to consume these distributions from 2.24 (Debian 9 Stretch) to 2.36 (Debian 12 Bookworm).

A better approach that is more maintainable in the long term to to use the LLVM toolchain to cross-compile these targets using a sysroot. This was mentioned in #1215.

Comment thread src/validation.rs
@veenious
veenious marked this pull request as draft August 27, 2026 13:48
@veenious
veenious marked this pull request as draft August 27, 2026 13:48
@veenious
veenious marked this pull request as ready for review September 4, 2026 08:56
@veenious
veenious marked this pull request as draft September 4, 2026 09:07
@veenious
veenious force-pushed the ppc64le-power9-power10-power11 branch 2 times, most recently from a61a7be to cbcc593 Compare September 8, 2026 06:37
@veenious
veenious marked this pull request as ready for review September 8, 2026 06:55
@veenious
veenious requested a review from jjhelmus September 8, 2026 11:13
@veenious

veenious commented Sep 8, 2026 •

Copy link
Copy Markdown
Author

Hardware validation + apples-to-apples benchmark — Python 3.13.15 on real P9/P10/P11 hardware

All three binaries were cross-compiled from x86 (commit cbcc593) and tested on RHEL 9.8 machines inside registry.access.redhat.com/ubi10/ubi (glibc 2.39) containers.

Smoke tests — ALL PASSED

All three binaries passed: Python version check, ssl, sqlite3, zlib, json, math, hashlib, ctypes imports, and pip invocation.


Performance benchmark — generic vs tuned, same machine

To isolate the tuning benefit from hardware differences, the same generic ppc64le-unknown-linux-gnu release binary was benchmarked against our tuned binary on the exact same machine.

Workload: Pi to 10,000 digits via Python's decimal stdlib module (pure CPU arithmetic, no external dependencies), 3 runs each.

POWER10

Binary Run 1 Run 2 Run 3 Avg
ppc64le-unknown-linux-gnu (generic baseline) 14.282 s 14.298 s 14.522 s 14.367 s
ppc64le_power10-unknown-linux-gnu 8.770 s 8.802 s 8.842 s 8.805 s

→ 38.7% faster on the same P10 machine with -mcpu=power10

POWER11

Binary Run 1 Run 2 Run 3 Avg
ppc64le-unknown-linux-gnu (generic baseline) 13.039 s 13.009 s 13.029 s 13.026 s
ppc64le_power11-unknown-linux-gnu 8.046 s 8.036 s 8.019 s 8.034 s

→ 38.3% faster on the same P11 machine with -mcpu=power11


glibc requirement

Power9 requires glibc ≥ 2.17 (same as the generic baseline). Power10 and Power11 require glibc ≥ 2.36 due to the Bookworm build base. This is enforced in validation.rs.

Comment on lines -20 to -25
# Stretch stopped publishing snapshots in April 2023. Last snapshot
# is 20230423T032533Z. But there are package authentication issues
# with this snapshot.
RUN for s in debian_stretch debian_stretch-updates debian-security_stretch/updates; do \
echo "deb http://snapshot.debian.org/archive/${s%_*}/20221105T150728Z/ ${s#*_} main"; \
done > /etc/apt/sources.list && \

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The snapshot release should not be removed. We want reproducible images when possible

@jjhelmus

jjhelmus commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

A good amount of work is done to keep the x86-64 microarchitecture variants based on the same glibc version. The same should be done here. There is limited functionality in uv to select a build based on the host glibc version so supporting older versions is important.

I would appreciate more details benchmarks, at minimum using fastmark but if possible pyperformance. These would give a more complete picture. The benchmarks should be based on the same compiler version as these difference can be substantial. If upgrading the compiler (and glibc version) give the bulk of the performance gain there is no reason to expand the build matrix.

Is there a reason why cross-compiling using LLVM was not been tried discussed in #1215 and my earlier comment?

@@ -0,0 +1,54 @@
# Debian Bookworm.
FROM docker.io/library/debian@sha256:6bc30d909583f38600edd6609e29eb3fb284ab8affce8d0389f332fc91c2dd91
LABEL org.opencontainers.image.authors="Gregory Szorc <gregory.szorc@gmail.com>"

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This would need to have a different author

@clnperez

Copy link
Copy Markdown
Contributor

@veenious sorry I missed that author fix when I sent over my initial suggestions. lmk if you want me to re-push anything or if your'e fine with fixing my commits.

@jjhelmus thanks for the reviews again. for the sake of this PR -- we'd assumed that since the project hadn't gone that route yet we could add these in the way they're already built and continue to discuss in #1100 . No other reason.

@jjhelmus jjhelmus added platform:linux Specific to the Linux platform arch:ppc64le build:all python:all Select all Python versions labels Sep 11, 2026
Adds three new ppc64le architecture variant targets, mirroring the
existing x86_64_v2/v3/v4 pattern:

- ppc64le_power9-unknown-linux-gnu  — compiled with -mcpu=power9 -mtune=power9
- ppc64le_power10-unknown-linux-gnu — compiled with -mcpu=power10 -mtune=power10
- ppc64le_power11-unknown-linux-gnu — compiled with -mcpu=power11 -mtune=power11

The existing generic ppc64le-unknown-linux-gnu artifact is untouched.

Changes:
- ci-targets.yaml: add all three power variant CI targets
- cpython-unix/targets.yml: add build definitions with correct compiler
  paths; power9 reuses build.cross.Dockerfile (Debian Stretch + GCC 6),
  power10 uses new Bookworm + GCC 12 image, power11 uses new
  Bookworm + GCC 14 from Trixie image (GCC 12 does not support -mcpu=power11)
- cpython-unix/build.cross.Dockerfile: switch apt sources to
  archive.debian.org over HTTPS (port 80 blocked in build containers)
- cpython-unix/build.cross-ppc64le_power10.Dockerfile: new image
- cpython-unix/build.cross-ppc64le_power11.Dockerfile: new image
- cpython-unix/build.py: strip ppc64le_powerN- variant prefix in triple
  normalization, matching the x86_64_vN pattern
- pythonbuild/downloads.json: fix x.org and sourceforge download URLs
  that were unreachable (redirect to blocked port 80)
- src/release.rs: register all three triples in RELEASE_TRIPLES
- src/validation.rs: add RECOGNIZED_TRIPLES, GLIBC_MAX_VERSION,
  ELF_ALLOWED_LIBRARIES, PLATFORM_TAG, and ELF machine entries

Power9 support is based on Christy Norman's work (clnperez/ppc64le-currency).
Power11 requires GCC 14 because GCC 12 does not support -mcpu=power11.

Tested by cross-compiling on x86 and running on physical POWER9, POWER10,
and POWER11 hardware (RHEL 9.8, glibc 2.34, UBI 10 container glibc 2.39).

Closes astral-sh#1215
@veenious
veenious force-pushed the ppc64le-power9-power10-power11 branch from cbcc593 to 739a932 Compare September 29, 2026 11:35
@veenious

veenious commented Sep 29, 2026 •

Copy link
Copy Markdown
Author

Hi @jjhelmus — updated the PR to address all review feedback. Summary below.


Changes from previous revision

Approach: LLVM 23 + Debian Stretch sysroot (cross-compiled on x86)

The LLVM cross-compilation approach in this PR follows #1259 (riscv64 LLVM PR) and #1241 (aarch64 Stretch sysroot PR) as the reference patterns.

  • Replaced the three separate per-variant Dockerfiles with a single unified build.cross-ppc64le.Dockerfile using Debian Trixie base + LLVM 23 from apt.llvm.org + Debian Stretch ppc64el sysroot (same sysroot approach as the existing build.cross.Dockerfile for plain ppc64le-unknown-linux-gnu)
  • Snapshot URL pinned to snapshot.debian.org/archive/debian/20221105T150728Z/ for reproducible builds
  • Dockerfile LABEL updated (not Gregory Szorc)

Shell script changes — each one fixed a specific bug required for LLVM cross-compilation:

File Change Why
build-cpython.sh 4 fixes (1) --no-tls-get-addr-optimize is GNU ld only — lld rejects it causing configure to fail; (2) clang cross-flags (--sysroot, --gcc-install-dir, --target) leaked into sysconfig, polluting downstream extension builds; (3) glibc_version.txt regex was broken with lld's objdump output format; (4) installed_config_vars used for correct PYTHON.json after sysconfig patch
build-expat.sh 1 line expat detected getentropy() (glibc ≥ 2.25 symbol) — same --with-dev-urandom fix already applied for x86, extended to ppc64le
build-libX11.sh 4 lines libtool's shared-library link filter silently stripped --target= and --gcc-install-dir= — wrong runtime objects were linked
build-libXau.sh 4 lines same libtool bug
build-libxcb.sh 4 lines same libtool bug

All changes are guarded to clang or ppc64le targets and do not affect any existing x86/aarch64/musl builds.


glibc

All three new variants now match the existing ppc64le-unknown-linux-gnu and x86 variant floor of glibc 2.17. The Stretch sysroot (glibc 2.24) combined with configure suppressions keeps the runtime minimum at 2.17.

validation.rs entries for all three variants set to 2.17.


pyperformance benchmarks

Ran pyperformance 1.14.0 (--fast, 85 benchmarks) on bare-metal RHEL 9.8. Same compiler (clang-23) on all three — only -mcpu differs.

Variant Compiler -mcpu Geometric mean vs power9
power9 (baseline) clang-23 pwr9 —
power10 clang-23 pwr10 1.35x faster (+35%)
power11 clang-23 pwr11 1.36x faster (+36%)

Selected results:

Benchmark P10 vs P9 P11 vs P9
scimark_monte_carlo 1.64x 1.74x
scimark_sparse_mat_mult 1.66x 1.70x
scimark_sor 1.59x 1.67x
float 1.59x 1.60x
mdp 1.89x 1.91x
asyncio_tcp 2.17x 1.88x
xml_etree_parse 1.50x 1.56x
python_startup 1.58x 1.48x
unpickle_pure_python 1.57x 1.66x
2to3 1.31x 1.32x
regex_compile 1.29x 1.39x
nbody 1.23x 1.30x

The gains are from POWER10/11 ISA features (MMA, new vector/crypto instructions) enabled by -mcpu=pwr10/pwr11, not from compiler version differences — clang-23 was used identically for all three.

@veenious
veenious requested a review from jjhelmus September 29, 2026 12:35
@jjhelmus

Copy link
Copy Markdown
Contributor

Thanks for the update. I'm out this week but will review this when I am back.
There is also a build of LLVM 23.1.2 that includes lld packaged in the same manner as the existing llvm compilers used in this project. That will likely be preferred for reproducibility over the apt.llvm.org packages. #1303 has the start of this upgrade. I have some work use this for cross-compiling but not in a PR yet.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

arch:ppc64le build:all platform:linux Specific to the Linux platform python:all Select all Python versions

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Additional arch binaries for ppc64le

3 participants