Skip to content

bench(wildct): H18w run on release 0.1.89, SUPPORTED - #332

Open
88plug wants to merge 8 commits into
mainfrom
claude/h18w-run-1106
Open

88plug wants to merge 8 commits into
mainfrom
claude/h18w-run-1106

Conversation

@88plug

@88plug 88plug commented Nov 7, 2026 •

Copy link
Copy Markdown
Owner

Row 2 of the wildct campaign, H18w, run to its pre-registered protocol (wildct pre-registration, rules W1-W8, amendments R1, P1 and R2-R6). H18's outcome table reads SUPPORTED.

Stacked on #331 (H52w). This branch is #331's branch (merged in at its review head e8e0bd9) plus the H18w commits. Merge #331 first; until then this PR's diff also shows H52w's changes. Both edit the same ledger rows, RESUME.md's status block and the technical report's counts, which is why it is stacked.

The hold

  • One hold, hold.sh H18w 2100 3 bash bench/wildct/row.sh h18w, 2026-11-07T04:22:23Z to 04:26:30Z, rc 0. The lock was free and there was no load wait (load1 0.52). Holds used: 2 of at most 12.
  • Release 0.1.89, frozen by rule W7 since the first hold (H52w). Node image cryptoandcoffee/k3d-gpu:0.1.89@sha256:2e53b511..., k3s v1.37.1+k3s1, k3d v5.9.0, helm v4.3.1, kubectl v1.37.2. The bench archive is main at 85a7bc8; its launcher and share/ match the release.
  • Each of the three runs used a fresh cluster k3dgpu-w-sbx, with K3D_GPU_VENDORS=auto,-nvidia,-intel, W3's kubelet thresholds and W4's RAPL reader. TARGETS resolved as registered: 100.66.38.121:22 192.168.8.238:22 pypi.org:443.
Run sandbox up (s) sandbox CPUs sandbox -> tailscale:22 control sandbox -> LAN:22 control drop-log pkts pypi.org:443 pip tomli_w
1 12.3 17 refused, 0.12 s connect refused, 0.12 s connect 2 connect ok
2 69.9 17 refused, 0.12 s connect refused, 0.12 s connect 2 connect ok
3 15.0 17 refused, 0.11 s connect refused, 0.12 s connect 2 connect ok

Every run meets (a), (b) and (c), so the verdict is SUPPORTED.

  • (a) The sandbox sat on an E-core (16-23).
  • (b) Both private addresses were refused from the sandbox, with kube-router's drop-log counter above 0, and the control pod reached both.
  • (c) PyPI resolved and connected, and pip install --user imported from /tmp/.local.

The prediction (0.8) held. No GPU was touched; every cluster ran with the opt-out.

Disclosed in the run section, not scored:

  • The sandbox pod's CPU 17 lies in 16-19, which W2 keeps free except for this one pod.
  • The runner's pip_rc reads pip's exit only through the import that follows it, as in H18.
  • fail2ban's sshd jail counters did not change across the hold.

Production box

  • The snapshot before (04:20Z) and after (04:27Z) is identical: 18 containers Up, started 2026-10-29T09:11:27Z, restart count 0, same port codes.
  • iptables-save, ip6tables-save and nft list ruleset read 180, 53 and 286 lines before and after. Their rules are identical with the counters stripped.
  • No cluster, container, network, volume or process of ours was left on wildct. live.lock is free and the ssh master is closed.

Files

  • EXPERIMENTS.md: the H18w row's result and verdict (the prediction cell is unchanged), and the "H18w run" section with its Reproduce header.
  • bench/wildct/results/2026-11-07/runs/H18w/ and H18w.out: the records, without kubeconfigs. host/h18w.txt: the host before and after. campaign.log.
  • bench/wildct/RESUME.md: next is row 3, H25w.
  • docs/intel/technical-report.md: 21 SUPPORTED, 7 PENDING, and an H18w row.
  • docs/intel/partner-update-2026-11.md: H18w with the wildct SUPPORTED rows, and the link to the technical report's SUPPORTED heading at its new anchor (mkdocs --strict).

Checks

  • python3 tests/ledger_drift_check.py: 43 files agree with 82 ledger rows.
  • tests/claims_check.sh: 28 files clean.
  • tests/wildct_hold_test.sh: 41 passed.
  • python3 bench/wildct/test_wildct.py, tests/ledger_freshness_test.py, tests/known_issues_test.py and tests/ledger_drift_check_test.py: OK.

Andrew Mello and others added 8 commits November 6, 2026 20:13
H52w, the first wildct hold, ran on 2026-11-07 from 04:03:54Z to 04:05:00Z under
bench/wildct/hold.sh with release 0.1.89 and the box owner's GPU opt-out. Every row of
the pre-registered detection table matches: hybrid active with the balloons policy and
the test pods on CPU 0 and CPU 17, exactly the six launcher ISA labels, no AVX-512, AMX
or NUMA label, nvidia and intel named as detected and opted out, no GPU resource, no GPU
plugin pod, no /dev hostPath, and the host inventory unchanged. The production snapshot
and firewall rules read the same before and after the hold.

The records are under bench/wildct/results/2026-11-07/runs/H52w/ (no kubeconfigs), the
host reads in host/h52w.txt. The ledger row and its run section, the technical report's
counts and RESUME.md's status follow. Rule W7 now holds the campaign at 0.1.89.
…read, two header lines

The technical report's SUPPORTED heading now names H52w, which moved its anchor, so the
partner update's link to the old anchor broke the docs build (mkdocs --strict: "does not
contain an anchor"). The link now points at the new anchor, the partner update lists
H52w among the SUPPORTED rows, and its open-items line no longer counts H52w as pending.

The run section said the loaded module count read 224 before the hold and at 04:11Z. No
record holds a 04:11Z read; the 224 is the preflight's (03:28Z, host/preflight.txt), and
host/h52w.txt has 18 of 18 loaded and kernel.modprobe empty before the hold only. The
text now says exactly that, and that no module read after the hold is recorded.

Two Reproduce lines now match the records: the shipped archive's bench/ differs from
main's at 28b1e70 in RESUME.md and the run records (the runners are equal), and
sample.py read / at 221.1-222.2 GB (decimal), where 207G is df -h's figure. No
prediction, verdict or measured value changes.
Row 2 of the wildct campaign, run to its registered line: one hold of
three bench/sandbox_round.sh runs on cluster k3dgpu-w-sbx with the release
node image, the box owner's GPU opt-out and rule W3. In every run
`sandbox up` exited 0 with the sandbox pod on CPU 17 (E-cores 16-23); the
host's tailscale and LAN sshd addresses were refused from the sandbox with
2 packets on kube-router's drop-log rule and reached from the control pod;
pip installed tomli_w from PyPI into /tmp/.local. H18's outcome table reads
SUPPORTED.

The production snapshot, the firewall rules and fail2ban's sshd jail read
the same before and after the hold, and nothing of the hold was left on
wildct. Records are under bench/wildct/results/2026-11-07/; RESUME.md names
H25w as the next row, and the technical report's counts move with the row.
The H18w run is stacked on #331, whose branch gained a review commit
(e8e0bd9: the technical report anchor in the partner update, the module
read and two header lines of the H52w run) after this branch was cut.
…ur record readings

The technical report's SUPPORTED heading now names H18w, which moved its
anchor, so the partner update's link to it failed mkdocs --strict (the Docs
build on this PR). The link now uses the new anchor. The partner update also
lists H18w with the wildct SUPPORTED rows and no longer counts it among the
PENDING wildct rows.

In the H18w run section and its ledger row, four readings now say what the
records hold. The 207 in "/ 207 GB available" is df -BG's GiB figure;
sample.py read 220.3-222.2 GB, and the swap reading is the runner's, not
sample.py's. The 0.08-0.09 s control connects are those to the two private
addresses (the control pod's pypi.org:443 connects took 0.09-0.14 s). The
18-of-18 module read is from before the hold; after it the records hold the
module count (224) and kernel.modprobe. The pip result is the runner's pip_rc,
as the section's own note on pip's exit says, and the technical report's row
states it the same way. No prediction, measurement or verdict changes.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant