Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 23 additions & 0 deletions research/overlap-batching-independent-audit/DEPENDENCIES.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
[
{
"local_path": "sources/baseline.py",
"commit": "6ca6f217708b075814de409ad693fea9a2aaa760",
"path": "scripts/find_overlap.py",
"git_blob": "de0bca1f9e3ee60d0f1659a87af3869bae8c90da",
"sha256": "890902252573117253ecd536ea09a04115092c7255dfe2ebcf96f7e2d337fdbd"
},
{
"local_path": "sources/candidate.py",
"commit": "a459ee34fad0488691beba8441e0a31e103b91a5",
"path": "scripts/find_overlap.py",
"git_blob": "5bdee10f1a5b324088d16f5a271ed57cec83c6c8",
"sha256": "d17c67167d6654dbea9763cab21bf9b54e929aebfcf18c7ea1b7f170dc6db998"
},
{
"local_path": "sources/candidate-tests.py",
"commit": "a459ee34fad0488691beba8441e0a31e103b91a5",
"path": "tests/test_research_discussion_batching.py",
"git_blob": "1ad26efd6e72e8d07a60b544f1be8e02e219a5e7",
"sha256": "948415ece070e2e9f48c01499d618f60f29482318621b1ff0981643333312d59"
}
]
154 changes: 154 additions & 0 deletions research/overlap-batching-independent-audit/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,154 @@
# Independent pagination and failure audit of PR2493

Arham Garg's [PR2493](https://github.com/CrocSwap/integer-mult-bounds/pull/2493)
batches the initial Discussion/comment/reply pages used by the research overlap
helper. This package independently corroborates its ordered-record and cache
failure behavior at **`a459ee34fad0488691beba8441e0a31e103b91a5`**. It adds no
collector implementation and claims no new measured speedup or multiplication
result. The selected record and production helper are unchanged.

The added evidence is a boundary cross-product and failure injection at every
request position, rather than a second implementation of the batching change.
The API model and direct record traversal here do not import the predecessor's
test harness. Both harnesses use the usual static-graph/cursor simulation;
this is separate implementation and expanded finite coverage, not an independent
human review or a proof for every possible API response.

## Exact sources

[DEPENDENCIES.json](DEPENDENCIES.json) records commit, path, Git blob and SHA256
for three byte-identical source exports:

| Input | Commit | Purpose |
| --- | --- | --- |
| `sources/baseline.py` | `6ca6f217708b075814de409ad693fea9a2aaa760` | Current-main unbatched collector and cache implementation |
| `sources/candidate.py` | `a459ee34fad0488691beba8441e0a31e103b91a5` | PR2493's actual collector and cache implementation |
| `sources/candidate-tests.py` | same PR2493 head | Six original tests, replayed unchanged in fresh normal/optimized processes |

All three inputs are authenticated before any target module executes. Sources
are compiled directly from those bytes, avoiding saved bytecode. The audit
needs neither Git nor network access. [SOURCES.json](SOURCES.json) retains main,
the selected record and the assigned task as historical provenance. There are
no live production-script pins to become stale if the batching change is adopted.
The generic package metadata check uses repository history; the direct checker
works in a Git-free package export.

## Finite result and failure coverage

The immutable corpus is generated from the full Cartesian product:

- Discussion counts: `0, 1, 49, 50, 51, 101`.
- Busy-thread comment counts and selected-comment reply counts, independently:
`0, 1, 4, 5, 6, 99, 100, 101, 104, 105, 106, 205`.
- Both the first and last Discussion are busy; other threads have small pages.
Reply-heavy comments occur at indices 0, 5 and the last comment. This exercises
replies delivered with initial and continuation comment pages.

The 864 parameter tuples yield **710 distinct graphs** after exact canonical
deduplication. Both collectors match the direct, cursor-free traversal on every
field and record position: **2,062,777 records per collector**. Equal body text
on different nodes prevents text-only comparison from hiding an order/identity
error. Unicode newline characters are retained. Opaque cursors encode their
connection owner and reject reuse in another thread or comment.

On the separate 51-thread / 205-comment / 205-reply busy fixture, every actual
request position is failed with a GraphQL-style exception, transport exception,
or malformed missing-connection response. Each is tested both with and without
previous complete evidence:

| Collector | Request positions | Failure cases |
| --- | ---: | ---: |
| Main baseline | 135 | 810 |
| PR2493 | 84 | 504 |

All **1,314 cases** retain a warning. With old evidence, its complete source,
records and original timestamp survive in memory and on disk. On a first fetch,
no partial Discussion source is admitted. The separately fetched PR source may
still refresh, matching the existing per-source cache contract.

Three actual collector mutants stop listing, comment or reply pagination early;
the direct traversal rejects all three. Three modified source exports fail
authentication. The candidate's six original tests pass in both normal and
optimized subprocesses. [RESULT.json](RESULT.json) is the deterministic receipt;
normal verification compares it without writing package files.

For a fixed 101-small-thread corpus, requests fall from **104 to 3** with equal
records. This is a finite request-count corroboration. It is not a new network
timing measurement, nor a claim that busy threads always use fewer requests.
Arham Garg's existing timing evidence retains its own corpus and environment.

## Reproduce

Standard-library Python 3.12, from the repository root:

```sh
python3.12 -I -B scripts/research_package.py --package research/overlap-batching-independent-audit
```

The registered commands run the complete audit normally and with `-O`. They
also replay the predecessor suite in both modes. To check the exact pinned
package without Git or the repository:

```sh
python3.12 -I -B research/overlap-batching-independent-audit/verify.py
python3.12 -I -O -B research/overlap-batching-independent-audit/verify.py
```

Expected: `PASS_OVERLAP_BATCHING_INDEPENDENT_AUDIT`, 710 static graphs, and the
counts above. `--write` explicitly regenerates only this package's receipt.
On restricted Windows shells, set `TMP` and `TEMP` to an existing writable
workspace directory before running; the checker uses temporary fixtures.

Executed on Windows x64, 2026-10-15: the registered CPython **3.12.14** replay
passes both commands. An optimized Git-free export also passes from an unrelated
directory with spaces, leaving all ten package files byte-identical. The initial
direct CPython **3.14.6** audit passes too. These are local assisted checks; no
hosted-CI or independent human result is claimed. TASK.json records the commands,
environment and final freshness check.

## Limits and integration handoff

This checks finite static API fixtures and specified failures. It does not prove
atomicity under concurrent board edits, certify GitHub availability/rate limits,
recheck every future source head, or provide a live timing ratio. Authenticated
source exports establish which code ran, not a general trust guarantee for code.

PR2493's two reported frozen-dependent failures reproduce on this untouched
main base:

```sh
python3.12 -B scripts/research_package.py --package research/overlap-path-index --check-only
# source blob provenance mismatch: scripts/find_overlap.py
python3.12 -B scripts/research_package.py --package research/research-package-pin-batching --check-only
# working source drift: tests/test_research_onboarding.py
```

They remain unresolved. This package does not edit frozen evidence, adopt the
collector, resolve the wider [PR2255 live-pin audit](https://github.com/CrocSwap/integer-mult-bounds/pull/2255),
or claim those dependent replays passed. Supplier/native/hosting/precision and
selected full cold replays are unrelated to this scoped audit and were not run.

## Open next questions

Can PR2493 be integrated with an explicit disposition for the two dependent
failures? This matters because passing the collector tests alone does not admit
frozen package changes. Reproduce the two commands above and record a maintainer
source-binding decision. That policy/integration decision is the blocker; more
static pagination examples are not proposed as a prerequisite. The structured
question, original task and scope change are in [TASK.json](TASK.json).

## Credit and coordination

**Arham Garg / @arhamgarg** owns PR2493's batching change, six tests, benchmark
and prior coverage argument. **Douglas Colkitt** and the overlap-tool contributors
own the original record schema, complete pagination and cache implementation;
**Nick Petalas** supplied the retained CLI-pagination compatibility work.
**Aaron Wang / PR2255** supplied the existing broader live-pin audit.
Their source headers and Apache-2.0 attribution are retained verbatim.

Prepared for **Arham Tahir** with substantial **OpenAI Codex** assistance in
analysis, implementation, verification and writing. No subagents, independent
human review or formal-kernel result is claimed. New material is Apache-2.0.
The canonical investigation is [Discussion2789](https://github.com/CrocSwap/integer-mult-bounds/discussions/2789).
The initial scalar-to-moment assignment and explicit change to this side audit
are preserved in TASK.json; there is no paid-profile or kappa improvement claim.
56 changes: 56 additions & 0 deletions research/overlap-batching-independent-audit/RESULT.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,56 @@
{
"status": "PASS_OVERLAP_BATCHING_INDEPENDENT_AUDIT",
"parameter_cases": 864,
"static_graph_cases": 710,
"records_per_collector": 2062777,
"boundary_sizes": [
0,
1,
4,
5,
6,
99,
100,
101,
104,
105,
106,
205
],
"thread_counts": [
0,
1,
49,
50,
51,
101
],
"small_thread_requests": {
"baseline": 104,
"candidate": 3
},
"fault_injection": {
"baseline": {
"request_positions": 135,
"failure_cases": 810
},
"candidate": {
"request_positions": 84,
"failure_cases": 504
}
},
"source_corruptions_rejected": 3,
"truncation_mutants": {
"stop_comments": "ordered record mismatch",
"stop_replies": "ordered record mismatch",
"stop_listing": "ordered record mismatch"
},
"predecessor_suite": {
"tests": 6,
"modes": [
"normal",
"optimized"
]
},
"scope": "Finite static-API and cache-failure audit; no live timing, adoption or kappa claim."
}
24 changes: 24 additions & 0 deletions research/overlap-batching-independent-audit/SOURCES.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
{
"schema_version": 1,
"base_commit": "6ca6f217708b075814de409ad693fea9a2aaa760",
"files": [
{
"path": "certificates/selected-result.json",
"usage": "provenance",
"git_blob": "ae6a99f28aa468649eb66a361e764d769363bf11",
"sha256": "10b9e340fd8e354a37a0c4813c90e5de1dd42044b5f6aca4a3fc5a42b685fa32"
},
{
"path": "docs/research/agent-task-catalog.json",
"usage": "provenance",
"git_blob": "889b95d936746df124872133ae1e7cc339adcb92",
"sha256": "7d185cd8c2af35988d638d969748ad7b670f902606444dbfc748e4402c340df6"
},
{
"path": "scripts/find_overlap.py",
"usage": "provenance",
"git_blob": "de0bca1f9e3ee60d0f1659a87af3869bae8c90da",
"sha256": "890902252573117253ecd536ea09a04115092c7255dfe2ebcf96f7e2d337fdbd"
}
]
}
134 changes: 134 additions & 0 deletions research/overlap-batching-independent-audit/TASK.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,134 @@
{
"schema_version": 1,
"task_id": "scalar-to-moment",
"priority_revision": 5,
"base_commit": "6ca6f217708b075814de409ad693fea9a2aaa760",
"original_card": {
"id": "scalar-to-moment",
"question": "Can one known scalar simplification be converted into an actual paid-profile improvement?",
"starting_points": [
"research/r439-bsection-stars-seed01/README.md",
"certificates/selected-result.json"
],
"methods": [
"Derive the changed legal frame itinerary and exact child histogram.",
"Prove a scoped obstruction showing why that scalar gain cannot change the paid contract."
],
"acceptance_gate": "An unchanged histogram is not a kappa gain; record any separate runtime or proof benefit explicitly.",
"first_step": {
"command": [
"python3",
"-B",
"research/r439-bsection-stars-seed01/verify.py"
],
"expected": "PASS_R439_BSECTION_STARS",
"inspect": "Observe that the positive control improves scalar counts while retaining the paid histogram.",
"scope": "Positive control / source-bound orientation only; this is not a new construction or full cold replay."
},
"first_experiment": "Choose one simplification and derive the complete changed frame itinerary, or prove why it cannot change the histogram.",
"bottleneck_link": "A legal change to the histogram, not addition count alone, is the bridge to an exponent gain.",
"allowed_variations": [
"One existing scalar simplification and one proposed frame-path change."
],
"scope_change_triggers": [
"Submitting only another scalar count as completion of a paid-profile task."
],
"overlap_terms": [
"scalar simplification",
"paid profile",
"R439"
]
},
"scope_status": "changed",
"actual_scope": "Independent finite static-API, complete-record and every-request-position cache-failure audit of PR2493 at a459ee34fad0488691beba8441e0a31e103b91a5.",
"scope_change_reason": "The scalar-to-moment positive control passed and nearby R439 frame questions were already covered. The mandatory live overlap scan exposed a coordination bottleneck already addressed by PR2493; the bounded contribution is independent verification of that existing proposal, not another batching implementation or mathematical mechanism.",
"bottleneck_link": "Side result in review tooling: independently test the complete-overlap evidence used to avoid duplicated research, including preservation of stale complete evidence on every injected page failure. This is not a paid-profile gain.",
"budget_minutes": 60,
"stop_rule": "One pinned collector proposal, a Cartesian threshold fixture, exhaustive request-position faults on one busy board, inherited tests, source controls and a public handoff. No collector edits, frozen-source repinning, cache redesign or family expansion.",
"outcome": "completed",
"evidence": "RESULT.json and verify.py: 710 distinct static graphs, 2062777 ordered records per collector, 1314 fault cases, three source corruptions and three truncation mutants; six predecessor tests normally and with -O.",
"author": "Arham Tahir",
"ai_assistance": "Substantial OpenAI Codex assistance in source inspection, harness implementation, verification and writing. No subagents or independent human review.",
"open_questions": [
{
"question": "Can PR2493 be integrated with an explicit disposition for its two frozen dependent-package failures?",
"why_it_matters": "The source-bound collector passes this finite audit, but successful record collection does not resolve frozen provenance and live-source drift.",
"first_step": "Reproduce the two check-only failures listed in README.md, then record the maintainer-approved source-binding decision before collector adoption.",
"blocked_by": "Maintainer integration and source-binding policy; no authorization to edit frozen evidence is inferred."
}
],
"selection_seed": "8e3fd61aeaea48140a3be0983b0943d3",
"selection_scope_key": "9dbfd943f23ef75bae31",
"track": "incumbent-optimization; explicit changed scope to independent tooling verification",
"discussion": "https://github.com/CrocSwap/integer-mult-bounds/discussions/2789",
"overlap": {
"entry_open_prs": 719,
"entry_discussion_records": 1425,
"open_prs_fetched_at": "2026-10-15T21:52:41.682513+00:00",
"discussions_fetched_at": "2026-10-15T21:55:43.603886+00:00",
"complete_pagination": true,
"nearest_work": [
{
"pr": 2493,
"head": "a459ee34fad0488691beba8441e0a31e103b91a5",
"contributor": "Arham Garg / arhamgarg",
"added_value": "Independent threshold cross-product and all-request-position fault audit; batching implementation, six existing tests and measured speedup belong to this predecessor."
},
{
"pr": 2255,
"head": "15836362a3cf17d245db8a01d930a12868c043bd",
"added_value": "Existing live-pin drift audit; this package does not repeat that broader analysis or resolve maintainer pin policy."
}
],
"limits": "Titles/bodies, Discussion comments/replies and local package/ledger notes; not all code diffs. Independent verification intentionally overlaps the exact target."
},
"freshness": {
"upstream_commit": "84f8e607779b81c05edc962d4981d1f9b4b9bc9f",
"recorded_at_utc": "2026-10-15T22:09:45.409937+00:00",
"priority_revision": 5,
"submission_parent": "84f8e607779b81c05edc962d4981d1f9b4b9bc9f",
"ancestry_check": "GitHub compare API reports ahead=8, behind=0 for 6ca6f217...84f8e607. Local shared repository is shallow; local merge-base could not establish this relationship.",
"compatibility": "Base 6ca6f217 remains an ancestor; AGENTS.md, autoresearch.md, catalogue, selected record, find_overlap.py and research_package.py unchanged at the fetched main. Only a new audit package is submitted; historical source pins retained.",
"target_pr": 2493,
"target_head": "a459ee34fad0488691beba8441e0a31e103b91a5",
"target_state": "open, ready; no review or Conversation comments at the direct check",
"overlap": {
"open_prs": {
"fetched_at": "2026-10-15T22:05:41.873096+00:00",
"complete_pagination": true,
"records": 722
},
"discussions": {
"fetched_at": "2026-10-15T22:06:03.800375+00:00",
"complete_pagination": true,
"records": 1436
}
},
"collector_note": "Final live overlap used the authenticated candidate collector after the offline audit passed; not a live timing comparison."
},
"validation": {
"host": "Windows x64",
"python": [
"CPython 3.12.14",
"CPython 3.14.6"
],
"registered_replay": "CPython 3.12.14 normal and optimized commands passed, including six unchanged predecessor tests in both modes.",
"git_free_relocation": {
"mode": "Git-free path with spaces, unrelated cwd, -I -O -B",
"python": "Python 3.12.14",
"elapsed_seconds": 26.342,
"unchanged_files": 10
},
"known_rejections": {
"overlap-path-index": "source blob provenance mismatch: scripts/find_overlap.py",
"research-package-pin-batching": "working source drift: tests/test_research_onboarding.py"
},
"not_claimed": [
"Live timing ratio",
"Frozen dependent-package success",
"Independent human review",
"Hosted CI result",
"Supplier or selected cold replay"
]
}
}
Loading
Loading