Repository navigation
Paper 1: official corrected-2009 audit + exploratory refit + fresh 2015 replication (author review) - #2
Draft
devissaputra wants to merge 31 commits into
Conversation
…AGE2_PROTOCOL_2015.md
…atory_2015_stage2.py
…ws/confirmatory-2015-stage2.yml
…interpretation limits
…/official-2009-parity.yml)
…ed-2009-reanalysis.yml
…sensitivity results
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Paper 1 — completed feasible scientific/technical work (22 October 2026)
Author-review working preprint, 11 pages. Draft PR; do not merge without the author reviewing claims and contributions.
1. Official corrected 2009 provenance: now directly established as NON-equivalent
Official maintainer-linked corrected ASSISTments 2009 release (SHA-256
162ef8d2d28bcbfea6591a282994062bd8d5eaa00636544292a0d268dca6e5da) has 4,163 learners and 283,105 skill-labeled response events. Frozen transformed Atomi mirror (SHA-2562053b7ea63f1d5ea953834bf82ed89543e1f11bae1e3e7535c2f9d7f49d4dda7) contains 4,148 learners and 274,331 events.All 4,148 mirror learner IDs exist in the corrected source. Among these, 3,331 have the same normalized skill-response sequence ordered by numeric
order_id; 817 do not. Exact parity of the full source is therefore disproved. Student-level raw data have not been committed. Evidence: source comparison workflow 39773920168, aggregate report, runner.2. Official corrected 2009 exploratory refit: completed
A new frozen, learner-disjoint 2009 corrected-source source-sensitivity experiment used 2,914 train / 624 validation / 625 test learners, 48,842 held-out interactions:
Evidence: corrected source run 39774414969, source code, protocol, JSON.
3. ASSISTments 2015 independent-year replication: completed
A first nonconverged PFA pilot was retained as diagnostic/inconclusive. Stage 2 excluded its 5,000 learners, fit PFA and GRU on new training learners and evaluated 750 untouched held-out learners / 26,697 events:
Evidence: Actions 39754854426.
4. Final artifact integration and new QA
/Paper1_Final_20261022and current ChatGPT delivery. The GitHub TeX source alone requires the three figures shipped in the arXiv source ZIP.Remaining external gates, not delegated
Limits: The 2009 strict parity is refuted. Findings compare unequal information representations and model capacities, do not identify a recurrence-only effect or teaching efficacy, and do not establish wide institutional transportability. These limitations are explicit in the manuscript.