Week 2 Day 5: tiled attention and selected checkpoint - #321
Merged
Merged
Conversation
AI-Assisted: GPT-6 Sol + Sentinel
AI-Assisted: GPT-6 Sol + Sentinel
AI-Assisted: GPT-6 Sol + Sentinel
AI-Assisted: GPT-6 Sol + Sentinel
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Scope
Add Week 2 Day 5 tiled dense-attention prefill and the cumulative
selectedcheckpoint on merged Day 4. Learners implement the BF16/D128 native tiled path for query length at least 9, with causal/additive masks and grouped-query attention. Short or unsupported cases use the readable fallback. Theselectedcheckpoint exposes capacity, RMSNorm, and tiled-attention controls independently. Required matched measurement uses the setup-cached Qwen3-0.6B model; 4B is optional. This PR makes no speed claim.The lesson makes Days 1–5 active and qualifies older Week 2 URLs that were reused by active lessons. The repaired Day 1–2 supplied tests check public cache, quantized-operator, and packed-model behavior instead of private layout, source text, or cache movement counters; the Day 2 lesson describes that observable scope.
Local evidence
360e485860b387ba7ecdc32bf24113cb269a7798, tree7b1159092980fa82ff8a453aea259ba829747c54, descended from merged Day 4 main68642f05df1094ca20f92779504f737921a8dbd9. The cumulative diff is exactly 55 paths, each matched to an accepted source blob. The final integration commit changes only the two repaired supplied-test files on the corrected docs parent.Open gates
This PR is Draft. Hosted macOS full unfiltered reference CI succeeded on this exact head (681 collected, 677 passed, 4 optional model skips in Week 1 Day 5 and Week 3 Day 1); the required 0.6B tests ran. Four fresh independent reviews of the exact public head, base, and current body remain required before Ready or ordinary merge. The full-course Draft #316 remains source material; its verdicts do not transfer.
Chi approved normal website updates for the five-day Week 2 batch. The ordinary main-branch Pages workflow may run after a separately gated merge. This PR does not authorize release, tag, settings or visibility change, manual deployment, or later-course work.