docs(email-security): the historical backfill is judged now, and still acts on nothing - #392
Open
maximelb wants to merge 1 commit into
Open
docs(email-security): the historical backfill is judged now, and still acts on nothing#392maximelb wants to merge 1 commit into
maximelb wants to merge 1 commit into
Conversation
…l acts on nothing The docs said the connection bootstrap was metadata-only and computed no verdicts. It judges that fortnight now, with the same rules live mail is judged with, so the queue has real verdicts on day one and a hunt or a rule backtest has something to run against — while still emitting no telemetry, running no automation and performing no remediation on mail that was delivered before the product was switched on. New `## The historical backfill` section in pipeline.md carries the contract and the reasoning; messages.md documents the drawer's `judged_via` field and the one screen where the distinction matters (a malicious verdict beside an empty action timeline is the lane working, not a broken connection); getting-started, index, providers and the API reference are corrected. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
maximelb
marked this pull request as ready for review
September 8, 2026 13:58
Contributor
Author
|
/lc-review |
lcbill
approved these changes
Sep 8, 2026
Contributor
Author
|
HOLD — do not merge yet. Approved and green (including |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What was wrong
The docs said, in four places, that the connection bootstrap is metadata-only and "computes no verdicts and performs no actions". The first half of that is no longer true.
The 14-day historical walk now judges the mail it indexes, with the same managed pack, the same customer
dr-mailrules and the same policy thresholds live mail is judged with. So a customer's queue has real verdicts on their first day, the raw copy and the judged model are stored on the normal retention lanes, a flagged message gets the same 400-day evidence row, and a hunt or a rule backtest has a fortnight of that customer's own mail to run against — instead of a screen ofunknown.The second half is unchanged and is the part that needed saying more clearly, not less: backfilled mail emits no telemetry and acts on nothing. No
EMAIL_MESSAGE, noEMAIL_VERDICT, no policy automation, no remediation, no detonation, no user-report processing, and no contribution to the time-to-verdict percentile.What is here
pipeline.md— a new## The historical backfillsection carrying the contract and the reasoning in one place: mail delivered eleven days ago has already been read and filed by the person it was addressed to, so quarantining it now is a surprise, and replaying a fortnight of it into a customer's D&R rules on the day they switch the product on is a denial of service on their own alerting. Also states what backfilled mail does feed (sender profiles including the flagged counter, and campaign clustering), that the walk is paced so it cannot take capacity from live mail, and that mail arriving during the walk is ordinary live mail.messages.md—### Which lane judged it, documenting the drawer's newjudged_viafield and the one screen where the distinction matters: a backfilled message can show amaliciousverdict beside an empty action timeline, and without this an analyst's only readings are "our telemetry is broken" or "somebody suppressed this". Absent/nullis documented as unknown, neverlive.api-reference.md—message.judged_viaonGET /messages/{msg_uuid}, with the same absent-is-not-livewarning.getting-started.md,index.md,providers.md— the three stale "metadata-only" claims corrected, including thebackfill_daystable row.pipeline.md's time-to-verdict exclusion note now distinguishes the historical backfill (which emits nothing, so it never enters the population at all) from an incident backfill and the emission sweeper's repairs (which do go back through the ingest path and are excluded by lane).Anchors
Checked by hand, both directions:
messages.md#which-lane-judged-itpipeline.md:306→messages.md:107### Which lane judged itpipeline.md#the-historical-backfillmessages.md:122,api-reference.md:49,pipeline.md:369→pipeline.md:267## The historical backfillNo
metadata-only,metadata only,no verdictsornot judgedstring remains anywhere underdocs/email-security/.