Repository navigation
Divide commercial kWh on survey electricity or other inputs, not on bills (#899, #705) - #1305
Conversation
Commercial electricity by sector, before and afterFlag off (before) and on (after), on the 2024
Other years. 2017 is identical, by construction. In 2022 the largest shifts are health care (100.6 to 113.4 TWh), arts and recreation (27.5 to 35.1) and real estate (210.1 to 203.7). All groups stay between 8.6 and 13.8 ¢/kWh, except "other", a few unmapped codes on 4 TWh. In 2020 the range is 9.4 to 12.6 ¢. What's wrong in 2024. Transportation and warehousing (18.4 ¢) and rental and leasing (25.3 ¢) are the AIES 2024 step in their bills (#1304): their kWh follow their survey path to 2022 and then their inputs, but their bills don't, so the excess becomes delivery. CBECS 2018 prices these buildings at 9.9-11.4 ¢/kWh. #1306 removes the step from the bills, so these two should come back near the class price on its tables. 🤖 Generated with Claude Code |
… --vintage (#1305) The trucking-to-warehousing electricity mapping in #1306 applies in every survey year, so 2022's tables differ slightly from fd271dc's. The base file holds the 2022 inputs the basis moves on from, so it comes from the build the stack will be pinned to. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Results for the stack (#1306 + #1305)Test rebuild run 43461231130, build Balance: passes in every year
Bills: the AIES 2024 step is goneElectricity bill as a share of output:
Commercial electricity by sector, before and after #1305 (hold tables, 2024)Bills don't change, and commercial kWh stay on EIA's 1,451 TWh. Outside the commercial class every buyer's bill, kWh, generation and delivery are identical, in every year. 2017 is identical.
On NChange against
The hold moves only 2024, as it should. There it undoes the AIES step: sectors whose 2024 bills it inflated fall (consumer goods rental -13%, equipment rental -10%, warehousing -8%, trucking -5%, couriers -4%), and those it deflated rise (cable +23%, broadcasting +19%, spectator sports +16%, legal +12%). The change in N from 2023 to 2024 shrinks: its median across all 404 sectors falls from 4.6% to 4.2%. Spectator sports goes from -14.3% to -0.9%, consumer goods rental from +11.7% to -2.9%, legal from -15.7% to -5.3%, cable from -34.3% to -19.5%. Electricity generation's N doesn't move. VolatilityThe IV score (spend weights) sums to 7.90 under hold and under hold + #1305, against 7.97 on
Still to doTurning the flags on is a re-pin, as in #1302. 🤖 Generated with Claude Code |
…bcea with #1305 IV score, volatility, N_d volatility, driving factor and emissions after the arrow now read the services seed hold (#1306) with commercial kWh divided on survey electricity or other inputs (#1305). Cable, broadcasting, elementary and secondary schools and securities brokerage drop to 0.200 or below and leave the high-volatility table; none had an issue. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
bl-young
left a comment
There was a problem hiding this comment.
Problem framing looks right, and the two PRs belong together once the flags are on.
#1306 / #1304. AIES 2024 against AIES 2023 is not a growth step for many seeded cells: 20/48 electricity reporters move past their own SAS-era yearly range, and other items jump 40-80% in one year, so the relative index divides by a bill that is changing for survey reasons. Holding every AIES year on the SAS 2022 index (Step 5 still sets levels) is the conservative fix the issue asked for. Trucking -> warehousing for electricity is a separate, reasonable claim (terminals/depots, not fleet); CBECS kWh-per-worker vs BEA 2017 for those two supports not understating the 2017 levels.
#1305 / #899+#705. With one commercial price, kWh shares are bill shares, and the balance moves bills without watching physical use. Re-splitting commercial kWh on SAS electricity through 2022 (then other intermediate inputs), while leaving bills, class EIA totals, and other classes alone, is a clear improvement over that: the split follows something that at least moves with electricity spending or activity, instead of with whatever residual the balance left in the bill. This is not the commercial bill seed (#899 still open for that).
Coupling. #1305 alone on fd271dc tables is what produces the 18.4 / 25.3 c/kWh delivery outliers; the stack rebuild (v1.0.0_54dbcea + #1305) brings every group to 8.8-14.2 c against CBECS building-type prices of ~9.2-11.4. That is better-behaved than bill-proportional kWh under the AIES step. Approving both together for a flags-on read is correct; landing them flag-off first (as written) matches the #1260 -> #1302 pattern.
Evidence is enough to approve as an improvement over what we had, with a few watch-outs:
- Balance:
q = L_dom yclean 2017-2024 with and without #1305 -- good. - Hold does what it claims on bills: warehousing / trucking / R&D / rental return to ~2023 shares of output; the inflated/deflated 2024 N movers line up with the AIES step undoing.
- Delivery margins with both on are in a believable band; the #1305-alone failure mode is documented and fixed by #1306.
N_dvolatility (commercial class) improves under the stack; IV barely moves, which is expected ifBis own fuel/refrigerants. Soft corroboration that the reassignment is steadier for users than bill share was.- Outside commercial / 2017 identical / class kWh conserved -- the right invariants for #1305.
Ask / clarify before treating flags-on as done:
- Hold is blanket. #1304's write-up still says hold, then test AIES item-by-item. Evidence here is strongest on electricity; the 2.4% / $163bn "all items" freeze is argued from the same YoY chaos but not item-graded. Fine as a v1.0 stopgap if you say so explicitly; otherwise call out the follow-up. Holding on 2022 also means every later AIES year inherits that freeze until the exit path is chosen -- not only a 2024 patch.
- Trucking proxy is gated by the hold flag in the seed, but
ELECTRICITY_PROXY_INDUSTRIESis always used in the #1305 kWh path when that flag is on. Intentional coupling for now is fine -- just don't lose the proxy if AIES is later re-enabled without revisiting trucking. - Who is floored? One buyer / $0.25bn in 2023 and 2024 -- name them if easy.
Minor: usa_config comment on commercial_kwh_follow_intermediate_inputs still says the basis is "chained at the 2023 survey change"; the code and PR body correctly stop at SAS 2022 and skip AIES. Worth aligning the comment so the next reader doesn't think AIES is in the kWh path.
Default CI won't re-prove the all-years balance; taking rebuild 43461231130 as the check is the same bargain as #1302.
Verdict: Approve #1306 and #1305 as the flag-off stack. With both flags on, the AIES step is gone, delivery margins behave, and commercial kWh allocation is an improvement over bill share (conserved class total, steadier N_d, no absurd implied prices). Hold the flags-on / pin / snapshot work for the combined re-pin with #1303, and leave item-by-item AIES re-entry and #899 bill seeding as explicit follow-ups.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Thanks @bl-young. Answers in order:
Minor. I fixed the The flags stay off until the combined re-pin with #1303. #899's bill seed is still open. 🤖 Generated with Claude Code |
…the split (#899, #705) Flag commercial_kwh_follow_intermediate_inputs, off. Within the commercial class of the generation and delivery split, each industry's kWh follow its 2017 bill moved on its survey electricity bill (chained at the 2023 survey change) or else on its other intermediate inputs. Class kWh stay on EIA; bills, other classes and the tables don't change. Buyers pinned on their own series (data processing on LBNL) keep their kWh exactly. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…#899, #1304) AIES 2024 against AIES 2023 moves purchased electricity beyond any SAS-era year in 20 of 48 survey industries, so the basis reads the SAS through 2022 and moves each buyer's 2022 value on its other inputs after that. A buyer whose survey electricity is withheld in any SAS year uses the inputs rule in every year. Base years come from the model's own 2017 and 2022 tables (commercial_electricity_base.csv), so 2017 is unchanged and 2022 has no step. Buyers left out of the basis keep their kWh exactly. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
… --vintage (#1305) The trucking-to-warehousing electricity mapping in #1306 applies in every survey year, so 2022's tables differ slightly from fd271dc's. The base file holds the 2022 inputs the basis moves on from, so it comes from the build the stack will be pinned to. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…rs get IV_score.py now reports V_Nd, the same volatility formula on each commodity's real N_d. The tracker page gets an N_d volatility column in all three tables. V only sees a commodity's own emissions, so fixes to what service sectors buy, electricity above all, show up in N_d and not in V. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…bcea with #1305 IV score, volatility, N_d volatility, driving factor and emissions after the arrow now read the services seed hold (#1306) with commercial kWh divided on survey electricity or other inputs (#1305). Cable, broadcasting, elementary and secondary schools and securities brokerage drop to 0.200 or below and leave the high-volatility table; none had an issue. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
… from the 5514c3b run Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
3c18839 to
8bc874d
Compare
…1164f (#1314) * feat(config): turn on v1.0 holds for services seed, summary trade, commercial kWh Enable hold_services_seed_at_last_sas_year, hold_imports_on_summary_groups, condition_service_exports_on_summary, and commercial_kwh_follow_intermediate_inputs on the nine v1.0 configs, and require the three Step 5-7 holds in the rebuild flag check. * feat(config): pin v1.0 to CI rebuild v1.0.0_2b1164f Retarget the nine v1.0 configs, 2024 balanced SUT and Cornerstone GHG pins, and upstream FBS inputs to the rebuild from Actions run 43526965633. * docs(analysis): move IV and B tracker currents to v1.0.0_2b1164f Equal- and spend-weight IV on the flags-on pin rebuild; landfill drops below 0.2 after calendar-2017 waste weights.
Part of #899 and #705, stacked on #1306 (#1304). Results for the stack are in this comment.
B driver tracker
The B driver tracker on this branch shows the stack's test build (
v1.0.0_54dbceawith this flag on), including theN_dvolatility column from #1308, which this branch merges until #1308 lands on main. Across the 132 commercial-class commodities the medianN_dvolatility is 0.100 against 0.106 onfd271dc, lower for 78 and higher for 23. Cable, broadcasting, elementary and secondary schools and securities brokerage drop off the high-volatility table.What this does
In the generation and delivery split (
electricity_delivery.py), each buyer's kWh arebill / class price, scaled so the class equals EIA Table 2.2. Every commercial buyer pays one price, so its share of commercial generation, and of the emissions that come with it, is its share of commercial bills. Balancing sets those bills without regard to kWh: other real estate's fell from 20.5% to 13.5% of EIA commercial revenue over 2017-2024 while its inputs grew 47%.With the flag
commercial_kwh_follow_intermediate_inputs(off), commercial kWh are divided on a basis instead of on the bill (commercial_kwh_basis):Purchased electricityin every year 2018-2022): its 2017 bill moved on the survey's own electricity spending through 2022, and on its other intermediate inputs from 2022 after that. AIES years aren't read (Services seed moves on AIES 2024 against AIES 2023, and that step is beyond the survey's range for many industries #1304);The class's kWh stay on EIA, and only the split between commercial buyers changes. Bills, value added, every other class (manufacturing and utilities included) and the tables are untouched. The base years come from the model's own 2017 and 2022 tables (
commercial_electricity_base.csv, written bywrite_commercial_electricity_base), so 2017 is unchanged and 2022 has no step.Checks, flag off vs on, 2017-2024 (
fd271dc)Delivery margins. The implied price of most buyers stays close to the class price: kWh-weighted p10-p90 of 10.1-13.2 ¢/kWh in 2024 against a class price of 12.3. CBECS 2018 has 9.19-11.22 across building activities. The exceptions are buyers whose bill carries the AIES 2024 step (#1304): scientific R&D at 22.5 ¢/kWh and trucking at 20.0 in 2024, and warehousing, whose 2020-2023 bill drifts down while its survey kWh rise, at 8.2-8.6.
Tests
split_billswith a basis moves kWh between commercial buyers only and keeps buyers outside it exact; the basis follows the survey through 2022 and other inputs from 2022; a survey withheld in any year gives no path.🤖 Generated with Claude Code