Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
d0678ac
Update results from script: scripts/irm/irm_ate_sensitivity.py
invalid-email-address Aug 6, 2026
c86c3f0
Update results from script: scripts/irm/irm_atte_sensitivity.py
invalid-email-address Aug 6, 2026
2a2b3af
Update results from script: scripts/irm/irm_cate.py
invalid-email-address Aug 6, 2026
c0bdc2f
Update results from script: scripts/irm/irm_gate.py
invalid-email-address Aug 6, 2026
a825122
Update results from script: scripts/irm/irm_ate.py
invalid-email-address Aug 6, 2026
6a7ac53
Update results from script: scripts/irm/irm_atte.py
invalid-email-address Aug 6, 2026
062e46e
Update results from script: scripts/plm/lplr_ate.py
invalid-email-address Aug 6, 2026
ef5cb5a
Update results from script: scripts/plm/plr_cate.py
invalid-email-address Aug 6, 2026
1eab0cd
Update results from script: scripts/plm/plr_gate.py
invalid-email-address Aug 6, 2026
06b3881
Update results from script: scripts/plm/plr_ate.py
invalid-email-address Aug 6, 2026
443caa1
Update results from script: scripts/plm/plr_ate_sensitivity.py
invalid-email-address Aug 6, 2026
36d276e
Merge branch 'main' into dev
SvenKlaassen Aug 10, 2026
1cb28f4
Merge branch 'main' into dev
SvenKlaassen Aug 10, 2026
ad3a5a4
Update results from script: scripts/irm/irm_atte_sensitivity.py
invalid-email-address Aug 10, 2026
08f8cbc
Update results from script: scripts/irm/irm_ate_sensitivity.py
invalid-email-address Aug 10, 2026
d47bea7
Update results from script: scripts/irm/irm_cate.py
invalid-email-address Aug 10, 2026
eee9036
Update results from script: scripts/irm/irm_gate.py
invalid-email-address Aug 10, 2026
2c3e58d
Update results from script: scripts/irm/irm_atte.py
invalid-email-address Aug 10, 2026
bfd7258
Update results from script: scripts/irm/irm_ate.py
invalid-email-address Aug 10, 2026
4698477
Update results from script: scripts/plm/lplr_ate.py
invalid-email-address Aug 10, 2026
b471588
Update results from script: scripts/plm/plr_cate.py
invalid-email-address Aug 10, 2026
c68117d
Update results from script: scripts/plm/plr_gate.py
invalid-email-address Aug 10, 2026
4610d5f
Update results from script: scripts/plm/plr_ate.py
invalid-email-address Aug 10, 2026
7ede802
Update results from script: scripts/plm/plr_ate_sensitivity.py
invalid-email-address Aug 10, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
28 changes: 14 additions & 14 deletions results/irm/irm_ate_coverage.csv
Original file line number Diff line number Diff line change
@@ -1,15 +1,15 @@
Learner g,Learner m,level,Coverage,CI Length,Bias,repetition
LGBM Regr.,LGBM Clas.,0.9,0.931,1.2316532622529917,0.2992448325629738,1000
LGBM Regr.,LGBM Clas.,0.95,0.971,1.4676053819640873,0.2992448325629738,1000
LGBM Regr.,Logistic,0.9,0.918,0.7686543138837709,0.19130776690526882,1000
LGBM Regr.,Logistic,0.95,0.964,0.9159081070123597,0.19130776690526882,1000
LassoCV,LGBM Clas.,0.9,0.919,1.085643937942505,0.26276932948403875,1000
LassoCV,LGBM Clas.,0.95,0.977,1.2936245411363425,0.26276932948403875,1000
LassoCV,Logistic,0.9,0.914,0.6575993935743172,0.15918300885857045,1000
LassoCV,Logistic,0.95,0.963,0.7835780075153564,0.15918300885857045,1000
LassoCV,RF Clas.,0.9,0.923,0.5880692523443405,0.14216834117620963,1000
LassoCV,RF Clas.,0.95,0.968,0.7007277341428199,0.14216834117620963,1000
RF Regr.,Logistic,0.9,0.912,0.737241521175503,0.18258213488785877,1000
RF Regr.,Logistic,0.95,0.96,0.8784774558266153,0.18258213488785877,1000
RF Regr.,RF Clas.,0.9,0.901,0.6169132543509753,0.15312602292680585,1000
RF Regr.,RF Clas.,0.95,0.952,0.7350974824150611,0.15312602292680585,1000
LGBM Regr.,LGBM Clas.,0.9,0.945,1.2216042267151985,0.28345657770907506,1000
LGBM Regr.,LGBM Clas.,0.95,0.978,1.455631217569933,0.28345657770907506,1000
LGBM Regr.,Logistic,0.9,0.937,0.7783635652471962,0.1755643048856624,1000
LGBM Regr.,Logistic,0.95,0.974,0.9274773935904179,0.1755643048856624,1000
LassoCV,LGBM Clas.,0.9,0.94,1.089252770786487,0.2509252248385753,1000
LassoCV,LGBM Clas.,0.95,0.97,1.297924730700042,0.2509252248385753,1000
LassoCV,Logistic,0.9,0.922,0.6689562114359321,0.15824066833297554,1000
LassoCV,Logistic,0.95,0.963,0.7971104906634167,0.15824066833297554,1000
LassoCV,RF Clas.,0.9,0.916,0.5816683496081073,0.13385921983832258,1000
LassoCV,RF Clas.,0.95,0.959,0.6931005881001578,0.13385921983832258,1000
RF Regr.,Logistic,0.9,0.928,0.7402877167307594,0.16822215567409454,1000
RF Regr.,Logistic,0.95,0.97,0.8821072217099382,0.16822215567409454,1000
RF Regr.,RF Clas.,0.9,0.911,0.6219224222421955,0.14345892189725745,1000
RF Regr.,RF Clas.,0.95,0.951,0.7410662741047522,0.14345892189725745,1000
2 changes: 1 addition & 1 deletion results/irm/irm_ate_metadata.csv
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
DoubleML Version,Script,Date,Total Runtime (minutes),Python Version,Config File
0.12.dev0,IRMATECoverageSimulation,2025-12-04 19:18,128.43919472694398,3.12.3,scripts/irm/irm_ate_config.yml
0.11.5.dev55,IRMATECoverageSimulation,2026-08-10 12:26,113.26169823010763,3.12.3,scripts/irm/irm_ate_config.yml
16 changes: 8 additions & 8 deletions results/irm/irm_ate_sensitivity_coverage.csv
Original file line number Diff line number Diff line change
@@ -1,9 +1,9 @@
Learner g,Learner m,level,Coverage,CI Length,Bias,Coverage (Lower),Coverage (Upper),RV,RVa,Bias (Lower),Bias (Upper),repetition
LGBM Regr.,LGBM Clas.,0.9,0.104,0.26700744915395425,0.18155232199663573,0.962,1.0,0.12549287515490162,0.05598005111522917,0.044565302894415494,0.32482781026582425,500
LGBM Regr.,LGBM Clas.,0.95,0.232,0.31815899929988095,0.18155232199663573,0.996,1.0,0.12549287515490162,0.03612029770121405,0.044565302894415494,0.32482781026582425,500
LGBM Regr.,Logistic,0.9,0.23,0.257663233362731,0.15145245487884335,1.0,1.0,0.10207244929149722,0.03621321533456867,0.02593099116694401,0.3002768258881602,500
LGBM Regr.,Logistic,0.95,0.522,0.30702467943428213,0.15145245487884335,1.0,1.0,0.10207244929149722,0.019182778604657814,0.02593099116694401,0.3002768258881602,500
Linear,LGBM Clas.,0.9,0.108,0.26725519240961965,0.17907088100479915,0.974,1.0,0.12655801859027904,0.05541429018003078,0.04415911293427357,0.31913100847174025,500
Linear,LGBM Clas.,0.95,0.27,0.318454203596823,0.17907088100479915,0.996,1.0,0.12655801859027904,0.03501281859485896,0.04415911293427357,0.31913100847174025,500
Linear,Logistic,0.9,0.874,0.25906199626090154,0.09125618159082688,1.0,1.0,0.06408216867705586,0.006446037964926924,0.05593258931866834,0.23673871825981035,500
Linear,Logistic,0.95,0.968,0.3086914082291149,0.09125618159082688,1.0,1.0,0.06408216867705586,0.0015805668774873335,0.05593258931866834,0.23673871825981035,500
LGBM Regr.,LGBM Clas.,0.9,0.078,0.267240647815274,0.1849797522270908,0.944,1.0,0.1277251511112122,0.058099654065215015,0.0462435901644452,0.3282162860304317,500
LGBM Regr.,LGBM Clas.,0.95,0.226,0.3184368726437095,0.1849797522270908,0.994,1.0,0.1277251511112122,0.038024434129740166,0.0462435901644452,0.3282162860304317,500
LGBM Regr.,Logistic,0.9,0.248,0.2575482967764377,0.15213650907120946,0.994,1.0,0.10242549359571286,0.03663077242613726,0.026715952687959295,0.30107260757572424,500
LGBM Regr.,Logistic,0.95,0.5,0.30688772404448356,0.15213650907120946,1.0,1.0,0.10242549359571286,0.0196591289842577,0.026715952687959295,0.30107260757572424,500
Linear,LGBM Clas.,0.9,0.074,0.2675287050740506,0.182823829142849,0.954,1.0,0.12886655394255406,0.0577538372519743,0.04604391866476501,0.32307881317113457,500
Linear,LGBM Clas.,0.95,0.244,0.3187801140382242,0.182823829142849,0.992,1.0,0.12886655394255406,0.03716643138314868,0.04604391866476501,0.32307881317113457,500
Linear,Logistic,0.9,0.848,0.25903708180803187,0.09212013208509906,1.0,1.0,0.06459624780853045,0.00698024047772583,0.056076576310785275,0.23782472799971893,500
Linear,Logistic,0.95,0.96,0.3086617208274404,0.09212013208509906,1.0,1.0,0.06459624780853045,0.002026183464072373,0.056076576310785275,0.23782472799971893,500
2 changes: 1 addition & 1 deletion results/irm/irm_ate_sensitivity_metadata.csv
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
DoubleML Version,Script,Date,Total Runtime (minutes),Python Version,Config File
0.12.dev0,IRMATESensitivityCoverageSimulation,2025-12-04 17:47,37.59833161433538,3.12.3,scripts/irm/irm_ate_sensitivity_config.yml
0.11.5.dev55,IRMATESensitivityCoverageSimulation,2026-08-10 11:11,37.94418383042018,3.12.3,scripts/irm/irm_ate_sensitivity_config.yml
28 changes: 14 additions & 14 deletions results/irm/irm_atte_coverage.csv
Original file line number Diff line number Diff line change
@@ -1,15 +1,15 @@
Learner g,Learner m,level,Coverage,CI Length,Bias,repetition
LGBM Regr.,LGBM Clas.,0.9,0.929,1.5129808992585232,0.3494762511606464,1000
LGBM Regr.,LGBM Clas.,0.95,0.975,1.802827937547063,0.3494762511606464,1000
LGBM Regr.,Logistic,0.9,0.897,0.8665295499675973,0.21830700047216328,1000
LGBM Regr.,Logistic,0.95,0.946,1.0325336441175617,0.21830700047216328,1000
LassoCV,LGBM Clas.,0.9,0.916,1.3734552128644464,0.3386570485257962,1000
LassoCV,LGBM Clas.,0.95,0.974,1.6365728278097587,0.3386570485257962,1000
LassoCV,Logistic,0.9,0.903,0.8185274172270134,0.2143949995500193,1000
LassoCV,Logistic,0.95,0.96,0.9753355750547081,0.2143949995500193,1000
LassoCV,RF Clas.,0.9,0.884,0.5768241077018054,0.15075762219708613,1000
LassoCV,RF Clas.,0.95,0.944,0.6873283178426831,0.15075762219708613,1000
RF Regr.,Logistic,0.9,0.896,0.8425822825234105,0.2141783904054886,1000
RF Regr.,Logistic,0.95,0.94,1.0039987149605252,0.2141783904054886,1000
RF Regr.,RF Clas.,0.9,0.873,0.5972373860549938,0.1572551056347038,1000
RF Regr.,RF Clas.,0.95,0.935,0.7116522392683193,0.1572551056347038,1000
LGBM Regr.,LGBM Clas.,0.9,0.934,1.4937798499989419,0.34117402890580323,1000
LGBM Regr.,LGBM Clas.,0.95,0.976,1.7799484761788762,0.34117402890580323,1000
LGBM Regr.,Logistic,0.9,0.916,0.8435638060800157,0.20631198454891522,1000
LGBM Regr.,Logistic,0.95,0.959,1.0051682724150017,0.20631198454891522,1000
LassoCV,LGBM Clas.,0.9,0.93,1.3997684908780161,0.3357813940036333,1000
LassoCV,LGBM Clas.,0.95,0.982,1.6679270324494568,0.3357813940036333,1000
LassoCV,Logistic,0.9,0.918,0.7891533639274975,0.19681613920501798,1000
LassoCV,Logistic,0.95,0.969,0.940334231711037,0.19681613920501798,1000
LassoCV,RF Clas.,0.9,0.907,0.5796654438870646,0.1409144365107981,1000
LassoCV,RF Clas.,0.95,0.955,0.6907139787305762,0.1409144365107981,1000
RF Regr.,Logistic,0.9,0.907,0.8127255948906641,0.1980752575183376,1000
RF Regr.,Logistic,0.95,0.954,0.9684222773377434,0.1980752575183376,1000
RF Regr.,RF Clas.,0.9,0.904,0.5989514996874538,0.14743004054325756,1000
RF Regr.,RF Clas.,0.95,0.957,0.7136947316396663,0.14743004054325756,1000
2 changes: 1 addition & 1 deletion results/irm/irm_atte_metadata.csv
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
DoubleML Version,Script,Date,Total Runtime (minutes),Python Version,Config File
0.12.dev0,IRMATTECoverageSimulation,2025-12-04 19:17,127.50641198952992,3.12.3,scripts/irm/irm_atte_config.yml
0.11.5.dev55,IRMATTECoverageSimulation,2026-08-10 12:23,110.56588924328486,3.12.3,scripts/irm/irm_atte_config.yml
16 changes: 8 additions & 8 deletions results/irm/irm_atte_sensitivity_coverage.csv
Original file line number Diff line number Diff line change
@@ -1,9 +1,9 @@
Learner g,Learner m,level,Coverage,CI Length,Bias,Coverage (Lower),Coverage (Upper),RV,RVa,Bias (Lower),Bias (Upper),repetition
LGBM Regr.,LGBM Clas.,0.9,0.742,0.34905458483668395,0.13054186381999264,0.958,1.0,0.10160519674460072,0.02147924444029479,0.06225696870603676,0.2547167550221069,500
LGBM Regr.,LGBM Clas.,0.95,0.848,0.4159241914956518,0.13054186381999264,0.988,1.0,0.10160519674460072,0.010345724353659373,0.06225696870603676,0.2547167550221069,500
LGBM Regr.,Logistic,0.9,0.76,0.3468033024136178,0.1257451763861217,0.962,1.0,0.09464538506725147,0.019042064023498208,0.062099562490136685,0.2546157792911907,500
LGBM Regr.,Logistic,0.95,0.87,0.4132416230312373,0.1257451763861217,0.99,1.0,0.09464538506725147,0.009057626091664835,0.062099562490136685,0.2546157792911907,500
Linear,LGBM Clas.,0.9,0.8,0.3498779710118114,0.11925928428374606,0.962,1.0,0.09501448425797636,0.017305926960423847,0.06259908086771278,0.23917304693135916,500
Linear,LGBM Clas.,0.95,0.888,0.4169053166378378,0.11925928428374606,0.99,1.0,0.09501448425797636,0.00818694195298031,0.06259908086771278,0.23917304693135916,500
Linear,Logistic,0.9,0.954,0.35050172092922355,0.06846426368040737,1.0,1.0,0.05373903639592994,0.0038361798530380602,0.10030761571464483,0.17007849218927298,500
Linear,Logistic,0.95,0.972,0.41764856050674876,0.06846426368040737,1.0,1.0,0.05373903639592994,0.0015020205315898524,0.10030761571464483,0.17007849218927298,500
LGBM Regr.,LGBM Clas.,0.9,0.702,0.3491292868207411,0.13763770189527935,0.946,1.0,0.10683828134908403,0.024107307497075292,0.06186766273961836,0.2627456479168576,500
LGBM Regr.,LGBM Clas.,0.95,0.84,0.4160132043998559,0.13763770189527935,0.98,1.0,0.10683828134908403,0.011647589846304079,0.06186766273961836,0.2627456479168576,500
LGBM Regr.,Logistic,0.9,0.72,0.3468272748096753,0.1344795350904188,0.946,1.0,0.10094330923810524,0.021882527374028946,0.05988315009713599,0.2642494015111184,500
LGBM Regr.,Logistic,0.95,0.838,0.4132701879029839,0.1344795350904188,0.988,1.0,0.10094330923810524,0.010789324511693234,0.05988315009713599,0.2642494015111184,500
Linear,LGBM Clas.,0.9,0.756,0.3498627168673395,0.12832078147710219,0.956,1.0,0.10192831815497197,0.02009400089391538,0.06013904072001689,0.24980019297384018,500
Linear,LGBM Clas.,0.95,0.87,0.4168871402036007,0.12832078147710219,0.986,1.0,0.10192831815497197,0.009725222351342957,0.06013904072001689,0.24980019297384018,500
Linear,Logistic,0.9,0.944,0.350593853054879,0.0741101735057973,1.0,1.0,0.0580582601702048,0.004580830816997106,0.09233050186704025,0.18000427592971247,500
Linear,Logistic,0.95,0.974,0.41775834270569034,0.0741101735057973,1.0,1.0,0.0580582601702048,0.001564934511098024,0.09233050186704025,0.18000427592971247,500
2 changes: 1 addition & 1 deletion results/irm/irm_atte_sensitivity_metadata.csv
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
DoubleML Version,Script,Date,Total Runtime (minutes),Python Version,Config File
0.12.dev0,IRMATTESensitivityCoverageSimulation,2025-12-04 17:47,37.48425861199697,3.12.3,scripts/irm/irm_atte_sensitivity_config.yml
0.11.5.dev55,IRMATTESensitivityCoverageSimulation,2026-08-10 11:11,38.09554938872655,3.12.3,scripts/irm/irm_atte_sensitivity_config.yml
28 changes: 14 additions & 14 deletions results/irm/irm_cate_coverage.csv
Original file line number Diff line number Diff line change
@@ -1,15 +1,15 @@
Learner g,Learner m,level,Coverage,CI Length,Bias,Uniform Coverage,Uniform CI Length,repetition
LGBM Regr.,LGBM Clas.,0.9,0.92461,1.0665951249223096,0.24613991582170225,1.0,2.6653759321537116,1000
LGBM Regr.,LGBM Clas.,0.95,0.97023,1.2709264804359406,0.24613991582170225,1.0,2.6812445695035247,1000
LGBM Regr.,Logistic,0.9,0.89795,0.4614986062328707,0.11130386458867365,0.999,1.1580110182466605,1000
LGBM Regr.,Logistic,0.95,0.94769,0.5499095070290679,0.11130386458867365,1.0,1.1604523683663983,1000
Linear,LGBM Clas.,0.9,0.90908,1.0653909229898018,0.2559912909682445,1.0,2.6806660530315596,1000
Linear,LGBM Clas.,0.95,0.9567,1.2694915853308952,0.2559912909682445,0.999,2.680517403176158,1000
Linear,Logistic,0.9,0.90534,0.4776874641392367,0.11362720144689947,1.0,1.2021014808982184,1000
Linear,Logistic,0.95,0.9505399999999999,0.5691997210197929,0.11362720144689947,0.996,1.2007226696609286,1000
Linear,RF Clas.,0.9,0.91122,0.5134643281598085,0.11906161888403807,1.0,1.2933158587254148,1000
Linear,RF Clas.,0.95,0.95521,0.6118304839102687,0.11906161888403807,1.0,1.2923682725270258,1000
RF Regr.,Logistic,0.9,0.89883,0.4617571633800954,0.11143886684767142,0.997,1.165093904354102,1000
RF Regr.,Logistic,0.95,0.94936,0.5502175968725668,0.11143886684767142,0.998,1.1641657405751544,1000
RF Regr.,RF Clas.,0.9,0.9018999999999999,0.49638796465577406,0.11812020692019015,1.0,1.2489623144139728,1000
RF Regr.,RF Clas.,0.95,0.94932,0.5914827417729625,0.11812020692019015,0.999,1.2486145265039033,1000
LGBM Regr.,LGBM Clas.,0.9,0.92402,1.0438842270940178,0.23965860666760463,0.97,1.7562600885997204,1000
LGBM Regr.,LGBM Clas.,0.95,0.96475,1.2438647765428603,0.23965860666760463,0.971,1.7547772992932296,1000
LGBM Regr.,Logistic,0.9,0.89791,0.4588360382851092,0.11059867069265111,0.941,0.771732162768498,1000
LGBM Regr.,Logistic,0.95,0.94625,0.546736861634672,0.11059867069265111,0.941,0.772526839318402,1000
Linear,LGBM Clas.,0.9,0.9050499999999999,1.0390438019787018,0.24952988918005253,0.953,1.7497239109348635,1000
Linear,LGBM Clas.,0.95,0.95431,1.238097054272359,0.24952988918005253,0.955,1.750159626740083,1000
Linear,Logistic,0.9,0.8968700000000001,0.4760524994633335,0.11424035017689979,0.937,0.8037721708602411,1000
Linear,Logistic,0.95,0.9490299999999999,0.5672515404472124,0.11424035017689979,0.943,0.8033275797261291,1000
Linear,RF Clas.,0.9,0.90398,0.5079458781734679,0.11963985145990708,0.939,0.8565789636312426,1000
Linear,RF Clas.,0.95,0.95252,0.6052548451747061,0.11963985145990708,0.941,0.8564492591301055,1000
RF Regr.,Logistic,0.9,0.89879,0.4593081650162346,0.11020772535113972,0.931,0.7726413526159014,1000
RF Regr.,Logistic,0.95,0.94794,0.5472994353336215,0.11020772535113972,0.928,0.7725174212186875,1000
RF Regr.,RF Clas.,0.9,0.90283,0.4939667895156676,0.11696365456942968,0.93,0.8298418626927668,1000
RF Regr.,RF Clas.,0.95,0.95159,0.5885977336499799,0.11696365456942968,0.931,0.830228246434023,1000
2 changes: 1 addition & 1 deletion results/irm/irm_cate_metadata.csv
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
DoubleML Version,Script,Date,Total Runtime (minutes),Python Version,Config File
0.12.dev0,IRMCATECoverageSimulation,2025-12-04 18:31,81.88368842999141,3.12.3,scripts/irm/irm_cate_config.yml
0.11.5.dev55,IRMCATECoverageSimulation,2026-08-10 11:53,80.29540002743403,3.12.3,scripts/irm/irm_cate_config.yml
28 changes: 14 additions & 14 deletions results/irm/irm_gate_coverage.csv
Original file line number Diff line number Diff line change
@@ -1,15 +1,15 @@
Learner g,Learner m,level,Coverage,CI Length,Bias,Uniform Coverage,Uniform CI Length,repetition
LGBM Regr.,LGBM Clas.,0.9,0.9386666666666666,0.8559513177443687,0.1937643264532876,1.0,2.006280185703383,1000
LGBM Regr.,LGBM Clas.,0.95,0.9703333333333334,1.0199289029795582,0.1937643264532876,0.999,2.0155442343424883,1000
LGBM Regr.,Logistic,0.9,0.9066666666666666,0.40149436064143407,0.09408161185194555,0.999,0.9449920639738041,1000
LGBM Regr.,Logistic,0.95,0.947,0.4784100384127144,0.09408161185194555,0.997,0.9432948190496762,1000
Linear,LGBM Clas.,0.9,0.916,0.8565340550805809,0.19475726876642258,1.0,2.0099798454237723,1000
Linear,LGBM Clas.,0.95,0.9683333333333334,1.0206232773437618,0.19475726876642258,1.0,2.012306077187581,1000
Linear,Logistic,0.9,0.9096666666666666,0.4187055393390181,0.09576110520986783,0.998,0.9871284997732542,1000
Linear,Logistic,0.95,0.9573333333333334,0.49891842276133763,0.09576110520986783,0.998,0.9832531417484586,1000
Linear,RF Clas.,0.9,0.912,0.4432050057206287,0.10020711620099187,0.998,1.0443477449082788,1000
Linear,RF Clas.,0.95,0.96,0.528111337536011,0.10020711620099187,0.998,1.043185424691669,1000
RF Regr.,Logistic,0.9,0.909,0.40204415185082115,0.09401292200323333,0.997,0.9441304263307014,1000
RF Regr.,Logistic,0.95,0.9513333333333334,0.4790651550454403,0.09401292200323333,0.998,0.9459424215336382,1000
RF Regr.,RF Clas.,0.9,0.9106666666666666,0.4240128937078121,0.09786079181797877,0.999,0.999003996144668,1000
RF Regr.,RF Clas.,0.95,0.9546666666666667,0.5052425255541841,0.09786079181797877,0.999,0.9978199943917729,1000
LGBM Regr.,LGBM Clas.,0.9,0.9316666666666666,0.8516665340271318,0.18876885372193195,0.976,1.235416006109316,1000
LGBM Regr.,LGBM Clas.,0.95,0.974,1.0148232682715677,0.18876885372193195,0.978,1.2363372368457708,1000
LGBM Regr.,Logistic,0.9,0.8963333333333334,0.4011207089115166,0.09622891248905781,0.954,0.581494549570086,1000
LGBM Regr.,Logistic,0.95,0.9493333333333334,0.4779648049150952,0.09622891248905781,0.949,0.5819196362731412,1000
Linear,LGBM Clas.,0.9,0.9193333333333333,0.8481044621699061,0.19329879265724492,0.977,1.2287570108017074,1000
Linear,LGBM Clas.,0.95,0.964,1.0105787978602732,0.19329879265724492,0.975,1.2296874709801973,1000
Linear,Logistic,0.9,0.9086666666666666,0.4183697818472865,0.09777377454884399,0.962,0.6070331766204055,1000
Linear,Logistic,0.95,0.9553333333333334,0.49851834303354264,0.09777377454884399,0.96,0.6068276743757652,1000
Linear,RF Clas.,0.9,0.925,0.4422779976144137,0.10012118051553687,0.969,0.6410400697342276,1000
Linear,RF Clas.,0.95,0.9653333333333334,0.5270067392472711,0.10012118051553687,0.969,0.6415102210915807,1000
RF Regr.,Logistic,0.9,0.9043333333333333,0.40049417560179035,0.09567597070460675,0.954,0.5810929242816404,1000
RF Regr.,Logistic,0.95,0.958,0.4772182444296774,0.09567597070460675,0.951,0.5806745585458496,1000
RF Regr.,RF Clas.,0.9,0.907,0.42244192294607386,0.09976716996906283,0.957,0.6130114238150348,1000
RF Regr.,RF Clas.,0.95,0.9553333333333334,0.5033705984335449,0.09976716996906283,0.955,0.6129727415565359,1000
2 changes: 1 addition & 1 deletion results/irm/irm_gate_metadata.csv
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
DoubleML Version,Script,Date,Total Runtime (minutes),Python Version,Config File
0.12.dev0,IRMGATECoverageSimulation,2025-12-04 18:30,81.06913734674454,3.12.3,scripts/irm/irm_gate_config.yml
0.11.5.dev55,IRMGATECoverageSimulation,2026-08-10 11:53,80.16719218492509,3.12.3,scripts/irm/irm_gate_config.yml
24 changes: 12 additions & 12 deletions results/plm/lplr_ate_coverage.csv
Original file line number Diff line number Diff line change
@@ -1,13 +1,13 @@
Learner m,Learner M,Learner t,Score,level,Coverage,CI Length,Bias,repetition
LGBM Regr.,LGBM Clas.,LGBM Regr.,instrument,0.9,0.9,0.6534565055513932,0.16336115980855923,500
LGBM Regr.,LGBM Clas.,LGBM Regr.,instrument,0.95,0.956,0.7786414519557212,0.16336115980855923,500
LGBM Regr.,LGBM Clas.,LGBM Regr.,nuisance_space,0.9,0.9,0.587173331700569,0.14523265588039966,500
LGBM Regr.,LGBM Clas.,LGBM Regr.,nuisance_space,0.95,0.948,0.6996601788503451,0.14523265588039966,500
LassoCV,Logistic,LassoCV,instrument,0.9,0.85,0.5909860504305657,0.16604923608569636,500
LassoCV,Logistic,LassoCV,instrument,0.95,0.92,0.7042033134317637,0.16604923608569636,500
LassoCV,Logistic,LassoCV,nuisance_space,0.9,0.872,0.5743427245911767,0.1561191992391632,500
LassoCV,Logistic,LassoCV,nuisance_space,0.95,0.934,0.6843715674978567,0.1561191992391632,500
RF Regr.,RF Clas.,RF Regr.,instrument,0.9,0.896,0.3948609235155087,0.09705489730756603,500
RF Regr.,RF Clas.,RF Regr.,instrument,0.95,0.95,0.4705058105546887,0.09705489730756603,500
RF Regr.,RF Clas.,RF Regr.,nuisance_space,0.9,0.892,0.38159441513135645,0.09629310976419707,500
RF Regr.,RF Clas.,RF Regr.,nuisance_space,0.95,0.936,0.4546977907968892,0.09629310976419707,500
LGBM Regr.,LGBM Clas.,LGBM Regr.,instrument,0.9,0.91,0.6531602206391924,0.16427181512445194,500
LGBM Regr.,LGBM Clas.,LGBM Regr.,instrument,0.95,0.956,0.7782884067074626,0.16427181512445194,500
LGBM Regr.,LGBM Clas.,LGBM Regr.,nuisance_space,0.9,0.894,0.5816668331124476,0.14592012010132824,500
LGBM Regr.,LGBM Clas.,LGBM Regr.,nuisance_space,0.95,0.944,0.6930987810841251,0.14592012010132824,500
LassoCV,Logistic,LassoCV,instrument,0.9,0.84,0.589697149264332,0.1650792519980431,500
LassoCV,Logistic,LassoCV,instrument,0.95,0.916,0.7026674929647888,0.1650792519980431,500
LassoCV,Logistic,LassoCV,nuisance_space,0.9,0.87,0.5711754628763093,0.15108878564194908,500
LassoCV,Logistic,LassoCV,nuisance_space,0.95,0.93,0.6805975423876357,0.15108878564194908,500
RF Regr.,RF Clas.,RF Regr.,instrument,0.9,0.9,0.39259843344394596,0.09684519332319126,500
RF Regr.,RF Clas.,RF Regr.,instrument,0.95,0.932,0.46780988735338774,0.09684519332319126,500
RF Regr.,RF Clas.,RF Regr.,nuisance_space,0.9,0.882,0.3796710466184269,0.09722576191179358,500
RF Regr.,RF Clas.,RF Regr.,nuisance_space,0.95,0.934,0.45240595585633764,0.09722576191179358,500
Loading