Benchmarks for dotnet/runtime#132951 (for @EgorBo)

[EgorBot]

Processing benchmark request from issue dotnet/runtime#132951.

Benchmark: ASP.NET Core minimal API (requests/sec)
Targets: ubuntu24_azure_turin, ubuntu24_azure_cobalt100, ubuntu24_aws_graviton5
Commits: 61f59a1a75419872ba05379a140290cd4177dbb3;61f59a1a75419872ba05379a140290cd4177dbb3~1

• ubuntu24_azure_turin: live logs
• ubuntu24_azure_cobalt100: live logs
• ubuntu24_aws_graviton5: live logs

Results will be posted here once they are ready.

[EgorBot]

Results for ubuntu24_aws_graviton5

@EgorBo

ASP.NET Core minimal API -- throughput (requests/sec, higher is better)

Runtime	RPS	StdDev	Noise (CV)	Min .. Max	Ratio	Median latency (p50 / p90 / p99)
61f59a1a	171,072	665	0.4%	170,004 .. 171,840	baseline	0.19 ms / 0.30 ms / 0.36 ms
61f59a1a~1	171,165	783	0.5%	169,904 .. 172,073	1.001 (+0.1%)	0.19 ms / 0.31 ms / 0.35 ms

RPS is the mean of 6 measured intervals per runtime; Noise (CV) is their coefficient of variation.

Configuration and per-interval results

• Fixed POST /api/customers/{customerId}/quotes: route + float, DateTimeOffset and string query parameters + header + nested JSON body
• System.Text.Json source-generated metadata contracts with reflection serialization disabled; JSON response includes calculated quote data
• linux-arm64, net11.0, self-contained
• 8 core(s) visible -- app pinned to 0,1,2,3,4,5,6, bombardier pinned to 7
• 32 connections, 30s warmup, 2 process(es) x 3 x 15s measured
• DOTNET_HillClimbing_Disable=1, DOTNET_gcServer=1

Runtime	Process	Interval	RPS	p50	p90	p99	non-2xx
61f59a1a	1	1	171,028	0.19	0.30	0.36	0
61f59a1a	1	2	171,714	0.19	0.30	0.36	0
61f59a1a	1	3	171,840	0.19	0.30	0.35	0
61f59a1a	2	1	170,004	0.19	0.30	0.36	0
61f59a1a	2	2	170,812	0.19	0.30	0.36	0
61f59a1a	2	3	171,036	0.19	0.30	0.36	0
61f59a1a~1	1	1	170,596	0.19	0.31	0.35	0
61f59a1a~1	1	2	172,073	0.19	0.31	0.35	0
61f59a1a~1	1	3	171,547	0.19	0.31	0.35	0
61f59a1a~1	2	1	171,294	0.19	0.31	0.35	0
61f59a1a~1	2	2	171,575	0.19	0.31	0.35	0
61f59a1a~1	2	3	169,904	0.19	0.31	0.35	0

Runtime assemblies come from each commit's Core_Root, which is not ReadyToRun-compiled. Compare rows from this job; do not compare its absolute RPS with released-runtime measurements.

Profiling artifacts

Supported perf events on this machine: perf_events.txt

MinimalApi:

	61f59a1a75419872ba05379a140290cd4177dbb3	61f59a1a75419872ba05379a140290cd4177dbb3~1
flamegraph	link	link
functions	link	link
asm	link	link
stats	link	link
speedscope	link	link

Full logs

[EgorBot]

Results for ubuntu24_azure_turin

@EgorBo

ASP.NET Core minimal API -- throughput (requests/sec, higher is better)

Runtime	RPS	StdDev	Noise (CV)	Min .. Max	Ratio	Median latency (p50 / p90 / p99)
61f59a1a	84,468	724	0.9%	83,500 .. 85,445	baseline	0.37 ms / 0.66 ms / 0.80 ms
61f59a1a~1	80,759	500	0.6%	79,976 .. 81,272	0.956 (-4.4%)	0.39 ms / 0.69 ms / 0.81 ms

RPS is the mean of 6 measured intervals per runtime; Noise (CV) is their coefficient of variation.

Configuration and per-interval results

• Fixed POST /api/customers/{customerId}/quotes: route + float, DateTimeOffset and string query parameters + header + nested JSON body
• System.Text.Json source-generated metadata contracts with reflection serialization disabled; JSON response includes calculated quote data
• linux-x64, net11.0, self-contained
• 8 core(s) visible -- app pinned to 0,1,2,3,4,5,6, bombardier pinned to 7
• 32 connections, 30s warmup, 2 process(es) x 3 x 15s measured
• DOTNET_HillClimbing_Disable=1, DOTNET_gcServer=1

Runtime	Process	Interval	RPS	p50	p90	p99	non-2xx
61f59a1a	1	1	84,249	0.37	0.66	0.80	0
61f59a1a	1	2	85,016	0.37	0.66	0.80	0
61f59a1a	1	3	85,445	0.37	0.65	0.80	0
61f59a1a	2	1	83,500	0.38	0.67	0.81	0
61f59a1a	2	2	84,703	0.37	0.66	0.80	0
61f59a1a	2	3	83,895	0.37	0.66	0.81	0
61f59a1a~1	1	1	80,419	0.39	0.69	0.82	0
61f59a1a~1	1	2	79,976	0.39	0.70	0.82	0
61f59a1a~1	1	3	80,662	0.39	0.69	0.81	0
61f59a1a~1	2	1	81,085	0.39	0.69	0.81	0
61f59a1a~1	2	2	81,272	0.39	0.69	0.80	0
61f59a1a~1	2	3	81,140	0.39	0.69	0.81	0

Runtime assemblies come from each commit's Core_Root, which is not ReadyToRun-compiled. Compare rows from this job; do not compare its absolute RPS with released-runtime measurements.

Profiling artifacts

Supported perf events on this machine: perf_events.txt

MinimalApi:

	61f59a1a75419872ba05379a140290cd4177dbb3	61f59a1a75419872ba05379a140290cd4177dbb3~1
flamegraph	link	link
functions	link	link
asm	link	link
stats	link	link
speedscope	link	link

Full logs

[EgorBot]

ubuntu24_azure_cobalt100 — Failed

@EgorBo

Cancelled by admin.

Job | Full logs