Skip to content

Emit the files of each checker in a deterministic order - #64922

Open
Mateusz Burzyński (Andarist) wants to merge 1 commit into
microsoft:mainfrom
Andarist:emit-grouped-by-checker
Open

Emit the files of each checker in a deterministic order#64922
Mateusz Burzyński (Andarist) wants to merge 1 commit into
microsoft:mainfrom
Andarist:emit-grouped-by-checker

Conversation

@Andarist

@Andarist Mateusz Burzyński (Andarist) commented Oct 22, 2026

Copy link
Copy Markdown
Contributor

I found this extra source of non-determinism when working on #64916

@typescript-automation typescript-automation Bot added the For Uncommitted Bug PR for untriaged, rejected, closed or missing bug label Oct 22, 2026
@jakebailey

Jake Bailey (jakebailey) commented Oct 22, 2026

Copy link
Copy Markdown
Member

TypeScript Bot (@typescript-bot) perf test this faster

@typescript-automation

typescript-automation Bot commented Oct 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
perf test this faster ✅ Started 👀 Results

@typescript-automation

typescript-automation Bot commented Oct 22, 2026

Copy link
Copy Markdown
Contributor

Jake Bailey (@jakebailey)
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-Unions - native
Errors 41 41 ~ ~ ~ p=1.000 n=12
Symbols 115,276 115,276 ~ ~ ~ p=1.000 n=12
Types 79,613 79,613 ~ ~ ~ p=1.000 n=12
Memory Used 113,510k (± 0.05%) 117,047k (± 0.06%) +3,536k (+ 3.12%) 116,901k 117,245k p=0.000 n=12
Memory Allocs 2,212,346 (± 0.01%) 2,212,182 (± 0.00%) ~ 2,211,849 2,212,396 p=0.089 n=12
Config Time 0.000s 0.000s ~ ~ ~ p=1.000 n=12
Parse Time 0.040s (± 4.52%) 0.040s (± 3.36%) ~ 0.036s 0.044s p=0.633 n=12
Bind Time 0.014s (± 9.33%) 0.014s (± 9.48%) ~ 0.011s 0.018s p=0.647 n=12
Check Time 0.465s (± 0.76%) 0.463s (± 0.73%) ~ 0.455s 0.473s p=0.558 n=12
Emit Time 0.269s (± 1.40%) 0.257s (± 0.84%) 🟩-0.012s (- 4.31%) 0.250s 0.263s p=0.000 n=12
Total Time 0.794s (± 0.91%) 0.781s (± 0.60%) -0.013s (- 1.66%) 0.772s 0.801s p=0.000 n=12
angular-1 - native
Errors 3 3 ~ ~ ~ p=1.000 n=12
Symbols 846,992 (± 0.08%) 843,171 -3,821 (- 0.45%) ~ ~ p=0.000 n=12
Types 247,032 (± 0.00%) 247,030 -2 (- 0.00%) ~ ~ p=0.001 n=12
Memory Used 596,191k (± 0.03%) 596,998k (± 0.01%) +807k (+ 0.14%) 596,808k 597,157k p=0.000 n=12
Memory Allocs 13,130,165 (± 0.03%) 13,129,661 (± 0.04%) ~ 13,121,471 13,149,735 p=0.378 n=12
Config Time 0.017s (± 1.70%) 0.017s (± 1.70%) ~ 0.016s 0.017s p=1.000 n=12
Parse Time 0.221s (± 2.85%) 0.221s (± 2.07%) ~ 0.207s 0.234s p=0.921 n=12
Bind Time 0.081s (±15.50%) 0.087s (±13.91%) ~ 0.056s 0.111s p=0.468 n=12
Check Time 0s 0s ~ ~ ~ p=1.000 n=12
Emit Time 1.560s (± 1.46%) 1.285s (± 1.50%) 🟩-0.276s (-17.67%) 1.262s 1.361s p=0.000 n=12
Total Time 1.896s (± 1.20%) 1.629s (± 0.65%) 🟩-0.266s (-14.05%) 1.609s 1.669s p=0.000 n=12
arktype - native
Errors 0 0 ~ ~ ~ p=1.000 n=12
Symbols 1,757,463 1,757,463 ~ ~ ~ p=1.000 n=12
Types 943,966 943,966 ~ ~ ~ p=1.000 n=12
Memory Used 703,611k (± 0.01%) 703,562k (± 0.01%) ~ 703,348k 703,727k p=0.378 n=12
Memory Allocs 13,289,399 (± 0.01%) 13,289,574 (± 0.02%) ~ 13,286,465 13,301,026 p=0.932 n=12
Config Time 0.002s 0.002s ~ ~ ~ p=1.000 n=12
Parse Time 0.071s (± 3.38%) 0.069s (± 3.75%) ~ 0.063s 0.076s p=0.152 n=12
Bind Time 0.022s (±15.44%) 0.020s (±10.69%) ~ 0.018s 0.031s p=0.390 n=12
Check Time 2.047s (± 0.54%) 2.054s (± 0.56%) ~ 2.030s 2.093s p=0.401 n=12
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=12
Total Time 2.188s (± 0.44%) 2.186s (± 0.60%) ~ 2.161s 2.232s p=0.541 n=12
mui-docs - native
Errors 11,405 11,405 ~ ~ ~ p=1.000 n=12
Symbols 4,331,983 4,331,983 ~ ~ ~ p=1.000 n=12
Types 1,370,520 1,370,520 ~ ~ ~ p=1.000 n=12
Memory Used 2,625,205k (± 0.05%) 2,625,292k (± 0.05%) ~ 2,621,407k 2,629,293k p=0.843 n=12
Memory Allocs 27,687,950 (± 0.07%) 27,682,889 (± 0.06%) ~ 27,648,948 27,718,553 p=0.630 n=12
Config Time 0.017s (± 1.07%) 0.017s (± 1.70%) ~ 0.016s 0.017s p=0.590 n=12
Parse Time 0.478s (± 1.87%) 0.471s (± 2.21%) ~ 0.444s 0.494s p=0.246 n=12
Bind Time 0.002s (± 9.47%) 0.002s (±24.21%) ~ 0.002s 0.005s p=0.522 n=12
Check Time 7.159s (± 0.70%) 7.160s (± 0.52%) ~ 7.110s 7.273s p=0.744 n=12
Emit Time 0.574s (±10.23%) 0.552s (±12.07%) ~ 0.415s 0.657s p=1.000 n=12
Total Time 8.981s (± 0.40%) 8.959s (± 0.43%) ~ 8.839s 9.042s p=0.385 n=12
sentry - native
Errors 2 2 ~ ~ ~ p=1.000 n=12
Symbols 7,459,653 7,459,653 ~ ~ ~ p=1.000 n=12
Types 2,647,172 2,647,172 ~ ~ ~ p=1.000 n=12
Memory Used 3,802,601k (± 0.02%) 3,802,575k (± 0.02%) ~ 3,800,783k 3,804,832k p=0.755 n=12
Memory Allocs 77,176,309 (± 0.07%) 77,135,330 (± 0.09%) ~ 76,960,801 77,324,284 p=0.378 n=12
Config Time 0.061s (± 0.53%) 0.060s (± 0.54%) ~ 0.060s 0.061s p=0.684 n=12
Parse Time 1.029s (± 2.70%) 1.018s (± 3.20%) ~ 0.940s 1.118s p=0.541 n=12
Bind Time 0.297s (±10.32%) 0.320s (±11.34%) ~ 0.262s 0.470s p=0.284 n=12
Check Time 14.802s (± 0.72%) 14.756s (± 0.45%) ~ 14.567s 14.963s p=0.855 n=12
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=12
Total Time 16.263s (± 0.67%) 16.230s (± 0.51%) ~ 16.098s 16.536s p=0.799 n=12
social-app - native
Errors 0 0 ~ ~ ~ p=1.000 n=12
Symbols 2,568,629 2,568,629 ~ ~ ~ p=1.000 n=12
Types 1,163,035 1,163,035 ~ ~ ~ p=1.000 n=12
Memory Used 1,212,877k (± 0.01%) 1,212,768k (± 0.01%) ~ 1,212,487k 1,213,124k p=0.160 n=12
Memory Allocs 13,971,235 (± 0.09%) 13,992,197 (± 0.20%) ~ 13,934,623 14,083,108 p=0.143 n=12
Config Time 0.017s 0.017s (± 1.06%) ~ 0.017s 0.018s p=1.000 n=12
Parse Time 0.350s (± 1.33%) 0.357s (± 2.31%) ~ 0.334s 0.385s p=0.137 n=12
Bind Time 0.082s (±10.21%) 0.079s (± 8.82%) ~ 0.071s 0.104s p=0.191 n=12
Check Time 3.592s (± 0.29%) 3.598s (± 0.31%) ~ 3.563s 3.630s p=0.629 n=12
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=12
Total Time 4.065s (± 0.36%) 4.073s (± 0.38%) ~ 4.035s 4.122s p=0.600 n=12
strada-build-src - native
Errors 0 0 ~ ~ ~ p=1.000 n=12
Symbols 1,388,680 1,388,680 ~ ~ ~ p=1.000 n=12
Types 441,862 441,862 ~ ~ ~ p=1.000 n=12
Memory Used 1,308,366k (± 0.75%) 1,322,757k (± 0.41%) +14,391k (+ 1.10%) 1,309,709k 1,334,624k p=0.017 n=12
Memory Allocs 78,061,232 (± 0.13%) 78,132,244 (± 0.10%) ~ 77,815,578 78,286,056 p=0.291 n=12
Config Time 0.005s (± 7.30%) 0.004s (±12.60%) ~ 0.002s 0.005s p=0.480 n=12
Parse Time 0.307s (± 1.92%) 0.314s (± 2.62%) ~ 0.295s 0.332s p=0.116 n=12
Bind Time 0.000s (±217.90%) 0.000s (±217.90%) ~ 0.000s 0.003s p=1.000 n=12
Check Time 1.998s (± 0.41%) 1.996s (± 0.50%) ~ 1.960s 2.023s p=0.900 n=12
Emit Time 0.350s (± 4.08%) 0.362s (± 2.90%) ~ 0.322s 0.381s p=0.117 n=12
Total Time 23.703s (± 0.89%) 23.842s (± 0.45%) ~ 23.551s 24.133s p=0.291 n=12
strada-compiler - native
Errors 0 0 ~ ~ ~ p=1.000 n=12
Symbols 334,953 334,953 ~ ~ ~ p=1.000 n=12
Types 197,616 197,616 ~ ~ ~ p=1.000 n=12
Memory Used 247,401k (± 0.02%) 247,432k (± 0.03%) ~ 247,239k 247,599k p=0.478 n=12
Memory Allocs 4,325,814 (± 0.01%) 4,326,991 (± 0.00%) +1,177 (+ 0.03%) 4,326,368 4,327,465 p=0.000 n=12
Config Time 0.001s 0.001s ~ ~ ~ p=1.000 n=12
Parse Time 0.115s (± 4.61%) 0.111s (± 4.00%) ~ 0.102s 0.124s p=0.310 n=12
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=12
Check Time 0.956s (± 0.66%) 0.958s (± 0.70%) ~ 0.945s 0.980s p=0.898 n=12
Emit Time 0.151s (± 5.15%) 0.154s (± 4.65%) ~ 0.131s 0.169s p=0.619 n=12
Total Time 1.276s (± 0.67%) 1.279s (± 0.73%) ~ 1.256s 1.299s p=0.660 n=12
t3code-server - native
Errors 0 0 ~ ~ ~ p=1.000 n=12
Symbols 11,588,087 11,588,087 ~ ~ ~ p=1.000 n=12
Types 3,062,556 3,062,556 ~ ~ ~ p=1.000 n=12
Memory Used 3,945,918k (± 0.01%) 3,946,169k (± 0.02%) ~ 3,944,542k 3,950,128k p=0.887 n=12
Memory Allocs 41,550,815 (± 0.06%) 41,550,799 (± 0.06%) ~ 41,496,345 41,640,210 p=0.977 n=12
Config Time 0.006s 0.006s ~ ~ ~ p=1.000 n=12
Parse Time 0.585s (± 2.13%) 0.587s (± 1.13%) ~ 0.570s 0.607s p=0.876 n=12
Bind Time 0.166s (± 7.39%) 0.154s (± 2.70%) 🟩-0.012s (- 7.17%) 0.147s 0.173s p=0.024 n=12
Check Time 18.605s (± 0.24%) 18.521s (± 0.22%) -0.084s (- 0.45%) 18.436s 18.674s p=0.006 n=12
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=12
Total Time 19.380s (± 0.23%) 19.284s (± 0.22%) -0.096s (- 0.49%) 19.208s 19.430s p=0.004 n=12
ts-pre-modules - native
Errors 87 87 ~ ~ ~ p=1.000 n=12
Symbols 303,834 303,834 ~ ~ ~ p=1.000 n=12
Types 181,663 181,663 ~ ~ ~ p=1.000 n=12
Memory Used 215,169k (± 0.02%) 215,195k (± 0.03%) ~ 214,994k 215,354k p=0.541 n=12
Memory Allocs 1,400,765 (± 0.01%) 1,400,803 (± 0.02%) ~ 1,400,199 1,401,569 p=0.899 n=12
Config Time 0.000s (±217.90%) 0.000s (±217.90%) ~ 0.000s 0.001s p=1.000 n=12
Parse Time 0.093s (± 3.77%) 0.098s (± 4.73%) ~ 0.090s 0.110s p=0.095 n=12
Bind Time 0.039s (±12.25%) 0.041s (± 8.49%) ~ 0.036s 0.054s p=0.202 n=12
Check Time 0.741s (± 1.06%) 0.739s (± 0.85%) ~ 0.721s 0.752s p=0.417 n=12
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=12
Total Time 0.887s (± 0.67%) 0.892s (± 0.80%) ~ 0.873s 0.907s p=0.297 n=12
vscode - native
Errors 10 10 ~ ~ ~ p=1.000 n=12
Symbols 13,153,245 13,153,245 ~ ~ ~ p=1.000 n=12
Types 4,277,428 4,277,428 ~ ~ ~ p=1.000 n=12
Memory Used 6,122,620k (± 0.01%) 6,121,816k (± 0.01%) ~ 6,119,998k 6,123,747k p=0.242 n=12
Memory Allocs 62,303,119 (± 0.01%) 62,302,821 (± 0.01%) ~ 62,296,884 62,315,601 p=0.671 n=12
Config Time 0.078s (± 0.31%) 0.078s (± 0.34%) ~ 0.077s 0.079s p=0.627 n=12
Parse Time 1.919s (± 1.59%) 1.932s (± 2.50%) ~ 1.839s 2.043s p=0.810 n=12
Bind Time 0.675s (± 9.95%) 0.685s (±14.55%) ~ 0.544s 0.968s p=0.681 n=12
Check Time 15.873s (± 1.10%) 15.736s (± 1.30%) ~ 15.286s 16.043s p=0.076 n=12
Emit Time 5.272s (± 5.11%) 4.716s (± 9.77%) ~ 3.882s 5.707s p=0.068 n=12
Total Time 23.903s (± 0.66%) 23.232s (± 1.37%) -0.671s (- 2.81%) 22.661s 23.975s p=0.007 n=12
webpack - native
Errors 600 600 ~ ~ ~ p=1.000 n=12
Symbols 1,347,151 1,347,151 ~ ~ ~ p=1.000 n=12
Types 648,706 648,706 ~ ~ ~ p=1.000 n=12
Memory Used 855,044k (± 0.02%) 855,069k (± 0.02%) ~ 854,660k 855,623k p=0.921 n=12
Memory Allocs 6,761,788 (± 0.05%) 6,761,456 (± 0.02%) ~ 6,759,555 6,766,281 p=0.319 n=12
Config Time 0.008s (± 4.04%) 0.008s (± 4.38%) ~ 0.007s 0.008s p=0.680 n=12
Parse Time 0.245s (± 2.74%) 0.246s (± 1.95%) ~ 0.232s 0.257s p=0.943 n=12
Bind Time 0.069s (±14.78%) 0.064s (±12.69%) ~ 0.055s 0.102s p=0.483 n=12
Check Time 2.514s (± 0.28%) 2.518s (± 0.25%) ~ 2.492s 2.534s p=0.384 n=12
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=12
Total Time 2.868s (± 0.20%) 2.868s (± 0.28%) ~ 2.845s 2.887s p=0.943 n=12
xstate-main - native
Errors 0 0 ~ ~ ~ p=1.000 n=12
Symbols 1,060,810 1,060,810 ~ ~ ~ p=1.000 n=12
Types 389,671 389,671 ~ ~ ~ p=1.000 n=12
Memory Used 471,760k (± 0.03%) 471,787k (± 0.03%) ~ 471,482k 472,270k p=0.713 n=12
Memory Allocs 4,217,054 (± 0.07%) 4,213,305 (± 0.09%) ~ 4,203,398 4,225,823 p=0.089 n=12
Config Time 0.003s 0.003s ~ ~ ~ p=1.000 n=12
Parse Time 0.134s (± 2.91%) 0.131s (± 2.95%) ~ 0.122s 0.144s p=0.163 n=12
Bind Time 0.044s (±18.61%) 0.046s (±17.42%) ~ 0.033s 0.068s p=0.598 n=12
Check Time 1.088s (± 1.02%) 1.082s (± 0.73%) ~ 1.062s 1.105s p=0.541 n=12
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=12
Total Time 1.275s (± 0.90%) 1.268s (± 0.76%) ~ 1.245s 1.290s p=0.259 n=12
System info unknown
Hosts
  • native
Scenarios
  • Compiler-Unions - native
  • angular-1 - native
  • arktype - native
  • mui-docs - native
  • sentry - native
  • social-app - native
  • strada-build-src - native
  • strada-compiler - native
  • t3code-server - native
  • ts-pre-modules - native
  • vscode - native
  • webpack - native
  • xstate-main - native
Benchmark Name Iterations
Current pr 12
Baseline baseline 12

Developer Information:

Download Benchmarks

@jakebailey

Jake Bailey (jakebailey) commented Oct 28, 2026

Copy link
Copy Markdown
Member

TypeScript Bot (@typescript-bot) perf test this faster

(benchmarks got updated)

@typescript-automation

typescript-automation Bot commented Oct 28, 2026

Copy link
Copy Markdown
Contributor

Hey Jake Bailey (@jakebailey), this PR was updated less than two minutes before this command. Please wait until it has been unchanged for two minutes and try again.

@jakebailey

Jake Bailey (jakebailey) commented Oct 28, 2026

Copy link
Copy Markdown
Member

TypeScript Bot (@typescript-bot) perf test this faster

@typescript-automation

typescript-automation Bot commented Oct 28, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
perf test this faster ✅ Started 👀 Results

@typescript-automation

typescript-automation Bot commented Oct 28, 2026

Copy link
Copy Markdown
Contributor

Jake Bailey (@jakebailey)
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-Unions - native
Errors 41 41 ~ ~ ~ p=1.000 n=20
Symbols 88,466 88,466 ~ ~ ~ p=1.000 n=20
Types 79,607 79,607 ~ ~ ~ p=1.000 n=20
Memory Used 104,148k (± 0.02%) 107,716k (± 0.02%) +3,568k (+ 3.43%) 107,659k 107,804k p=0.000 n=20
Memory Allocs 2,200,859 (± 0.00%) 2,200,936 (± 0.00%) ~ 2,200,693 2,201,434 p=0.239 n=20
Config Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Parse Time 0.026s (±13.19%) 0.025s (± 5.60%) ~ 0.021s 0.036s p=0.633 n=20
Bind Time 0.009s (± 4.47%) 0.009s (± 5.99%) ~ 0.008s 0.012s p=0.589 n=20
Check Time 0.228s (± 0.76%) 0.229s (± 0.76%) ~ 0.223s 0.238s p=0.846 n=20
Emit Time 0.158s (± 4.13%) 0.154s (± 1.82%) ~ 0.147s 0.173s p=0.063 n=20
Total Time 0.425s (± 1.71%) 0.419s (± 0.80%) ~ 0.409s 0.441s p=0.150 n=20
angular-1 - native
Errors 3 3 ~ ~ ~ p=1.000 n=20
Symbols 586,591 (± 0.01%) 586,553 -38 (- 0.01%) ~ ~ p=0.003 n=20
Types 241,688 (± 0.00%) 241,685 -3 (- 0.00%) ~ ~ p=0.000 n=20
Memory Used 517,968k (± 0.03%) 518,987k (± 0.02%) +1,019k (+ 0.20%) 518,493k 519,313k p=0.000 n=20
Memory Allocs 13,117,280 (± 0.04%) 13,122,612 (± 0.06%) ~ 13,106,918 13,155,207 p=0.678 n=20
Config Time 0.009s 0.009s ~ ~ ~ p=1.000 n=20
Parse Time 0.136s (± 4.84%) 0.134s (± 3.51%) ~ 0.119s 0.156s p=0.920 n=20
Bind Time 0.043s (± 7.27%) 0.043s (± 9.77%) ~ 0.038s 0.067s p=0.461 n=20
Check Time 0s 0s ~ ~ ~ p=1.000 n=20
Emit Time 0.917s (± 0.80%) 0.743s (± 1.01%) 🟩-0.175s (-19.06%) 0.711s 0.764s p=0.000 n=20
Total Time 1.119s (± 0.91%) 0.940s (± 0.72%) 🟩-0.180s (-16.06%) 0.914s 0.966s p=0.000 n=20
arktype - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 685,920 685,920 ~ ~ ~ p=1.000 n=20
Types 939,467 939,467 ~ ~ ~ p=1.000 n=20
Memory Used 497,274k (± 0.01%) 497,275k (± 0.01%) ~ 497,078k 497,500k p=0.931 n=20
Memory Allocs 12,806,149 (± 0.01%) 12,806,418 (± 0.02%) ~ 12,801,235 12,814,440 p=0.799 n=20
Config Time 0.001s 0.001s ~ ~ ~ p=1.000 n=20
Parse Time 0.043s (± 4.00%) 0.043s (± 2.47%) ~ 0.040s 0.050s p=0.405 n=20
Bind Time 0.013s (± 7.39%) 0.013s (± 6.75%) ~ 0.011s 0.019s p=0.587 n=20
Check Time 1.002s (± 1.04%) 1.003s (± 1.05%) ~ 0.968s 1.045s p=0.846 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 1.089s (± 0.90%) 1.089s (± 0.90%) ~ 1.058s 1.131s p=0.973 n=20
class-transformer - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 45,376 45,376 ~ ~ ~ p=1.000 n=20
Types 7,573 7,573 ~ ~ ~ p=1.000 n=20
Memory Used 27,840k (± 0.03%) 27,836k (± 0.02%) ~ 27,816k 27,856k p=0.606 n=20
Memory Allocs 323,484 (± 0.04%) 323,475 (± 0.04%) ~ 322,877 324,140 p=0.883 n=20
Config Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Parse Time 0.013s (± 4.36%) 0.013s (± 3.55%) ~ 0.011s 0.015s p=0.769 n=20
Bind Time 0.004s (±10.90%) 0.004s (±17.63%) ~ 0.003s 0.008s p=0.684 n=20
Check Time 0.010s (± 6.03%) 0.010s (± 5.78%) ~ 0.008s 0.012s p=0.718 n=20
Emit Time 0.011s (± 4.07%) 0.010s (± 6.51%) 🟩-0.001s (-11.79%) 0.008s 0.012s p=0.002 n=20
Total Time 0.039s (± 1.80%) 0.038s (± 2.25%) ~ 0.035s 0.041s p=0.231 n=20
effect - native
Errors 12 12 ~ ~ ~ p=1.000 n=20
Symbols 1,235,115 1,235,115 ~ ~ ~ p=1.000 n=20
Types 894,113 894,113 ~ ~ ~ p=1.000 n=20
Memory Used 940,497k (± 0.02%) 951,038k (± 0.02%) +10,540k (+ 1.12%) 950,138k 951,906k p=0.000 n=20
Memory Allocs 15,751,705 (± 0.01%) 15,753,585 (± 0.02%) ~ 15,746,938 15,764,123 p=0.429 n=20
Config Time 0.002s (± 5.09%) 0.002s (±11.58%) ~ 0.002s 0.004s p=0.155 n=20
Parse Time 0.189s (± 3.89%) 0.186s (± 3.75%) ~ 0.163s 0.220s p=0.433 n=20
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Check Time 1.112s (± 2.13%) 1.102s (± 2.12%) ~ 1.037s 1.211s p=0.410 n=20
Emit Time 0.642s (± 2.97%) 0.594s (± 2.54%) 🟩-0.048s (- 7.55%) 0.543s 0.675s p=0.000 n=20
Total Time 2.057s (± 1.67%) 1.992s (± 1.79%) 🟩-0.065s (- 3.15%) 1.858s 2.131s p=0.009 n=20
mui-docs - native
Errors 11,405 11,405 ~ ~ ~ p=1.000 n=20
Symbols 3,784,019 3,784,019 ~ ~ ~ p=1.000 n=20
Types 1,355,974 1,355,974 ~ ~ ~ p=1.000 n=20
Memory Used 1,836,438k (± 0.07%) 1,836,248k (± 0.06%) ~ 1,832,324k 1,840,734k p=0.799 n=20
Memory Allocs 26,736,628 (± 0.04%) 26,734,928 (± 0.05%) ~ 26,668,210 26,807,214 p=0.989 n=20
Config Time 0.008s (± 1.30%) 0.008s ~ ~ ~ p=1.000 n=20
Parse Time 0.285s (± 2.24%) 0.289s (± 1.90%) ~ 0.267s 0.310s p=0.298 n=20
Bind Time 0.001s 0.001s ~ ~ ~ p=1.000 n=20
Check Time 3.248s (± 0.53%) 3.240s (± 0.51%) ~ 3.197s 3.310s p=0.465 n=20
Emit Time 0.246s (± 1.05%) 0.248s (± 1.62%) ~ 0.237s 0.276s p=0.515 n=20
Total Time 4.274s (± 0.59%) 4.270s (± 0.68%) ~ 4.215s 4.496s p=0.588 n=20
sentry - native
Errors 2 2 ~ ~ ~ p=1.000 n=20
Symbols 4,793,245 4,793,245 ~ ~ ~ p=1.000 n=20
Types 2,607,047 2,607,047 ~ ~ ~ p=1.000 n=20
Memory Used 2,880,837k (± 0.03%) 2,881,095k (± 0.03%) ~ 2,878,432k 2,884,675k p=0.779 n=20
Memory Allocs 75,932,869 (± 0.05%) 75,989,026 (± 0.12%) ~ 75,679,127 76,696,945 p=0.192 n=20
Config Time 0.026s (± 0.94%) 0.025s (± 1.50%) ~ 0.025s 0.028s p=0.096 n=20
Parse Time 0.466s (± 1.84%) 0.494s (± 5.75%) ~ 0.442s 0.716s p=0.068 n=20
Bind Time 0.159s (± 9.95%) 0.144s (± 8.88%) ~ 0.120s 0.214s p=0.114 n=20
Check Time 6.935s (± 0.57%) 7.014s (± 0.67%) +0.078s (+ 1.13%) 6.866s 7.266s p=0.012 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 7.639s (± 0.43%) 7.724s (± 0.62%) +0.086s (+ 1.12%) 7.603s 7.989s p=0.003 n=20
social-app - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 1,883,074 1,883,074 ~ ~ ~ p=1.000 n=20
Types 1,158,170 1,158,170 ~ ~ ~ p=1.000 n=20
Memory Used 972,381k (± 0.01%) 972,431k (± 0.01%) ~ 972,008k 972,831k p=0.542 n=20
Memory Allocs 13,715,116 (± 0.14%) 13,709,884 (± 0.11%) ~ 13,665,160 13,773,059 p=0.799 n=20
Config Time 0.008s 0.008s ~ ~ ~ p=1.000 n=20
Parse Time 0.165s (± 3.89%) 0.159s (± 1.80%) ~ 0.149s 0.171s p=0.193 n=20
Bind Time 0.044s (±10.73%) 0.049s (±11.74%) ~ 0.036s 0.068s p=0.523 n=20
Check Time 1.603s (± 0.61%) 1.602s (± 0.51%) ~ 1.556s 1.637s p=0.763 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 1.838s (± 0.73%) 1.836s (± 0.53%) ~ 1.778s 1.872s p=0.774 n=20
strada-build-src - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 1,184,972 1,184,972 ~ ~ ~ p=1.000 n=20
Types 438,963 438,963 ~ ~ ~ p=1.000 n=20
Memory Used 1,172,809k (± 0.23%) 1,170,699k (± 0.22%) ~ 1,159,777k 1,182,747k p=0.289 n=20
Memory Allocs 77,420,098 (± 0.11%) 77,542,945 (± 0.12%) +122,847 (+ 0.16%) 77,116,542 77,776,185 p=0.033 n=20
Config Time 0.002s (±15.95%) 0.002s (±16.60%) ~ 0.001s 0.003s p=0.332 n=20
Parse Time 0.147s (± 2.46%) 0.145s (± 1.36%) ~ 0.137s 0.153s p=0.051 n=20
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Check Time 0.835s (± 0.44%) 0.834s (± 0.35%) ~ 0.823s 0.842s p=0.733 n=20
Emit Time 0.177s (± 2.11%) 0.177s (± 1.24%) ~ 0.170s 0.185s p=0.931 n=20
Total Time 10.144s (± 0.44%) 10.110s (± 0.32%) ~ 9.965s 10.228s p=0.224 n=20
strada-compiler - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 263,511 263,511 ~ ~ ~ p=1.000 n=20
Types 196,116 196,116 ~ ~ ~ p=1.000 n=20
Memory Used 224,604k (± 0.02%) 224,581k (± 0.02%) ~ 224,430k 224,712k p=0.533 n=20
Memory Allocs 4,304,716 (± 0.01%) 4,305,595 (± 0.01%) +879 (+ 0.02%) 4,304,762 4,306,939 p=0.000 n=20
Config Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Parse Time 0.060s (±10.17%) 0.056s (± 3.35%) ~ 0.051s 0.063s p=0.296 n=20
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Check Time 0.420s (± 3.01%) 0.424s (± 3.28%) ~ 0.389s 0.464s p=0.542 n=20
Emit Time 0.078s (± 2.93%) 0.079s (± 2.40%) ~ 0.072s 0.089s p=0.952 n=20
Total Time 0.588s (± 2.86%) 0.589s (± 2.59%) ~ 0.548s 0.641s p=0.973 n=20
t3code-server - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 4,350,661 4,350,661 ~ ~ ~ p=1.000 n=20
Types 3,040,647 3,040,647 ~ ~ ~ p=1.000 n=20
Memory Used 2,433,432k (± 0.03%) 2,433,728k (± 0.03%) ~ 2,431,268k 2,437,140k p=0.738 n=20
Memory Allocs 37,882,597 (± 0.05%) 37,889,664 (± 0.05%) ~ 37,836,085 37,986,930 p=0.758 n=20
Config Time 0.002s (± 9.72%) 0.002s (± 9.77%) ~ 0.002s 0.003s p=1.000 n=20
Parse Time 0.264s (± 2.42%) 0.259s (± 2.17%) ~ 0.241s 0.277s p=0.262 n=20
Bind Time 0.084s (± 7.18%) 0.090s (±10.31%) ~ 0.078s 0.141s p=0.071 n=20
Check Time 7.676s (± 0.38%) 7.722s (± 0.61%) ~ 7.570s 7.930s p=0.155 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 8.039s (± 0.39%) 8.086s (± 0.54%) ~ 7.963s 8.301s p=0.122 n=20
tanstack-router - native
Errors 1 1 ~ ~ ~ p=1.000 n=20
Symbols 571,756 571,756 ~ ~ ~ p=1.000 n=20
Types 397,689 397,689 ~ ~ ~ p=1.000 n=20
Memory Used 331,420k (± 0.01%) 331,426k (± 0.01%) ~ 331,259k 331,622k p=0.925 n=20
Memory Allocs 5,094,013 (± 0.07%) 5,095,400 (± 0.09%) ~ 5,085,568 5,126,200 p=0.925 n=20
Config Time 0.001s 0.001s ~ ~ ~ p=1.000 n=20
Parse Time 0.046s (± 3.15%) 0.047s (± 3.69%) ~ 0.040s 0.053s p=0.335 n=20
Bind Time 0.013s (± 7.07%) 0.015s (±14.03%) ~ 0.012s 0.027s p=0.362 n=20
Check Time 0.631s (± 1.94%) 0.629s (± 1.76%) ~ 0.594s 0.678s p=0.878 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 0.720s (± 1.95%) 0.717s (± 1.44%) ~ 0.680s 0.757s p=0.931 n=20
ts-pre-modules - native
Errors 87 87 ~ ~ ~ p=1.000 n=20
Symbols 231,616 231,616 ~ ~ ~ p=1.000 n=20
Types 181,195 181,195 ~ ~ ~ p=1.000 n=20
Memory Used 193,517k (± 0.01%) 193,549k (± 0.01%) ~ 193,477k 193,633k p=0.059 n=20
Memory Allocs 1,373,299 (± 0.02%) 1,373,317 (± 0.01%) ~ 1,372,898 1,373,774 p=0.311 n=20
Config Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Parse Time 0.047s (± 2.78%) 0.046s (± 2.83%) ~ 0.041s 0.051s p=0.711 n=20
Bind Time 0.021s (± 5.18%) 0.022s (± 5.76%) ~ 0.018s 0.026s p=0.495 n=20
Check Time 0.317s (± 1.20%) 0.317s (± 1.78%) ~ 0.300s 0.347s p=0.846 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 0.392s (± 0.92%) 0.392s (± 1.54%) ~ 0.375s 0.427s p=0.578 n=20
vscode - native
Errors 11 11 ~ ~ ~ p=1.000 n=20
Symbols 7,387,991 7,387,991 ~ ~ ~ p=1.000 n=20
Types 4,346,718 4,346,718 ~ ~ ~ p=1.000 n=20
Memory Used 5,141,297k (± 0.01%) 5,140,816k (± 0.02%) ~ 5,138,070k 5,143,436k p=0.383 n=20
Memory Allocs 64,879,522 (± 0.01%) 64,882,966 (± 0.02%) ~ 64,866,018 65,007,981 p=0.758 n=20
Config Time 0.038s (± 2.29%) 0.037s (± 1.99%) ~ 0.035s 0.042s p=0.575 n=20
Parse Time 0.974s (± 2.41%) 0.966s (± 2.76%) ~ 0.866s 1.149s p=0.473 n=20
Bind Time 0.318s (± 2.36%) 0.329s (± 6.01%) ~ 0.299s 0.460s p=0.909 n=20
Check Time 8.266s (± 1.30%) 8.188s (± 1.48%) ~ 7.877s 8.727s p=0.265 n=20
Emit Time 2.956s (± 2.62%) 2.296s (± 4.87%) 🟩-0.660s (-22.32%) 2.080s 2.940s p=0.000 n=20
Total Time 12.612s (± 1.14%) 11.878s (± 1.57%) 🟩-0.734s (- 5.82%) 11.382s 12.572s p=0.000 n=20
webpack - native
Errors 619 619 ~ ~ ~ p=1.000 n=20
Symbols 917,280 917,280 ~ ~ ~ p=1.000 n=20
Types 632,992 632,992 ~ ~ ~ p=1.000 n=20
Memory Used 690,276k (± 0.01%) 690,435k (± 0.02%) +159k (+ 0.02%) 690,085k 690,800k p=0.024 n=20
Memory Allocs 6,604,478 (± 0.02%) 6,606,066 (± 0.05%) ~ 6,598,973 6,632,488 p=0.738 n=20
Config Time 0.004s 0.004s ~ ~ ~ p=1.000 n=20
Parse Time 0.154s (± 3.78%) 0.155s (± 3.92%) ~ 0.137s 0.183s p=0.899 n=20
Bind Time 0.051s (± 9.66%) 0.054s (± 9.75%) ~ 0.043s 0.079s p=0.197 n=20
Check Time 1.271s (± 1.45%) 1.282s (± 1.70%) ~ 1.213s 1.393s p=0.358 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 1.506s (± 1.41%) 1.519s (± 1.45%) ~ 1.438s 1.644s p=0.337 n=20
xstate-main - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 640,490 640,490 ~ ~ ~ p=1.000 n=20
Types 387,988 387,988 ~ ~ ~ p=1.000 n=20
Memory Used 350,934k (± 0.02%) 350,888k (± 0.02%) ~ 350,594k 351,145k p=0.774 n=20
Memory Allocs 4,065,846 (± 0.08%) 4,066,325 (± 0.08%) ~ 4,053,532 4,080,125 p=0.910 n=20
Config Time 0.001s 0.001s ~ ~ ~ p=1.000 n=20
Parse Time 0.063s (± 2.65%) 0.063s (± 2.63%) ~ 0.058s 0.070s p=0.549 n=20
Bind Time 0.021s (± 9.70%) 0.020s (±10.43%) ~ 0.017s 0.032s p=0.693 n=20
Check Time 0.416s (± 0.70%) 0.420s (± 0.94%) ~ 0.409s 0.439s p=0.202 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 0.506s (± 0.79%) 0.510s (± 0.98%) ~ 0.497s 0.531s p=0.213 n=20
System info unknown
Hosts
  • native
Scenarios
  • Compiler-Unions - native
  • angular-1 - native
  • arktype - native
  • class-transformer - native
  • effect - native
  • mui-docs - native
  • sentry - native
  • social-app - native
  • strada-build-src - native
  • strada-compiler - native
  • t3code-server - native
  • tanstack-router - native
  • ts-pre-modules - native
  • vscode - native
  • webpack - native
  • xstate-main - native
Benchmark Name Iterations
Current pr 20
Baseline baseline 20

Developer Information:

Download Benchmarks

@jakebailey
Jake Bailey (jakebailey) requested a balanced review from Copilot October 28, 2026 22:18
Copilot AI reviewed Oct 28, 2026
View reviewed changes

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Approval recommended

No active review issues remain for the changes that order checker-dependent transformations while preserving parallel printing.

No open issues 🎉

What changed in this PR

This PR removes a source of nondeterminism in the native compiler’s emit pipeline, complementing the symbol-table ordering work in #64916. Files sharing a checker are transformed in a fixed order, while printing remains parallel.

Changes:

  • Group files by checker and transform each group in reverse program order, matching single-threaded emit scheduling.
  • Separate checker-dependent transformation from printing and writing output.
  • Add a shared-checker regression test with JavaScript, declaration, type, and symbol baselines.
File Description
tsc/​testdata/​tests/​cases/​compiler/​noFlakyDeclarationEmitSharedCheckerOrder.ts Adds a single-checker declaration-emit regression with circular module references.
tsc/​testdata/​baselines/​reference/​compiler/​noFlakyDeclarationEmitSharedCheckerOrder.types Records expected inferred types.
tsc/​testdata/​baselines/​reference/​compiler/​noFlakyDeclarationEmitSharedCheckerOrder.symbols Records expected symbol bindings.
tsc/​testdata/​baselines/​reference/​compiler/​noFlakyDeclarationEmitSharedCheckerOrder.js Records expected JavaScript and declaration output.
tsc/​internal/​compiler/​program.go Schedules ordered transformations per checker and separate printing tasks.
tsc/​internal/​compiler/​emitter.go Splits transformation from deferred printing.
tsc/​internal/​compiler/​checkerpool.go Groups file indices by checker while preserving input order.

Review effort: Balanced

@Andarist
Mateusz Burzyński (Andarist) marked this pull request as ready for review October 29, 2026 05:56
@typescript-automation

typescript-automation Bot commented Oct 29, 2026

Copy link
Copy Markdown
Contributor

This PR doesn't have any linked issues. Please open an issue that references this PR. From there we can discuss and prioritise.

@Andarist Mateusz Burzyński (Andarist) mentioned this pull request Oct 29, 2026
Open
@jakebailey

Jake Bailey (jakebailey) commented Oct 29, 2026

Copy link
Copy Markdown
Member

TypeScript Bot (@typescript-bot) perf test this faster

I like to be sure

@typescript-automation

typescript-automation Bot commented Oct 29, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
perf test this faster ✅ Started 👀 Results

@typescript-automation

typescript-automation Bot commented Oct 29, 2026

Copy link
Copy Markdown
Contributor

Jake Bailey (@jakebailey)
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-Unions - native
Errors 41 41 ~ ~ ~ p=1.000 n=20
Symbols 88,466 88,466 ~ ~ ~ p=1.000 n=20
Types 79,607 79,607 ~ ~ ~ p=1.000 n=20
Memory Used 104,155k (± 0.02%) 107,742k (± 0.03%) +3,588k (+ 3.44%) 107,632k 107,890k p=0.000 n=20
Memory Allocs 2,200,850 (± 0.01%) 2,200,836 (± 0.00%) ~ 2,200,281 2,201,075 p=0.654 n=20
Config Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Parse Time 0.028s (±10.57%) 0.027s (± 3.04%) ~ 0.024s 0.031s p=0.920 n=20
Bind Time 0.011s (± 6.65%) 0.011s (± 5.68%) ~ 0.009s 0.013s p=0.836 n=20
Check Time 0.263s (± 3.04%) 0.263s (± 2.25%) ~ 0.247s 0.297s p=0.899 n=20
Emit Time 0.179s (± 1.41%) 0.174s (± 2.81%) -0.005s (- 2.63%) 0.166s 0.214s p=0.001 n=20
Total Time 0.484s (± 2.21%) 0.478s (± 1.81%) ~ 0.457s 0.519s p=0.245 n=20
angular-1 - native
Errors 3 3 ~ ~ ~ p=1.000 n=20
Symbols 586,516 (± 0.02%) 586,553 ~ ~ ~ p=0.254 n=20
Types 241,688 (± 0.00%) 241,685 -3 (- 0.00%) ~ ~ p=0.000 n=20
Memory Used 517,942k (± 0.02%) 518,994k (± 0.02%) +1,052k (+ 0.20%) 518,654k 519,424k p=0.000 n=20
Memory Allocs 13,116,898 (± 0.04%) 13,113,107 (± 0.02%) ~ 13,107,213 13,123,056 p=0.081 n=20
Config Time 0.009s (± 3.42%) 0.009s (± 3.42%) ~ 0.009s 0.012s p=1.000 n=20
Parse Time 0.135s (± 3.94%) 0.132s (± 2.54%) ~ 0.123s 0.149s p=0.239 n=20
Bind Time 0.044s (± 5.89%) 0.046s (± 9.91%) ~ 0.040s 0.076s p=0.781 n=20
Check Time 0s 0s ~ ~ ~ p=1.000 n=20
Emit Time 0.953s (± 1.05%) 0.756s (± 1.00%) 🟩-0.198s (-20.72%) 0.726s 0.778s p=0.000 n=20
Total Time 1.153s (± 0.95%) 0.953s (± 0.86%) 🟩-0.200s (-17.33%) 0.913s 0.988s p=0.000 n=20
arktype - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 685,920 685,920 ~ ~ ~ p=1.000 n=20
Types 939,467 939,467 ~ ~ ~ p=1.000 n=20
Memory Used 497,328k (± 0.01%) 497,283k (± 0.01%) ~ 497,118k 497,527k p=0.180 n=20
Memory Allocs 12,806,370 (± 0.02%) 12,805,464 (± 0.01%) ~ 12,801,212 12,812,975 p=0.495 n=20
Config Time 0.001s (± 9.93%) 0.001s ~ ~ ~ p=1.000 n=20
Parse Time 0.044s (± 3.15%) 0.043s (± 3.46%) ~ 0.037s 0.051s p=0.793 n=20
Bind Time 0.013s (± 7.40%) 0.013s (± 6.30%) ~ 0.011s 0.017s p=0.271 n=20
Check Time 1.004s (± 1.77%) 0.997s (± 1.02%) ~ 0.961s 1.029s p=0.973 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 1.091s (± 1.65%) 1.085s (± 0.81%) ~ 1.058s 1.115s p=0.846 n=20
class-transformer - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 45,376 45,376 ~ ~ ~ p=1.000 n=20
Types 7,573 7,573 ~ ~ ~ p=1.000 n=20
Memory Used 27,839k (± 0.02%) 27,836k (± 0.02%) ~ 27,818k 27,855k p=0.350 n=20
Memory Allocs 323,435 (± 0.04%) 323,465 (± 0.04%) ~ 323,050 324,018 p=0.779 n=20
Config Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Parse Time 0.012s (± 3.64%) 0.012s (± 3.99%) ~ 0.010s 0.014s p=0.815 n=20
Bind Time 0.003s (±14.35%) 0.003s (±10.09%) ~ 0.002s 0.005s p=0.218 n=20
Check Time 0.009s (± 5.77%) 0.009s (± 5.96%) ~ 0.007s 0.011s p=0.604 n=20
Emit Time 0.010s (± 4.78%) 0.009s (± 5.91%) 🟩-0.001s (- 7.65%) 0.008s 0.012s p=0.023 n=20
Total Time 0.035s (± 1.60%) 0.034s (± 3.04%) ~ 0.029s 0.039s p=0.270 n=20
effect - native
Errors 12 12 ~ ~ ~ p=1.000 n=20
Symbols 1,235,115 1,235,115 ~ ~ ~ p=1.000 n=20
Types 894,113 894,113 ~ ~ ~ p=1.000 n=20
Memory Used 940,569k (± 0.02%) 951,066k (± 0.02%) +10,498k (+ 1.12%) 950,361k 951,806k p=0.000 n=20
Memory Allocs 15,751,578 (± 0.01%) 15,754,072 (± 0.02%) ~ 15,746,168 15,769,162 p=0.081 n=20
Config Time 0.002s 0.002s (± 6.84%) ~ 0.002s 0.003s p=0.487 n=20
Parse Time 0.158s (± 1.35%) 0.159s (± 1.88%) ~ 0.150s 0.169s p=0.568 n=20
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Check Time 0.969s (± 0.84%) 0.976s (± 0.80%) ~ 0.946s 1.004s p=0.176 n=20
Emit Time 0.523s (± 1.79%) 0.512s (± 1.22%) -0.012s (- 2.23%) 0.487s 0.538s p=0.047 n=20
Total Time 1.747s (± 0.64%) 1.743s (± 0.42%) ~ 1.718s 1.777s p=0.482 n=20
mui-docs - native
Errors 11,405 11,405 ~ ~ ~ p=1.000 n=20
Symbols 3,784,019 3,784,019 ~ ~ ~ p=1.000 n=20
Types 1,355,974 1,355,974 ~ ~ ~ p=1.000 n=20
Memory Used 1,835,563k (± 0.06%) 1,835,162k (± 0.07%) ~ 1,830,367k 1,839,691k p=0.495 n=20
Memory Allocs 26,737,928 (± 0.07%) 26,728,271 (± 0.06%) ~ 26,667,234 26,778,648 p=0.799 n=20
Config Time 0.009s (± 2.78%) 0.009s (± 2.78%) ~ 0.008s 0.009s p=1.000 n=20
Parse Time 0.298s (± 1.94%) 0.302s (± 3.88%) ~ 0.263s 0.376s p=0.952 n=20
Bind Time 0.001s 0.001s ~ ~ ~ p=1.000 n=20
Check Time 3.472s (± 2.10%) 3.419s (± 1.72%) ~ 3.217s 3.786s p=0.365 n=20
Emit Time 0.262s (± 1.84%) 0.258s (± 1.59%) ~ 0.237s 0.271s p=0.291 n=20
Total Time 4.542s (± 1.81%) 4.490s (± 1.58%) ~ 4.236s 4.909s p=0.331 n=20
sentry - native
Errors 2 2 ~ ~ ~ p=1.000 n=20
Symbols 4,793,245 4,793,245 ~ ~ ~ p=1.000 n=20
Types 2,607,047 2,607,047 ~ ~ ~ p=1.000 n=20
Memory Used 2,881,694k (± 0.05%) 2,881,142k (± 0.04%) ~ 2,878,460k 2,885,943k p=0.738 n=20
Memory Allocs 76,002,222 (± 0.10%) 75,976,544 (± 0.06%) ~ 75,819,719 76,227,230 p=0.620 n=20
Config Time 0.025s (± 1.51%) 0.025s (± 0.76%) ~ 0.025s 0.026s p=0.603 n=20
Parse Time 0.469s (± 2.52%) 0.472s (± 2.04%) ~ 0.443s 0.523s p=0.457 n=20
Bind Time 0.174s (± 8.49%) 0.153s (± 8.54%) ~ 0.131s 0.210s p=0.073 n=20
Check Time 6.854s (± 0.76%) 6.900s (± 0.61%) ~ 6.759s 7.133s p=0.059 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 7.580s (± 0.69%) 7.603s (± 0.51%) ~ 7.458s 7.861s p=0.147 n=20
social-app - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 1,883,074 1,883,074 ~ ~ ~ p=1.000 n=20
Types 1,158,170 1,158,170 ~ ~ ~ p=1.000 n=20
Memory Used 972,391k (± 0.01%) 972,416k (± 0.01%) ~ 972,083k 972,800k p=0.551 n=20
Memory Allocs 13,714,234 (± 0.20%) 13,699,181 (± 0.11%) ~ 13,660,892 13,760,340 p=0.602 n=20
Config Time 0.008s (± 3.08%) 0.008s (± 3.19%) ~ 0.007s 0.008s p=0.751 n=20
Parse Time 0.179s (± 4.11%) 0.176s (± 5.73%) ~ 0.143s 0.222s p=0.569 n=20
Bind Time 0.043s (± 7.40%) 0.043s (± 7.71%) ~ 0.035s 0.064s p=0.931 n=20
Check Time 1.646s (± 2.18%) 1.648s (± 2.31%) ~ 1.535s 1.792s p=0.904 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 1.895s (± 2.23%) 1.896s (± 2.36%) ~ 1.751s 2.069s p=0.973 n=20
strada-build-src - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 1,184,972 1,184,972 ~ ~ ~ p=1.000 n=20
Types 438,963 438,963 ~ ~ ~ p=1.000 n=20
Memory Used 1,173,438k (± 0.17%) 1,172,794k (± 0.22%) ~ 1,160,643k 1,182,922k p=0.820 n=20
Memory Allocs 77,477,124 (± 0.11%) 77,500,892 (± 0.09%) ~ 77,210,454 77,717,659 p=0.640 n=20
Config Time 0.002s (±14.80%) 0.002s (± 9.43%) ~ 0.001s 0.003s p=0.455 n=20
Parse Time 0.149s (± 2.12%) 0.151s (± 2.73%) ~ 0.141s 0.180s p=0.472 n=20
Bind Time 0.000s 0.000s (±208.60%) ~ 0.000s 0.003s p=1.000 n=20
Check Time 0.863s (± 2.19%) 0.851s (± 1.54%) ~ 0.827s 0.932s p=0.180 n=20
Emit Time 0.183s (± 1.81%) 0.181s (± 1.55%) ~ 0.169s 0.193s p=0.524 n=20
Total Time 10.457s (± 2.10%) 10.342s (± 1.62%) ~ 10.064s 11.357s p=0.174 n=20
strada-compiler - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 263,511 263,511 ~ ~ ~ p=1.000 n=20
Types 196,116 196,116 ~ ~ ~ p=1.000 n=20
Memory Used 224,600k (± 0.02%) 224,579k (± 0.02%) ~ 224,410k 224,690k p=0.815 n=20
Memory Allocs 4,304,611 (± 0.01%) 4,305,423 (± 0.01%) +813 (+ 0.02%) 4,304,215 4,306,322 p=0.000 n=20
Config Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Parse Time 0.055s (± 3.16%) 0.054s (± 3.77%) ~ 0.048s 0.062s p=0.633 n=20
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Check Time 0.397s (± 0.75%) 0.398s (± 0.62%) ~ 0.388s 0.406s p=0.559 n=20
Emit Time 0.079s (± 2.21%) 0.079s (± 2.67%) ~ 0.070s 0.086s p=0.540 n=20
Total Time 0.560s (± 0.60%) 0.559s (± 0.45%) ~ 0.551s 0.573s p=0.634 n=20
t3code-server - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 4,350,661 4,350,661 ~ ~ ~ p=1.000 n=20
Types 3,040,647 3,040,647 ~ ~ ~ p=1.000 n=20
Memory Used 2,433,730k (± 0.04%) 2,433,390k (± 0.02%) ~ 2,431,606k 2,435,262k p=0.904 n=20
Memory Allocs 37,879,603 (± 0.03%) 37,889,213 (± 0.04%) ~ 37,833,325 37,962,811 p=0.301 n=20
Config Time 0.003s (± 7.54%) 0.003s (± 7.54%) ~ 0.002s 0.003s p=1.000 n=20
Parse Time 0.259s (± 1.62%) 0.260s (± 2.04%) ~ 0.244s 0.281s p=0.753 n=20
Bind Time 0.087s (± 8.59%) 0.084s (± 7.76%) ~ 0.076s 0.129s p=0.190 n=20
Check Time 7.626s (± 0.61%) 7.652s (± 0.58%) ~ 7.535s 7.861s p=0.387 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 7.986s (± 0.57%) 8.010s (± 0.54%) ~ 7.907s 8.228s p=0.358 n=20
tanstack-router - native
Errors 1 1 ~ ~ ~ p=1.000 n=20
Symbols 571,756 571,756 ~ ~ ~ p=1.000 n=20
Types 397,689 397,689 ~ ~ ~ p=1.000 n=20
Memory Used 331,431k (± 0.01%) 331,413k (± 0.01%) ~ 331,261k 331,563k p=0.516 n=20
Memory Allocs 5,095,544 (± 0.07%) 5,100,375 (± 0.25%) ~ 5,087,250 5,211,461 p=0.654 n=20
Config Time 0.001s 0.001s ~ ~ ~ p=1.000 n=20
Parse Time 0.043s (± 3.51%) 0.043s (± 8.81%) ~ 0.034s 0.075s p=0.231 n=20
Bind Time 0.014s (±12.46%) 0.016s (±13.89%) ~ 0.011s 0.026s p=0.178 n=20
Check Time 0.607s (± 1.84%) 0.602s (± 0.89%) ~ 0.582s 0.635s p=0.473 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 0.690s (± 1.79%) 0.685s (± 1.10%) ~ 0.668s 0.726s p=0.317 n=20
ts-pre-modules - native
Errors 87 87 ~ ~ ~ p=1.000 n=20
Symbols 231,616 231,616 ~ ~ ~ p=1.000 n=20
Types 181,195 181,195 ~ ~ ~ p=1.000 n=20
Memory Used 193,570k (± 0.01%) 193,551k (± 0.02%) ~ 193,418k 193,671k p=0.387 n=20
Memory Allocs 1,373,406 (± 0.01%) 1,373,192 (± 0.01%) ~ 1,372,582 1,374,178 p=0.163 n=20
Config Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Parse Time 0.046s (± 3.45%) 0.046s (± 2.95%) ~ 0.041s 0.051s p=0.671 n=20
Bind Time 0.021s (± 4.65%) 0.020s (± 4.95%) ~ 0.017s 0.028s p=0.395 n=20
Check Time 0.305s (± 1.30%) 0.305s (± 0.94%) ~ 0.293s 0.312s p=0.888 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 0.378s (± 0.91%) 0.377s (± 0.84%) ~ 0.364s 0.390s p=0.941 n=20
vscode - native
Errors 11 11 ~ ~ ~ p=1.000 n=20
Symbols 7,414,524 7,414,524 ~ ~ ~ p=1.000 n=20
Types 4,356,679 4,356,679 ~ ~ ~ p=1.000 n=20
Memory Used 5,151,044k (± 0.02%) 5,150,237k (± 0.02%) ~ 5,147,306k 5,158,730k p=0.096 n=20
Memory Allocs 65,088,330 (± 0.02%) 65,092,963 (± 0.04%) ~ 65,071,706 65,302,557 p=0.925 n=20
Config Time 0.033s (± 1.31%) 0.033s (± 0.52%) ~ 0.033s 0.034s p=0.522 n=20
Parse Time 0.927s (± 2.11%) 0.921s (± 1.56%) ~ 0.885s 0.995s p=0.189 n=20
Bind Time 0.317s (± 7.63%) 0.309s (± 3.58%) ~ 0.293s 0.405s p=0.291 n=20
Check Time 7.467s (± 0.58%) 7.460s (± 0.41%) ~ 7.363s 7.602s p=0.441 n=20
Emit Time 2.903s (± 4.80%) 2.204s (± 3.89%) 🟩-0.698s (-24.06%) 2.096s 2.855s p=0.000 n=20
Total Time 11.707s (± 1.17%) 10.986s (± 0.78%) 🟩-0.721s (- 6.16%) 10.817s 11.627s p=0.000 n=20
webpack - native
Errors 619 619 ~ ~ ~ p=1.000 n=20
Symbols 926,331 926,331 ~ ~ ~ p=1.000 n=20
Types 646,440 646,440 ~ ~ ~ p=1.000 n=20
Memory Used 698,660k (± 0.02%) 698,571k (± 0.02%) ~ 698,128k 698,913k p=0.204 n=20
Memory Allocs 6,689,976 (± 0.03%) 6,691,479 (± 0.04%) ~ 6,686,005 6,703,489 p=0.355 n=20
Config Time 0.004s (± 2.58%) 0.004s ~ ~ ~ p=1.000 n=20
Parse Time 0.153s (± 2.77%) 0.152s (± 2.20%) ~ 0.132s 0.166s p=0.663 n=20
Bind Time 0.048s (± 7.75%) 0.049s (±10.25%) ~ 0.039s 0.074s p=0.909 n=20
Check Time 1.254s (± 0.44%) 1.259s (± 0.61%) ~ 1.236s 1.314s p=0.267 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 1.485s (± 0.78%) 1.488s (± 0.71%) ~ 1.458s 1.545s p=0.542 n=20
xstate-main - native
Errors 0 0 ~ ~ ~ p=1.000 n=20
Symbols 640,490 640,490 ~ ~ ~ p=1.000 n=20
Types 387,988 387,988 ~ ~ ~ p=1.000 n=20
Memory Used 350,972k (± 0.02%) 350,888k (± 0.02%) -84k (- 0.02%) 350,745k 351,205k p=0.042 n=20
Memory Allocs 4,067,987 (± 0.09%) 4,066,804 (± 0.07%) ~ 4,055,709 4,077,113 p=0.862 n=20
Config Time 0.001s 0.001s ~ ~ ~ p=1.000 n=20
Parse Time 0.071s (± 2.48%) 0.070s (± 2.58%) ~ 0.063s 0.075s p=0.398 n=20
Bind Time 0.021s (± 8.37%) 0.021s (± 8.94%) ~ 0.018s 0.032s p=0.671 n=20
Check Time 0.436s (± 0.71%) 0.437s (± 0.82%) ~ 0.426s 0.452s p=0.963 n=20
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=20
Total Time 0.534s (± 0.82%) 0.534s (± 0.91%) ~ 0.520s 0.556s p=0.835 n=20
System info unknown
Hosts
  • native
Scenarios
  • Compiler-Unions - native
  • angular-1 - native
  • arktype - native
  • class-transformer - native
  • effect - native
  • mui-docs - native
  • sentry - native
  • social-app - native
  • strada-build-src - native
  • strada-compiler - native
  • t3code-server - native
  • tanstack-router - native
  • ts-pre-modules - native
  • vscode - native
  • webpack - native
  • xstate-main - native
Benchmark Name Iterations
Current pr 20
Baseline baseline 20

Developer Information:

Download Benchmarks

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

Copilot code review Copilot
Copilot review effort
Applies to this pull request for everyone.Learn more about Copilot code review.
Copilot left review comments

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

For Uncommitted Bug PR for untriaged, rejected, closed or missing bug

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@Andarist @jakebailey