Skip to content

ignore me, testing build stuff - #55267

Closed
Jake Bailey (jakebailey) wants to merge 2 commits into
microsoft:mainfrom
jakebailey:noop-testing-2
Closed

Jake Bailey (jakebailey) wants to merge 2 commits into
microsoft:mainfrom
jakebailey:noop-testing-2

Conversation

@jakebailey

Copy link
Copy Markdown
Member

No description provided.

@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) pack this

@typescript-bot

TypeScript Bot (typescript-bot) commented Aug 4, 2023 •

Copy link
Copy Markdown
Contributor

Heya Jake Bailey (@jakebailey), I've started to run the tarball bundle task on this PR at 63e8eae. You can monitor the build here.

@typescript-bot

TypeScript Bot (typescript-bot) commented Aug 4, 2023 •

Copy link
Copy Markdown
Contributor

Hey Jake Bailey (@jakebailey), I've packed this into an installable tgz. You can install it for testing by referencing it in your package.json like so:

{
    "devDependencies": {
        "typescript": "https://typescript.visualstudio.com/cf7ac146-d525-443c-b23c-0d58337efebc/_apis/build/builds/156239/artifacts?artifactName=tgz&fileId=9C693591393572DE27206905AC214EF7A645084F8DDDED5392E1E9AD1EAB369502&fileName=/typescript-5.2.0-insiders.20230804.tgz"
    }
}

and then running npm install.


There is also a playground for this build and an npm module you can use via "typescript": "npm:@typescript-deploys/pr-build@5.2.0-pr-55267-2".;

@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) pack this

@typescript-bot

TypeScript Bot (typescript-bot) commented Aug 4, 2023 •

Copy link
Copy Markdown
Contributor

Heya Jake Bailey (@jakebailey), I've started to run the tarball bundle task on this PR at 63e8eae. You can monitor the build here.

@typescript-bot

TypeScript Bot (typescript-bot) commented Aug 4, 2023 •

Copy link
Copy Markdown
Contributor

Hey Jake Bailey (@jakebailey), I've packed this into an installable tgz. You can install it for testing by referencing it in your package.json like so:

{
    "devDependencies": {
        "typescript": "https://typescript.visualstudio.com/cf7ac146-d525-443c-b23c-0d58337efebc/_apis/build/builds/156240/artifacts?artifactName=tgz&fileId=9C693591393572DE27206905AC214EF7A645084F8DDDED5392E1E9AD1EAB369502&fileName=/typescript-5.2.0-insiders.20230804.tgz"
    }
}

and then running npm install.


There is also a playground for this build and an npm module you can use via "typescript": "npm:@typescript-deploys/pr-build@5.2.0-pr-55267-5".;

@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) pack this

@typescript-bot

TypeScript Bot (typescript-bot) commented Aug 4, 2023 •

Copy link
Copy Markdown
Contributor

Heya Jake Bailey (@jakebailey), I've started to run the tarball bundle task on this PR at 63e8eae. You can monitor the build here.

@typescript-bot

TypeScript Bot (typescript-bot) commented Aug 4, 2023 •

Copy link
Copy Markdown
Contributor

Hey Jake Bailey (@jakebailey), I've packed this into an installable tgz. You can install it for testing by referencing it in your package.json like so:

{
    "devDependencies": {
        "typescript": "https://typescript.visualstudio.com/cf7ac146-d525-443c-b23c-0d58337efebc/_apis/build/builds/156246/artifacts?artifactName=tgz&fileId=1C81B256BB8001203E5CD3EF144ABC97CC87E40C0F26A924F925228CFC60433002&fileName=/typescript-5.2.0-insiders.20230804.tgz"
    }
}

and then running npm install.


There is also a playground for this build and an npm module you can use via "typescript": "npm:@typescript-deploys/pr-build@5.2.0-pr-55267-8".;

@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) new perf test bun

@typescript-bot

TypeScript Bot (typescript-bot) commented Aug 30, 2023 •

Copy link
Copy Markdown
Contributor

Heya Jake Bailey (@jakebailey), I've started to run the bun perf test suite on this PR at 63e8eae. You can monitor the build here.

Update: The results are in!

@typescript-bot

Copy link
Copy Markdown
Contributor

Jake Bailey (@jakebailey)
The results of the perf run you requested are in!

Here they are:

Compiler

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Angular - bun (v0.7.3, x64)
Memory used 322,062k (± 0.30%) 322,686k (± 0.13%) ~ 322,195k 323,191k p=0.230 n=6
Parse Time 2.32s (± 1.18%) 2.33s (± 1.12%) ~ 2.31s 2.38s p=0.145 n=6
Bind Time 0.98s (± 6.25%) 0.96s (± 5.47%) ~ 0.87s 1.02s p=0.470 n=6
Check Time 7.88s (± 1.52%) 7.94s (± 2.39%) ~ 7.75s 8.17s p=0.873 n=6
Emit Time 6.43s (± 1.15%) 6.46s (± 0.76%) ~ 6.40s 6.53s p=0.873 n=6
Total Time 17.61s (± 0.69%) 17.68s (± 0.82%) ~ 17.54s 17.84s p=0.628 n=6
Compiler-Unions - bun (v0.7.3, x64)
Memory used 243,101k (± 2.27%) 243,636k (± 2.78%) ~ 240,454k 257,425k p=0.689 n=6
Parse Time 1.27s (± 1.89%) 1.26s (± 0.44%) ~ 1.25s 1.26s p=0.236 n=6
Bind Time 0.85s (± 1.73%) 0.85s (± 1.88%) ~ 0.83s 0.88s p=0.933 n=6
Check Time 8.92s (± 0.46%) 8.91s (± 0.48%) ~ 8.87s 8.98s p=0.808 n=6
Emit Time 2.75s (± 1.42%) 2.76s (± 0.99%) ~ 2.73s 2.80s p=0.936 n=6
Total Time 13.80s (± 0.59%) 13.77s (± 0.50%) ~ 13.70s 13.89s p=0.520 n=6
Monaco - bun (v0.7.3, x64)
Memory used 369,778k (± 0.25%) 370,498k (± 0.31%) ~ 369,470k 372,221k p=0.066 n=6
Parse Time 2.05s (± 0.48%) 2.06s (± 0.27%) ~ 2.05s 2.06s p=0.201 n=6
Bind Time 1.08s (± 1.48%) 1.09s (± 1.58%) ~ 1.07s 1.11s p=0.452 n=6
Check Time 7.20s (± 0.55%) 7.16s (± 0.87%) ~ 7.07s 7.24s p=0.149 n=6
Emit Time 3.80s (± 1.40%) 3.74s (± 0.55%) -0.06s (- 1.49%) 3.72s 3.77s p=0.044 n=6
Total Time 14.13s (± 0.41%) 14.04s (± 0.38%) -0.09s (- 0.66%) 13.99s 14.13s p=0.020 n=6
TFS - bun (v0.7.3, x64)
Memory used 318,031k (± 0.16%) 318,090k (± 0.47%) ~ 316,497k 320,296k p=0.936 n=6
Parse Time 1.80s (± 1.40%) 1.80s (± 1.04%) ~ 1.79s 1.84s p=0.357 n=6
Bind Time 1.00s (± 0.63%) 0.98s (± 2.69%) ~ 0.93s 1.00s p=0.070 n=6
Check Time 6.64s (± 0.54%) 6.64s (± 0.19%) ~ 6.62s 6.66s p=1.000 n=6
Emit Time 3.48s (± 1.15%) 3.46s (± 0.88%) ~ 3.42s 3.51s p=0.373 n=6
Total Time 12.92s (± 0.50%) 12.89s (± 0.24%) ~ 12.85s 12.93s p=0.376 n=6
material-ui - bun (v0.7.3, x64)
Memory used 511,825k (± 5.43%) 522,497k (± 4.24%) ~ 488,592k 537,875k p=0.689 n=6
Parse Time 2.50s (± 0.55%) 2.50s (± 2.14%) ~ 2.44s 2.59s p=0.465 n=6
Bind Time 0.71s (± 0.58%) 0.73s (± 4.86%) ~ 0.71s 0.80s p=0.056 n=6
Check Time 15.75s (± 0.28%) 15.81s (± 0.54%) ~ 15.70s 15.96s p=0.169 n=6
Emit Time 0.00s (± 0.00%) 0.01s (±154.76%) ~ 0.00s 0.02s p=0.174 n=6
Total Time 18.96s (± 0.21%) 19.04s (± 0.56%) ~ 18.94s 19.22s p=0.092 n=6
xstate - bun (v0.7.3, x64)
Memory used 407,574k (± 9.08%) 446,225k (±13.05%) ~ 358,909k 512,993k p=0.471 n=6
Parse Time 3.56s (± 0.75%) 3.59s (± 0.56%) ~ 3.57s 3.62s p=0.063 n=6
Bind Time 1.38s (± 1.77%) 1.38s (± 2.79%) ~ 1.30s 1.41s p=0.687 n=6
Check Time 3.54s (± 0.39%) 3.55s (± 1.03%) ~ 3.51s 3.60s p=0.871 n=6
Emit Time 0.21s (± 3.01%) 0.21s (± 1.96%) ~ 0.20s 0.21s p=0.673 n=6
Total Time 8.70s (± 0.40%) 8.72s (± 0.60%) ~ 8.66s 8.80s p=0.936 n=6
System info unknown
Hosts
  • bun (v0.7.3, x64)
Scenarios
  • Angular - bun (v0.7.3, x64)
  • Compiler-Unions - bun (v0.7.3, x64)
  • Monaco - bun (v0.7.3, x64)
  • TFS - bun (v0.7.3, x64)
  • material-ui - bun (v0.7.3, x64)
  • xstate - bun (v0.7.3, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Startup

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
tsc-startup - bun (v0.7.3, x64)
Execution time 425.46ms (± 0.06%) 424.89ms (± 0.11%) -0.57ms (- 0.13%) 423.67ms 433.14ms p=0.000 n=600
tsserverlibrary-startup - bun (v0.7.3, x64)
Execution time 661.73ms (± 0.15%) 661.61ms (± 0.14%) -0.12ms (- 0.02%) 659.60ms 677.41ms p=0.027 n=600
typescript-startup - bun (v0.7.3, x64)
Execution time 662.41ms (± 0.15%) 661.94ms (± 0.15%) -0.47ms (- 0.07%) 660.03ms 691.02ms p=0.000 n=600
System info unknown
Hosts
  • bun (v0.7.3, x64)
Scenarios
  • tsc-startup - bun (v0.7.3, x64)
  • tsserverlibrary-startup - bun (v0.7.3, x64)
  • typescript-startup - bun (v0.7.3, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) new perf test vscode

@typescript-bot

TypeScript Bot (typescript-bot) commented Aug 30, 2023 •

Copy link
Copy Markdown
Contributor

Heya Jake Bailey (@jakebailey), I've started to run the vscode perf test suite on this PR at 63e8eae. You can monitor the build here.

Update: The results are in!

@typescript-bot

Copy link
Copy Markdown
Contributor

Jake Bailey (@jakebailey), the perf run you requested failed. You can check the log here.

@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) perf test vscode

@typescript-bot

TypeScript Bot (typescript-bot) commented Aug 30, 2023 •

Copy link
Copy Markdown
Contributor

Heya Jake Bailey (@jakebailey), I've started to run the vscode perf test suite on this PR at 63e8eae. You can monitor the build here.

Update: The results are in!

@jakebailey Jake Bailey (jakebailey) changed the title ignore me, testing playground ignore me, testing build stuff Aug 30, 2023
@typescript-bot

Copy link
Copy Markdown
Contributor

Jake Bailey (@jakebailey)
The results of the perf run you requested are in!

Here they are:

Compiler

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Angular - vscode (1.81.1, x64)
Memory used 239,805k (± 0.82%) 239,806k (± 0.82%) ~ 235,812k 240,701k p=0.936 n=6
Parse Time 2.95s (± 0.94%) 2.96s (± 0.51%) ~ 2.94s 2.98s p=0.511 n=6
Bind Time 1.00s (± 1.03%) 1.00s (± 0.75%) ~ 0.99s 1.01s p=0.931 n=6
Check Time 7.84s (± 0.15%) 7.85s (± 0.25%) ~ 7.82s 7.87s p=0.625 n=6
Emit Time 7.20s (± 0.50%) 7.17s (± 0.42%) ~ 7.14s 7.21s p=0.195 n=6
Total Time 19.00s (± 0.29%) 18.98s (± 0.22%) ~ 18.92s 19.04s p=0.687 n=6
Compiler-Unions - vscode (1.81.1, x64)
Memory used 168,685k (± 2.27%) 168,533k (± 2.45%) ~ 160,819k 171,691k p=0.936 n=6
Parse Time 1.58s (± 1.79%) 1.57s (± 3.62%) ~ 1.48s 1.63s p=0.872 n=6
Bind Time 0.76s (± 0.99%) 0.75s (± 1.82%) ~ 0.74s 0.77s p=0.740 n=6
Check Time 8.69s (± 0.46%) 8.72s (± 0.62%) ~ 8.65s 8.81s p=0.376 n=6
Emit Time 2.60s (± 0.91%) 2.61s (± 1.07%) ~ 2.58s 2.66s p=0.418 n=6
Total Time 13.63s (± 0.45%) 13.66s (± 0.65%) ~ 13.55s 13.78s p=0.629 n=6
Monaco - vscode (1.81.1, x64)
Memory used 243,869k (± 0.19%) 246,109k (± 1.05%) ~ 243,640k 250,168k p=0.066 n=6
Parse Time 2.60s (± 1.16%) 2.64s (± 2.64%) ~ 2.58s 2.73s p=0.296 n=6
Bind Time 1.11s (± 1.23%) 1.06s (± 8.39%) ~ 0.94s 1.14s p=0.805 n=6
Check Time 6.86s (± 0.54%) 6.80s (± 0.46%) -0.06s (- 0.87%) 6.75s 6.83s p=0.023 n=6
Emit Time 3.91s (± 0.30%) 3.91s (± 0.43%) ~ 3.89s 3.94s p=0.933 n=6
Total Time 14.47s (± 0.33%) 14.41s (± 0.33%) ~ 14.34s 14.47s p=0.064 n=6
TFS - vscode (1.81.1, x64)
Memory used 196,282k (± 0.31%) 196,791k (± 0.22%) ~ 196,254k 197,224k p=0.093 n=6
Parse Time 2.08s (± 0.56%) 2.08s (± 0.90%) ~ 2.06s 2.11s p=0.807 n=6
Bind Time 1.02s (± 7.47%) 0.97s (± 7.71%) ~ 0.90s 1.04s p=0.062 n=6
Check Time 6.18s (± 1.04%) 6.22s (± 1.59%) ~ 6.12s 6.34s p=0.628 n=6
Emit Time 3.77s (± 1.80%) 3.76s (± 2.00%) ~ 3.61s 3.82s p=0.515 n=6
Total Time 13.06s (± 0.49%) 13.04s (± 0.69%) ~ 12.89s 13.16s p=0.936 n=6
material-ui - vscode (1.81.1, x64)
Memory used 303,145k (± 0.86%) 296,493k (± 4.26%) ~ 271,371k 304,638k p=0.128 n=6
Parse Time 3.22s (± 1.27%) 3.19s (± 1.39%) ~ 3.13s 3.24s p=0.418 n=6
Bind Time 0.92s (± 0.82%) 0.95s (± 5.73%) ~ 0.90s 1.02s p=0.682 n=6
Check Time 15.78s (± 0.74%) 15.81s (± 1.00%) ~ 15.63s 16.09s p=1.000 n=6
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) ~ 0.00s 0.00s p=1.000 n=6
Total Time 19.93s (± 0.73%) 19.95s (± 0.82%) ~ 19.80s 20.25s p=1.000 n=6
xstate - vscode (1.81.1, x64)
Memory used 367,863k (± 0.88%) 368,740k (± 0.67%) ~ 365,164k 371,246k p=0.810 n=6
Parse Time 3.83s (± 0.79%) 3.83s (± 0.88%) ~ 3.77s 3.87s p=0.629 n=6
Bind Time 1.34s (± 1.61%) 1.34s (± 1.33%) ~ 1.32s 1.37s p=0.745 n=6
Check Time 2.87s (± 0.58%) 2.87s (± 0.90%) ~ 2.82s 2.89s p=1.000 n=6
Emit Time 0.13s (± 3.87%) 0.14s (± 5.97%) ~ 0.13s 0.15s p=0.652 n=6
Total Time 8.18s (± 0.59%) 8.18s (± 0.39%) ~ 8.13s 8.22s p=0.872 n=6
System info unknown
Hosts
  • vscode (1.81.1, x64)
Scenarios
  • Angular - vscode (1.81.1, x64)
  • Compiler-Unions - vscode (1.81.1, x64)
  • Monaco - vscode (1.81.1, x64)
  • TFS - vscode (1.81.1, x64)
  • material-ui - vscode (1.81.1, x64)
  • xstate - vscode (1.81.1, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

tsserver

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-UnionsTSServer - vscode (1.81.1, x64)
Req 1 - updateOpen 2,488ms (± 0.43%) 2,451ms (± 0.95%) -38ms (- 1.51%) 2,423ms 2,480ms p=0.013 n=6
Req 2 - geterr 5,307ms (± 1.55%) 5,334ms (± 1.99%) ~ 5,139ms 5,415ms p=0.423 n=6
Req 3 - references 362ms (± 2.34%) 356ms (± 2.70%) ~ 337ms 363ms p=0.872 n=6
Req 4 - navto 307ms (± 4.39%) 317ms (± 3.58%) ~ 300ms 334ms p=0.229 n=6
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) ~ 1,356 1,356 p=1.000 n=6
Req 5 - completionInfo 95ms (±10.73%) 95ms (± 5.80%) ~ 90ms 102ms p=0.809 n=6
CompilerTSServer - vscode (1.81.1, x64)
Req 1 - updateOpen 2,621ms (± 0.96%) 2,625ms (± 1.44%) ~ 2,557ms 2,668ms p=0.471 n=6
Req 2 - geterr 3,871ms (± 0.55%) 3,866ms (± 0.36%) ~ 3,843ms 3,885ms p=0.748 n=6
Req 3 - references 366ms (± 2.12%) 365ms (± 2.22%) ~ 354ms 377ms p=0.873 n=6
Req 4 - navto 295ms (± 3.75%) 301ms (± 2.65%) ~ 287ms 310ms p=0.520 n=6
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) ~ 1,518 1,518 p=1.000 n=6
Req 5 - completionInfo 92ms (± 7.05%) 91ms (± 5.61%) ~ 81ms 95ms p=0.683 n=6
xstateTSServer - vscode (1.81.1, x64)
Req 1 - updateOpen 2,736ms (± 1.09%) 2,728ms (± 1.18%) ~ 2,674ms 2,757ms p=0.936 n=6
Req 2 - geterr 1,586ms (± 2.58%) 1,583ms (± 1.37%) ~ 1,565ms 1,622ms p=0.936 n=6
Req 3 - references 121ms (± 4.41%) 123ms (± 5.74%) ~ 115ms 135ms p=0.936 n=6
Req 4 - navto 381ms (± 2.79%) 376ms (± 1.58%) ~ 365ms 381ms p=0.575 n=6
Req 5 - completionInfo count 2,071 (± 0.00%) 2,071 (± 0.00%) ~ 2,071 2,071 p=1.000 n=6
Req 5 - completionInfo 364ms (± 9.38%) 361ms (± 5.19%) ~ 340ms 386ms p=0.936 n=6
System info unknown
Hosts
  • vscode (1.81.1, x64)
Scenarios
  • CompilerTSServer - vscode (1.81.1, x64)
  • Compiler-UnionsTSServer - vscode (1.81.1, x64)
  • xstateTSServer - vscode (1.81.1, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Startup

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
tsc-startup - vscode (1.81.1, x64)
Execution time 206.85ms (± 0.11%) 206.79ms (± 0.23%) -0.06ms (- 0.03%) 205.72ms 226.61ms p=0.000 n=600
tsserver-startup - vscode (1.81.1, x64)
Execution time 296.47ms (± 0.09%) 296.43ms (± 0.19%) -0.04ms (- 0.01%) 295.40ms 319.17ms p=0.000 n=600
tsserverlibrary-startup - vscode (1.81.1, x64)
Execution time 285.99ms (± 0.09%) 286.00ms (± 0.12%) ~ 284.74ms 297.62ms p=0.901 n=600
typescript-startup - vscode (1.81.1, x64)
Execution time 285.65ms (± 0.09%) 285.74ms (± 0.11%) +0.09ms (+ 0.03%) 284.58ms 295.84ms p=0.000 n=600
System info unknown
Hosts
  • vscode (1.81.1, x64)
Scenarios
  • tsc-startup - vscode (1.81.1, x64)
  • tsserver-startup - vscode (1.81.1, x64)
  • tsserverlibrary-startup - vscode (1.81.1, x64)
  • typescript-startup - vscode (1.81.1, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) perf test vscode
TypeScript Bot (@typescript-bot) perf test bun

@typescript-bot

TypeScript Bot (typescript-bot) commented Sep 7, 2023 •

Copy link
Copy Markdown
Contributor

Heya Jake Bailey (@jakebailey), I've started to run the vscode perf test suite on this PR at 63e8eae. You can monitor the build here.

Update: The results are in!

@typescript-bot

Copy link
Copy Markdown
Contributor

Jake Bailey (@jakebailey)
The results of the perf run you requested are in!

Here they are:

Compiler

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Angular - vscode (1.81.1, x64)
Memory used 233,325k (± 5.13%) 229,486k (± 9.40%) ~ 185,585k 240,549k p=0.936 n=6
Parse Time 2.96s (± 0.50%) 2.96s (± 0.97%) ~ 2.92s 3.00s p=0.460 n=6
Bind Time 1.01s (± 1.02%) 1.01s (± 0.74%) ~ 1.00s 1.02s p=0.348 n=6
Check Time 7.86s (± 0.50%) 7.87s (± 0.34%) ~ 7.84s 7.91s p=0.742 n=6
Emit Time 7.26s (± 1.51%) 7.23s (± 1.29%) ~ 7.15s 7.41s p=0.420 n=6
Total Time 19.09s (± 0.53%) 19.08s (± 0.39%) ~ 18.97s 19.18s p=0.873 n=6
Compiler-Unions - vscode (1.81.1, x64)
Memory used 168,183k (± 3.75%) 167,810k (± 2.89%) ~ 162,745k 173,293k p=1.000 n=6
Parse Time 1.59s (± 1.62%) 1.55s (± 2.79%) ~ 1.50s 1.61s p=0.076 n=6
Bind Time 0.76s (± 1.74%) 0.76s (± 1.07%) ~ 0.75s 0.77s p=0.865 n=6
Check Time 8.64s (± 0.52%) 8.67s (± 0.49%) ~ 8.59s 8.71s p=0.333 n=6
Emit Time 2.62s (± 3.56%) 2.71s (± 3.30%) +0.09s (+ 3.50%) 2.61s 2.82s p=0.036 n=6
Total Time 13.62s (± 0.70%) 13.70s (± 0.48%) ~ 13.62s 13.79s p=0.107 n=6
Monaco - vscode (1.81.1, x64)
Memory used 244,672k (± 0.75%) 246,239k (± 1.53%) ~ 243,530k 252,829k p=0.575 n=6
Parse Time 2.60s (± 1.45%) 2.63s (± 3.53%) ~ 2.56s 2.81s p=0.684 n=6
Bind Time 1.10s (± 1.70%) 1.09s (± 6.18%) ~ 0.95s 1.13s p=0.413 n=6
Check Time 6.83s (± 0.38%) 6.84s (± 0.43%) ~ 6.80s 6.88s p=0.871 n=6
Emit Time 3.92s (± 0.53%) 3.90s (± 0.51%) ~ 3.87s 3.93s p=0.195 n=6
Total Time 14.44s (± 0.24%) 14.45s (± 0.40%) ~ 14.34s 14.50s p=0.569 n=6
TFS - vscode (1.81.1, x64)
Memory used 196,895k (± 0.60%) 197,331k (± 0.81%) ~ 195,558k 199,286k p=0.936 n=6
Parse Time 2.10s (± 1.15%) 2.08s (± 0.59%) ~ 2.07s 2.10s p=0.100 n=6
Bind Time 0.98s (± 8.30%) 0.97s (± 8.09%) ~ 0.90s 1.06s p=1.000 n=6
Check Time 6.20s (± 1.24%) 6.19s (± 1.24%) ~ 6.09s 6.28s p=1.000 n=6
Emit Time 3.76s (± 2.37%) 3.76s (± 2.25%) ~ 3.59s 3.82s p=0.936 n=6
Total Time 13.04s (± 0.47%) 13.01s (± 0.62%) ~ 12.87s 13.10s p=0.575 n=6
material-ui - vscode (1.81.1, x64)
Memory used 299,848k (± 0.49%) 300,180k (± 0.83%) ~ 298,024k 304,273k p=1.000 n=6
Parse Time 3.20s (± 1.79%) 3.21s (± 1.24%) ~ 3.14s 3.24s p=0.683 n=6
Bind Time 0.94s (± 4.69%) 0.95s (± 4.84%) ~ 0.91s 1.01s p=0.871 n=6
Check Time 15.72s (± 0.56%) 15.75s (± 0.34%) ~ 15.69s 15.84s p=0.687 n=6
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) ~ 0.00s 0.00s p=1.000 n=6
Total Time 19.85s (± 0.28%) 19.91s (± 0.23%) ~ 19.85s 19.99s p=0.145 n=6
xstate - vscode (1.81.1, x64)
Memory used 366,852k (± 0.46%) 368,018k (± 0.49%) ~ 366,165k 370,179k p=0.298 n=6
Parse Time 3.83s (± 0.43%) 3.84s (± 0.77%) ~ 3.79s 3.87s p=0.221 n=6
Bind Time 1.34s (± 0.56%) 1.34s (± 1.37%) ~ 1.32s 1.37s p=0.934 n=6
Check Time 2.87s (± 1.31%) 2.88s (± 0.81%) ~ 2.83s 2.89s p=1.000 n=6
Emit Time 0.13s (± 7.74%) 0.13s (± 5.71%) ~ 0.12s 0.14s p=0.864 n=6
Total Time 8.18s (± 0.73%) 8.20s (± 0.26%) ~ 8.18s 8.23s p=0.227 n=6
System info unknown
Hosts
  • vscode (1.81.1, x64)
Scenarios
  • Angular - vscode (1.81.1, x64)
  • Compiler-Unions - vscode (1.81.1, x64)
  • Monaco - vscode (1.81.1, x64)
  • TFS - vscode (1.81.1, x64)
  • material-ui - vscode (1.81.1, x64)
  • xstate - vscode (1.81.1, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

tsserver

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-UnionsTSServer - vscode (1.81.1, x64)
Req 1 - updateOpen 2,467ms (± 0.77%) 2,487ms (± 1.38%) ~ 2,451ms 2,530ms p=0.471 n=6
Req 2 - geterr 5,327ms (± 0.97%) 5,307ms (± 1.80%) ~ 5,212ms 5,405ms p=0.810 n=6
Req 3 - references 359ms (± 1.78%) 360ms (± 0.54%) ~ 357ms 362ms p=0.809 n=6
Req 4 - navto 300ms (± 1.94%) 301ms (± 1.55%) ~ 296ms 309ms p=0.809 n=6
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) ~ 1,356 1,356 p=1.000 n=6
Req 5 - completionInfo 94ms (± 8.19%) 98ms (± 6.50%) ~ 87ms 102ms p=0.454 n=6
CompilerTSServer - vscode (1.81.1, x64)
Req 1 - updateOpen 2,610ms (± 1.55%) 2,613ms (± 1.51%) ~ 2,549ms 2,655ms p=0.810 n=6
Req 2 - geterr 3,847ms (± 0.66%) 3,857ms (± 0.93%) ~ 3,799ms 3,909ms p=0.689 n=6
Req 3 - references 364ms (± 1.08%) 370ms (± 0.78%) +5ms (+ 1.46%) 367ms 375ms p=0.043 n=6
Req 4 - navto 297ms (± 1.78%) 293ms (± 2.31%) ~ 286ms 304ms p=0.286 n=6
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) ~ 1,518 1,518 p=1.000 n=6
Req 5 - completionInfo 91ms (± 8.95%) 96ms (± 1.28%) ~ 93ms 96ms p=0.228 n=6
xstateTSServer - vscode (1.81.1, x64)
Req 1 - updateOpen 2,714ms (± 0.34%) 2,738ms (± 0.96%) +24ms (+ 0.89%) 2,707ms 2,787ms p=0.045 n=6
Req 2 - geterr 1,579ms (± 1.59%) 1,578ms (± 0.97%) ~ 1,547ms 1,590ms p=0.688 n=6
Req 3 - references 118ms (± 7.10%) 118ms (± 5.58%) ~ 107ms 127ms p=1.000 n=6
Req 4 - navto 363ms (± 4.40%) 365ms (± 1.17%) ~ 358ms 370ms p=1.000 n=6
Req 5 - completionInfo count 2,071 (± 0.00%) 2,071 (± 0.00%) ~ 2,071 2,071 p=1.000 n=6
Req 5 - completionInfo 357ms (± 6.12%) 362ms (± 8.30%) ~ 338ms 416ms p=0.873 n=6
System info unknown
Hosts
  • vscode (1.81.1, x64)
Scenarios
  • CompilerTSServer - vscode (1.81.1, x64)
  • Compiler-UnionsTSServer - vscode (1.81.1, x64)
  • xstateTSServer - vscode (1.81.1, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Startup

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
tsc-startup - vscode (1.81.1, x64)
Execution time 206.96ms (± 0.11%) 207.03ms (± 0.10%) +0.07ms (+ 0.03%) 206.14ms 209.35ms p=0.000 n=600
tsserver-startup - vscode (1.81.1, x64)
Execution time 296.57ms (± 0.10%) 296.50ms (± 0.09%) -0.07ms (- 0.03%) 295.14ms 299.54ms p=0.004 n=600
tsserverlibrary-startup - vscode (1.81.1, x64)
Execution time 286.19ms (± 0.08%) 286.19ms (± 0.08%) ~ 285.03ms 288.61ms p=0.989 n=600
typescript-startup - vscode (1.81.1, x64)
Execution time 286.07ms (± 0.08%) 286.09ms (± 0.09%) ~ 285.01ms 289.59ms p=0.717 n=600
System info unknown
Hosts
  • vscode (1.81.1, x64)
Scenarios
  • tsc-startup - vscode (1.81.1, x64)
  • tsserver-startup - vscode (1.81.1, x64)
  • tsserverlibrary-startup - vscode (1.81.1, x64)
  • typescript-startup - vscode (1.81.1, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

@jakebailey

Copy link
Copy Markdown
Member Author

checking that things worked...

TypeScript Bot (@typescript-bot) perf test vscode
TypeScript Bot (@typescript-bot) perf test bun
TypeScript Bot (@typescript-bot) perf test this faster
TypeScript Bot (@typescript-bot) perf test vscode
TypeScript Bot (@typescript-bot) perf test bun
TypeScript Bot (@typescript-bot) perf test this faster

@typescript-bot

TypeScript Bot (typescript-bot) commented Sep 7, 2023 •

Copy link
Copy Markdown
Contributor

Heya Jake Bailey (@jakebailey), I've started to run the tsc-only perf test suite on this PR at 63e8eae. You can monitor the build here.

@typescript-bot

TypeScript Bot (typescript-bot) commented Sep 7, 2023 •

Copy link
Copy Markdown
Contributor

Heya Jake Bailey (@jakebailey), I've started to run the bun perf test suite on this PR at 63e8eae. You can monitor the build here.

@typescript-bot

TypeScript Bot (typescript-bot) commented Sep 7, 2023 •

Copy link
Copy Markdown
Contributor

Heya Jake Bailey (@jakebailey), I've started to run the vscode perf test suite on this PR at 63e8eae. You can monitor the build here.

@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) perf test this faster
TypeScript Bot (@typescript-bot) perf test this bun
TypeScript Bot (@typescript-bot) perf test this vscode

@typescript-bot

TypeScript Bot (typescript-bot) commented Sep 8, 2023 •

Copy link
Copy Markdown
Contributor

Heya Jake Bailey (@jakebailey), I've started to run the vscode perf test suite on this PR at 63e8eae. You can monitor the build here.

@typescript-bot

TypeScript Bot (typescript-bot) commented Jan 29, 2025 •

Copy link
Copy Markdown
Contributor

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
pack this ✅ Started ✅ Results

@typescript-bot

TypeScript Bot (typescript-bot) commented Jan 29, 2025 •

Copy link
Copy Markdown
Contributor

Hey Jake Bailey (@jakebailey), I've packed this into an installable tgz. You can install it for testing by referencing it in your package.json like so:

{
    "devDependencies": {
        "typescript": "https://typescript.visualstudio.com/cf7ac146-d525-443c-b23c-0d58337efebc/_apis/build/builds/164675/artifacts?artifactName=tgz&fileId=6DC7313A15761814F782AD4CA9E9707C4532CB882677EB801E359F73352984B202&fileName=/typescript-5.8.0-insiders.20250129.tgz"
    }
}

and then running npm install.


There is also a playground for this build and an npm module you can use via "typescript": "npm:@typescript-deploys/pr-build@5.8.0-pr-55267-247".;

@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) user test this

@typescript-bot

TypeScript Bot (typescript-bot) commented Feb 6, 2025 •

Copy link
Copy Markdown
Contributor

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
user test this ✅ Started

@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) user test this

9 similar comments
@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) user test this

@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) user test this

@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) user test this

@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) user test this

@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) user test this

@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) user test this

@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) user test this

@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) user test this

@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) user test this

@typescript-bot

TypeScript Bot (typescript-bot) commented May 7, 2025 •

Copy link
Copy Markdown
Contributor

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
user test this ✅ Started

@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) user test this

@typescript-bot

TypeScript Bot (typescript-bot) commented Jun 25, 2025 •

Copy link
Copy Markdown
Contributor

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
user test this ✅ Started ✅ Results

@typescript-bot

Copy link
Copy Markdown
Contributor

Jake Bailey (@jakebailey) Here are the results of running the user tests with tsc comparing main and refs/pull/55267/merge:

Everything looks good!

@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) user test this

@typescript-bot

TypeScript Bot (typescript-bot) commented Jun 25, 2025 •

Copy link
Copy Markdown
Contributor

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
user test this ✅ Started ✅ Results

@typescript-bot

Copy link
Copy Markdown
Contributor

Jake Bailey (@jakebailey) Here are the results of running the user tests with tsc comparing main and refs/pull/55267/merge:

Everything looks good!

@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) pack this

@typescript-bot

TypeScript Bot (typescript-bot) commented Sep 4, 2025 •

Copy link
Copy Markdown
Contributor

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
pack this ✅ Started ✅ Results

@typescript-bot

Copy link
Copy Markdown
Contributor

Hey Jake Bailey (@jakebailey), I've packed this into an installable tgz. You can install it for testing by referencing it in your package.json like so:

{
    "devDependencies": {
        "typescript": "https://typescript.visualstudio.com/cf7ac146-d525-443c-b23c-0d58337efebc/_apis/build/builds/165989/artifacts?artifactName=tgz&fileId=48150747BD1CE1F38D9A04487AF0646FE2A0CE45B3009EBB6148F96C1069FAC402&fileName=/typescript-6.0.0-insiders.20250904.tgz"
    }
}

and then running npm install.

@jakebailey

Copy link
Copy Markdown
Member Author

TypeScript Bot (@typescript-bot) pack this

@typescript-bot

TypeScript Bot (typescript-bot) commented Sep 4, 2025 •

Copy link
Copy Markdown
Contributor

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
pack this ✅ Started ✅ Results

@typescript-bot

TypeScript Bot (typescript-bot) commented Sep 4, 2025 •

Copy link
Copy Markdown
Contributor

Hey Jake Bailey (@jakebailey), I've packed this into an installable tgz. You can install it for testing by referencing it in your package.json like so:

{
    "devDependencies": {
        "typescript": "https://typescript.visualstudio.com/cf7ac146-d525-443c-b23c-0d58337efebc/_apis/build/builds/165990/artifacts?artifactName=tgz&fileId=48150747BD1CE1F38D9A04487AF0646FE2A0CE45B3009EBB6148F96C1069FAC402&fileName=/typescript-6.0.0-insiders.20250904.tgz"
    }
}

and then running npm install.


There is also a playground for this build and an npm module you can use via "typescript": "npm:@typescript-deploys/pr-build@6.0.0-pr-55267-272".;

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants