Repository navigation
TS Server Performance Analysis Tooling #49006
Description
We have a performance suite of code where we can test out the full build time of individual projects; however, this performance suite is limited to just the compiler. It doesn't give a sense of work being done in the language service (e.g. the amount of work auto-imports might perform, or multi-project workspace loading might involve, time for find-all-reference, etc.). We need to be able to accurately measure these things.
We want to create a tool to run language service operations and report back on them to discover regressions in performance. We've done similar things on Definitely Typed, but we need other codebases to be run as well. Things to think about:
- When and how do these tests run?
- How does a person kick off these tests for a PR?
- Where can we see the results of these tests if they're kicked off manually? If they're kicked off periodically?
- Can we see time series records of the data?
- Are operations consistent, or randomly applied?
- What counts as an anomaly?
Activity
amcasey commentedon May 10, 2022
Part of
@typescript-bot perf test thisAs above
As above and maybe a dashboard like the one for tsc.
Yes, if we build out a dashboard.
Consistent - we need this to be repeatable. Random might follow later.
We'll have to see how stable it ends up being, but I'm guessing it'll be as for tsc - anything over 1% is worth digging into, but may be acceptable if we're getting something for it.
DanielRosenwasser commentedon Nov 2, 2022
Seems fair to say this was done, right? Looks like the server perf tests are working pretty well so far!