Skip to content

Add performance coverage for builder/incremental/watch scenarios #44426

Open
@DanielRosenwasser

Description

@DanielRosenwasser
Member

I'm pretty sure we have no perf suite coverage of the builder, but why not?

Originally posted by @amcasey in #44402 (comment)

There's no good reason except for "it's work", but we really should come up with a way to measure our performance characteristics in the perf suite; however, that's not necessarily an easy thing to accomplish.

Some challenges

  1. What are good "representative" codebases?
  2. What is a good "representative" set of changes to benchmark for rebuilds?
  3. How does this integrate with existing perf tests?

Activity

added
InfrastructureIssue relates to TypeScript team infrastructure
Needs ProposalThis issue needs a plan that clarifies the finer details of how it could be implemented.
SuggestionAn idea for TypeScript
on Jun 4, 2021
amcasey

amcasey commented on Jun 4, 2021

@amcasey
Member

Haha, "why not?" was "why not kick off a perf run anyway?".

The reason "why not have coverage" is that the space of possible incremental changes is enormous. We'd basically have to stumble upon one that turns out to be interesting (i.e. through a separate investigation) and then add that exact change to the suite.

removed
SuggestionAn idea for TypeScript
Needs ProposalThis issue needs a plan that clarifies the finer details of how it could be implemented.
on Mar 12, 2024
added this to the Backlog milestone on Mar 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

Domain: PerformanceReports of unusually slow behaviorInfrastructureIssue relates to TypeScript team infrastructure

Type

No type

Projects

No projects

Relationships

None yet

    Development

    No branches or pull requests

      Participants

      @DanielRosenwasser@RyanCavanaugh@sheetalkamat@amcasey

      Issue actions

        Add performance coverage for builder/incremental/watch scenarios · Issue #44426 · microsoft/TypeScript