Adding Performance Tests

Chrome runs a battery of performance tests against every build. These tests are monitored by the perf sheriffs for regressions. The best ways to ensure your feature stays fast and gets faster is to add a performance test.

  1. Create the test
    Most new perf tests will want to use the Telemetry framework. All enabled Telemetry tests are automatically detected and run by the perf bots.

    If you know what you are doing and have a good reason not to use Telemetry, a perf test may be any program or script which outputs results in the format the buildbot understands. You'll need to edit the bot configurations to run the test.

  2. Announce it
    When you add, remove, or change a test, you should always make everyone else aware as there are many people who depend on our tests and dashboards. At the very least, send an email to chrome-perf@google.com with the details of your test.

  3. Document it
    The dashboard displays descriptions pulled from unit-info.json and test-info.json. Help out your fellow engineers and describe your test thoroughly.

  4. Monitor the results
    Finally, monitor the results for regressions. Once the test is monitored, it will show up in the dashboard by default. To do so, use the red "Report Issue > Request Monitoring for Tests" menu on the perf dashboard.



    ...

  5. Profit!
Comments