This patch adds a daily cron task to build the custom chromium-as-release (CaR) application and running
raptor browsertime tests with it.
Differential Revision: https://phabricator.services.mozilla.com/D177545
This patch should disable fenix/geckoview *fission* performance tests only.
The tests are still available to select through Try.
Differential Revision: https://phabricator.services.mozilla.com/D171133
There are no jobs remaining on 10.14, but we still had some lingering
supporting code.
Also change the treeherder label for the generate-profile task to match
the actual worker type.
Differential Revision: https://phabricator.services.mozilla.com/D170735
Instead of excluding android builds based on the `project` parameter, use
`release_type`, which is properly set to e.g. `esr102` by `mach try release`.
Differential Revision: https://phabricator.services.mozilla.com/D168563
This patch updates the S3 commit used, fixes an issue with local Windows benchmark runs, and enables the windows S3 tests in CI.
Differential Revision: https://phabricator.services.mozilla.com/D166323
This patch adds the speedometer 3 benchmark test to raptor enables it for CI. In CI, it'll start by running on Linux, and MacOSX on Firefox, Chrome, and Chromium. The patch also adds a new method for parsing benchmark tests that is more generic and works in conjunction with the `custom_data` option.
Differential Revision: https://phabricator.services.mozilla.com/D165988
Now that we can run performance tests on Safari, this patch adds these tests to the general_perf_testing cron.
This let's us run the existing Safari live and benchmark tests at the same frequency as Chrome tests.
Differential Revision: https://phabricator.services.mozilla.com/D163987
The `always_target` attribute is a feature which I believe I previously
mis-implemented. It doesn't belong in `generator.py` and should instead be
implemented somewhere in `target_tasks.py`. I chose to wrap the registration
decorator to guarantee backwards compatibility within Gecko. Though we may wish
to move it out to a filter in the future.
I'm making this change now to facilitate merging standalone and Gecko
taskgraphs. The `always_target` feature will be removed from standalone (as it
isn't being used and should consumers need something like it, they can roll
their own implementations).
With the feature removed from both Gecko and standalone in generator.py, this
file will now be identical across both Taskgraphs and can therefore be removed
from Gecko.
Differential Revision: https://phabricator.services.mozilla.com/D159181
This patch is to help address scenarios where duplicate graphs are created for the daily browsertime tests on mozilla-beta, off of the same revision. This occurs when the 2nd cron job finishes before the 1st one finishes. Here, the logic prevents a 2nd graph from being created.
Differential Revision: https://phabricator.services.mozilla.com/D157366
This patch limits the frequency of performance tests running on the mozilla-release branch. In particular, we need to reduce the load on our android devices for the time being, similar to how we did this for the beta branch in bug 1788026.
Differential Revision: https://phabricator.services.mozilla.com/D157159
Renaming `nightly` to `daily` is intended for avoiding confusion with Nightly builds and better reflect what we are doing with these performance tests.
Differential Revision: https://phabricator.services.mozilla.com/D156324
There will be changes in mozilla-beta that will increase the frequency of pushes. This will increase the load on our android devices so this patch will limit the amount of tests to be run nightly rather than on every push.
Differential Revision: https://phabricator.services.mozilla.com/D156198
What we are doing:
- Disabling chrome-m tests to run on Pixel2 devices
Why:
- Recent bitbar cleanup script update is causing permafails on chrome
Differential Revision: https://phabricator.services.mozilla.com/D154274
Add non-android debug builds/tests back to mozilla-beta, to catch
post-central leaks and debug-only test failures before reaching esr.
Differential Revision: https://phabricator.services.mozilla.com/D150621
This patch adds a cron job that runs daily and triggers the backfill-all-browsertime action task for the revisions containing commits that were reviewed by #perftest for the daay before the job is running.
Differential Revision: https://phabricator.services.mozilla.com/D144713
This patch removes all the code related to the second task (the `*-vismet` tasks) we were using for visual-metrics processing.
Differential Revision: https://phabricator.services.mozilla.com/D142837
