Commit Graph

341 Commits

Author SHA1 Message Date
Dave Hunt
ada790bf83 Bug 1670005 - Remove weekly Fennec cron for Raptor tests; r=perftest-reviewers,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D109669
2021-03-25 12:02:04 +00:00
Tom Ritter
be70759661 Bug 1699740 - Make updatebot run on a cron job in m-c r=aki
Differential Revision: https://phabricator.services.mozilla.com/D109076
2021-03-23 17:17:52 +00:00
Dave Hunt
ca22e0493d Bug 1677125 - Schedule live desktop page loads r=perftest-reviewers,sparky
Schedule live desktop page load for all recorded sites. Also provide fission variants for all browsertime desktop tests running on webrender platforms and moved sheriffed live page load tests into a separate job.

Differential Revision: https://phabricator.services.mozilla.com/D108959
2021-03-19 22:17:10 +00:00
Gregory Mierzwinski
1d1ff00ffa Bug 1696496 - Disable raptor tests running on windows10-64-ref-hw-2017. r=perftest-reviewers,igoldan
Differential Revision: https://phabricator.services.mozilla.com/D107663
2021-03-11 14:13:09 +00:00
Gregory Mierzwinski
dbabd59457 Bug 1693135 - Disable raptor-webext tests on windows. r=perftest-reviewers,kimberlythegeek
Differential Revision: https://phabricator.services.mozilla.com/D106504
2021-02-25 19:33:41 +00:00
Gregory Mierzwinski
55f8e26b6b Bug 1667396 - Enable browsertime tests on windows. r=jesup
This patch enables browsertime pageload tests on windows and also modifies some crons to run the pageload tests through browsertime rather than raptor.

Differential Revision: https://phabricator.services.mozilla.com/D105352
2021-02-19 15:56:38 +00:00
Joel Maher
06430efec4 Bug 1677640 - disable cron based windows7 chrome/chromium perf tests. r=sparky
disable cron based windows7 chrome/chromium perf tests

Differential Revision: https://phabricator.services.mozilla.com/D104728
2021-02-10 19:05:26 +00:00
Alex Ionescu
6dce6921b2 Bug 1681053 Disable jianshu mobile live due to perma r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D104152
2021-02-08 07:15:59 +00:00
Andrew Creskey
45cf01a1d4 Bug 1677617 - Disable the fenix MAIN test r=sparky
The test will no longer run on commits until we can resolve the failure, which is blocked on a Fenix issue.
https://github.com/mozilla-mobile/fenix/issues/13470

Differential Revision: https://phabricator.services.mozilla.com/D97226
2020-11-19 15:33:05 +00:00
Gregory Mierzwinski
9a34ef2a25 Bug 1675739 - Disable macos raptor chrome/chromium tests. r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D96316
2020-11-09 14:31:16 +00:00
Tom Ritter
346da0ff52 Bug 1674182 - Support a regex filter for./mach try auto r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D95186
2020-11-05 17:53:31 +00:00
Gregory Mierzwinski
43a443ea4d Bug 1670284 - Run android perf tests with webrender-enabled. r=perftest-reviewers,Bebe
This patch makes webrender-enabled testing the main method for testing and also adds a subset of tests that will without it enabled until the switch is fully complete.

Differential Revision: https://phabricator.services.mozilla.com/D95744
2020-11-05 14:28:58 +00:00
Sebastian Hengst
094bc841d8 Bug 1675086 - drop references to 'pgo' platforms for Linux and Windows. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D95802
2020-11-03 22:45:54 +00:00
Kartikaya Gupta
e487e48753 Bug 1673359 - Allow suffixes on ccov test platforms. r=ahal
This allows additional suffixes (e.g. -qr) to be added to ccov test platforms,
and in most cases those labels will be treated the same as the other ccov jobs.
In a few cases exact (non-regex) keys were left unmodified, because changing
a non-regex key to a regex key can result in taskgraph generation failure, if
more than one regex key matches.

I verified that this patch does not modify the output generated by `./mach
taskgraph full --json`.

Differential Revision: https://phabricator.services.mozilla.com/D94725
2020-10-27 14:00:11 +00:00
Ricky Stewart
31b8ca9716 Bug 1654103: Standardize on Black for Python code in mozilla-central.
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Make some ad-hoc manual updates to `testing/marionette/client/setup.py`, `testing/marionette/harness/setup.py`, and `testing/firefox-ui/harness/setup.py`, which have hard-coded regexes that break after the reformat.

5. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-26 18:34:53 +00:00
Gregory Mierzwinski
7c674c6e61 Bug 1673074 - Modify cron to run chrome linux tests in browsertime. r=perftest-reviewers,Bebe
This patch modifies the cron to run chrome linux tests on browsertime instead of webext. It also removes the linux smoke tests.

Differential Revision: https://phabricator.services.mozilla.com/D94628
2020-10-26 12:49:21 +00:00
Bogdan Tara
612312a64c Backed out 10 changesets (bug 1654103, bug 1672023, bug 1518999) for PanZoomControllerTest.touchEventForResult gv-junit failures CLOSED TREE
Backed out changeset ff3fb0b4a512 (bug 1672023)
Backed out changeset e7834b600201 (bug 1654103)
Backed out changeset 807893ca8069 (bug 1518999)
Backed out changeset 13e6b92440e9 (bug 1518999)
Backed out changeset 8b2ac5a6c98a (bug 1518999)
Backed out changeset 575748295752 (bug 1518999)
Backed out changeset 65f07ce7b39b (bug 1518999)
Backed out changeset 4bb80556158d (bug 1518999)
Backed out changeset 8ac8461d7bd7 (bug 1518999)
Backed out changeset e8ba13ee17f5 (bug 1518999)
2020-10-24 03:36:18 +03:00
Ricky Stewart
065d2eb893 Bug 1654103: Standardize on Black for Python code in mozilla-central. r=remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers,devtools-backward-compat-reviewers,jgilbert,preferences-reviewers,sylvestre,maja_zf,webcompat-reviewers,denschub,ntim,whimboo,sparky
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Make some ad-hoc manual updates to `testing/marionette/client/setup.py`, `testing/marionette/harness/setup.py`, and `testing/firefox-ui/harness/setup.py`, which have hard-coded regexes that break after the reformat.

5. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-23 20:40:42 +00:00
Marco Castelluccio
21c3bcf759 Bug 1672505 - Make the 'system_symbols' target tasks method select symbol scraping tasks too. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D94393
2020-10-22 15:38:01 +00:00
Dorel Luca
95b44c982f Backed out changeset 7558c8821a07 (bug 1654103) for multiple failures. CLOSED TREE 2020-10-22 03:51:06 +03:00
Ricky Stewart
43baed3c18 Bug 1654103: Standardize on Black for Python code in mozilla-central. r=remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers,devtools-backward-compat-reviewers,jgilbert,preferences-reviewers,sylvestre,maja_zf,webcompat-reviewers,denschub,ntim,whimboo,sparky
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-21 21:27:27 +00:00
Gregory Mierzwinski
1e590fa3ab Bug 1652457 - Remove non-live site tests from Sunday live-site raptor cron. r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D93397
2020-10-14 15:05:06 +00:00
James Graham
d0ee2e3d09 Bug 1666759 - Add a target_tasks filter that enables scheduling uncommon tasks, r=jmaher
In particular this allows scheduling backlog tasks on try with --disable-target-task-filter

Differential Revision: https://phabricator.services.mozilla.com/D91135
2020-09-25 19:48:47 +00:00
Andrew Halberstadt
5a1e5b09f2 Bug 1665312 - Ensure a test task is never completely removed from full_task_graph due to test_manifest_loader, r=taskgraph-reviewers,aki
This causes them to get filtered out at the target tasks phase instead. We need
to do this since backfilling depends on the task existing in the full task
graph.

Differential Revision: https://phabricator.services.mozilla.com/D90579
2020-09-23 18:13:12 +00:00
Gregory Mierzwinski
a42f98cbca Bug 1662777 - Fix cron tasks for power tests. r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D89157
2020-09-08 13:14:25 +00:00
Mihai Tabara
26ab1edc56 Bug 1661673 - remove esr68 references.r=releng-reviewers,aki DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D88618
2020-08-31 07:59:28 +00:00
Mihai Tabara
53f0eb567c Bug 1661673 - make esr78 not next-esr.r=releng-reviewers,aki DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D88591
2020-09-04 20:35:04 +00:00
alexandru.ionescu
81b3ad8af1 Bug 1662061 Remove mobile pageload tests for webextension r=sparky,Bebe,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D88783
2020-09-01 09:58:39 +00:00
Andrew Halberstadt
1a5d28b93c Bug 1660506 - Move backstop determination to the decision task and store it in a parameter, r=marco,taskgraph-reviewers,jmaher
We want to be able to retroactively tell whether a push was a backstop or not.
This patch stores whether or not a push was a "backstop" directly in the
parameters. The optimization strategy now simply returns 'not
params["backstop"]'.

For simplicity, I'm not counting the 'optimized-backstop' as a backstop. It's
unclear if we'll want to be able to detect these types of the pushes in the
future or not, but we can cross that bridge when we get there.

Differential Revision: https://phabricator.services.mozilla.com/D88151
2020-08-26 21:56:05 +00:00
Aki Sasaki
d89b7aaa92 no bug - fix try taskgraph-gen r=taskgraph-reviewers,jmaher DONTBUILD
taskgraph-gen.py dies on try.yml currently.
I'm not sure what the underlying issue is, but this gets things working again.

Differential Revision: https://phabricator.services.mozilla.com/D87691
2020-08-20 15:23:54 +00:00
Florin Strugariu
6220b766cc Bug 1656475 - Activate performance alerting on multi commit Fenix performance tests r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D86020
2020-08-05 16:06:17 +00:00
Geoff Brown
8cf0a50755 Bug 1617684 - Run existing fission web-platform tests as tier 1; r=jmaher
For all fission web-platform tests currently running on mozilla-central as tier 2,
promote to tier 1 and run on all trunk trees.

Differential Revision: https://phabricator.services.mozilla.com/D85512
2020-08-04 14:12:11 +00:00
Joel Maher
2aead6d572 Bug 1652881 - filter out remaining debug tasks on beta/release. r=Callek
filter out remaining debug tasks on beta/release.

Differential Revision: https://phabricator.services.mozilla.com/D85511
2020-07-31 20:10:37 +00:00
Ben Hearsum
c76b6ae359 Bug 1656534: devtools preset no longer runs linux opt fission tests (moved to --full task list). r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D85614
2020-07-31 18:22:02 +00:00
Florin Strugariu
db4e46c63f Bug 1652438 - Schedule all tests to run nightly on test-windows10-64-ref-hw-2017 r=perftest-reviewers,davehunt,jmaher,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D83485
2020-07-31 11:04:21 +00:00
Ben Hearsum
f7bd855261 Bug 1655703: Can't schedule opt tests on try without --full r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D85197
2020-07-30 20:56:36 +00:00
Andrew Sutherland
ec7f2250d4 Bug 1653986 - Add new test metadata taskcluster searchfox task deps. r=kats
The enhancements in Bug 1653986 to display information about tests derives its
data from these 2 jobs and so it's appropriate to explicitly depend on them.

The current status of these jobs in the tree as far as I can tell is that:
- "source-test-file-metadata-test-info-all": Seems to get automatically
  triggered by someone's regularly, so it's always likely to be there for
  our searchfox cron jobs, but it's nice to not depend on that.
- "source-test-wpt-metadata-summary" : Seems to get automatically run, but
  only on commits that touch meta files change, per
  https://searchfox.org/mozilla-central/rev/cf561cece0ca9aeaf0202e68699836d957d0c670/taskcluster/ci/source-test/wpt-metadata.yml#31
  and indeed it wasn't there on today's searchfox jobs.

Differential Revision: https://phabricator.services.mozilla.com/D84933
2020-07-28 09:59:02 +00:00
Ben Hearsum
a517f66228 Bug 1650208: run opt builds by default on autoland; shippable builds by default on central r=tomprince,ahal,marco
Differential Revision: https://phabricator.services.mozilla.com/D83186
2020-07-27 16:25:40 +00:00
Gregory Mierzwinski
4d622e7427 Bug 1652451 - Re-enable youtube-playback 2020 tests. r=perftest-reviewers,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D84184
2020-07-27 11:53:38 +00:00
Joel Maher
034fac4385 Bug 1652881 - reduce debug build/test on mozilla-beta and mozilla-release branches r=Callek
reduce debug build/test on mozilla-beta and mozilla-release branches

Differential Revision: https://phabricator.services.mozilla.com/D84279
2020-07-22 08:33:57 +00:00
Tom Prince
a090d5bb84 No bug: Cleanup language. DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D84071
2020-07-18 04:56:52 +00:00
Gregory Mierzwinski
4e75086381 Bug 1652451 - Disable 2020 youtube-playback tests temporarily. r=perftest-reviewers,davehunt
This patch disables all failing youtube-playback tests.

Differential Revision: https://phabricator.services.mozilla.com/D83368
2020-07-13 19:29:12 +00:00
Tom Prince
6a07223760 Bug 1649168: Add scriptworker-canary action and corresponding task; r=rail
Add an action that will trigger a task that runs
`mach release push-scriptworker-canary`
to test a new scriptworker deployment.

Differential Revision: https://phabricator.services.mozilla.com/D82821
2020-07-10 16:12:05 +00:00
Gregory Mierzwinski
2684007f96 Bug 1650871 - Add all browsertime desktop tests. r=perftest-reviewers,AlexandruIonescu
This patch adds all desktop pageload tests to browsertime. It adds taskcluster tasks for these but doesn't enable them in production. They can only be run when --full is used.

Differential Revision: https://phabricator.services.mozilla.com/D82432
2020-07-08 07:48:16 +00:00
Justin Wood
cc3863fa1d Bug 1649383 - don't do geckoview builds on esr. r=jcristau
Differential Revision: https://phabricator.services.mozilla.com/D81742
2020-07-07 16:09:35 +00:00
Gregory Mierzwinski
3de41e362d Bug 1649641 - Re-enable live site Fenix tests. r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D81786
2020-07-01 09:24:15 +00:00
Andi-Bogdan Postelnicu
c3f0d4ad96 Bug 1648709 - run Coverity Static Analysis on mozilla-central once per day. r=sylvestre
Right now we are running `Coverity Static Analysis` for each merge to `mozilla-central`,
this is suboptimal since the resources required to do so are very expensive. It's
enough to run it once a day.

Differential Revision: https://phabricator.services.mozilla.com/D81510
2020-06-29 12:44:51 +00:00
Andrew Creskey
fb1800b073 Bug 1648183 - Disable live site testing for 1 day, or otherwise disable telemetry pings r=davehunt
Disabling these unsheriffed tests to determine if they are causing the spikes in new users that telemetry reveals.

Differential Revision: https://phabricator.services.mozilla.com/D81326
2020-06-26 16:59:38 +00:00
Gregory Mierzwinski
8bd0247163 Bug 1645874 - Simplify the perftest crons and remove some tests in production. r=perftest-reviewers,davehunt
This patch does a few small things to clean up our CI tests:
(1) The GPT cron is simplified so that it can be more manageable. In this change I also include a new helper method to make sure we run our android tests on the build variants that we should be running them on (and no others).
(2) The geckoview browsertime warm tests were running on 1 platform too many - this is no longer the case.
(3) Fennec vismet tests were previously excluded but are now included.
(4) All fennec tests that were in GPT cron have been moved to the Fennec_v68 cron so they only run once a week.

Differential Revision: https://phabricator.services.mozilla.com/D79891
2020-06-22 10:26:39 +00:00
Justin Wood
050683fd9d Bug 1646588 - Add esr78 support. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D79731
2020-06-18 19:57:20 +00:00