Commit Graph

328 Commits

Author SHA1 Message Date
Kartikaya Gupta
e487e48753 Bug 1673359 - Allow suffixes on ccov test platforms. r=ahal
This allows additional suffixes (e.g. -qr) to be added to ccov test platforms,
and in most cases those labels will be treated the same as the other ccov jobs.
In a few cases exact (non-regex) keys were left unmodified, because changing
a non-regex key to a regex key can result in taskgraph generation failure, if
more than one regex key matches.

I verified that this patch does not modify the output generated by `./mach
taskgraph full --json`.

Differential Revision: https://phabricator.services.mozilla.com/D94725
2020-10-27 14:00:11 +00:00
Ricky Stewart
31b8ca9716 Bug 1654103: Standardize on Black for Python code in mozilla-central.
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Make some ad-hoc manual updates to `testing/marionette/client/setup.py`, `testing/marionette/harness/setup.py`, and `testing/firefox-ui/harness/setup.py`, which have hard-coded regexes that break after the reformat.

5. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-26 18:34:53 +00:00
Gregory Mierzwinski
7c674c6e61 Bug 1673074 - Modify cron to run chrome linux tests in browsertime. r=perftest-reviewers,Bebe
This patch modifies the cron to run chrome linux tests on browsertime instead of webext. It also removes the linux smoke tests.

Differential Revision: https://phabricator.services.mozilla.com/D94628
2020-10-26 12:49:21 +00:00
Bogdan Tara
612312a64c Backed out 10 changesets (bug 1654103, bug 1672023, bug 1518999) for PanZoomControllerTest.touchEventForResult gv-junit failures CLOSED TREE
Backed out changeset ff3fb0b4a512 (bug 1672023)
Backed out changeset e7834b600201 (bug 1654103)
Backed out changeset 807893ca8069 (bug 1518999)
Backed out changeset 13e6b92440e9 (bug 1518999)
Backed out changeset 8b2ac5a6c98a (bug 1518999)
Backed out changeset 575748295752 (bug 1518999)
Backed out changeset 65f07ce7b39b (bug 1518999)
Backed out changeset 4bb80556158d (bug 1518999)
Backed out changeset 8ac8461d7bd7 (bug 1518999)
Backed out changeset e8ba13ee17f5 (bug 1518999)
2020-10-24 03:36:18 +03:00
Ricky Stewart
065d2eb893 Bug 1654103: Standardize on Black for Python code in mozilla-central. r=remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers,devtools-backward-compat-reviewers,jgilbert,preferences-reviewers,sylvestre,maja_zf,webcompat-reviewers,denschub,ntim,whimboo,sparky
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Make some ad-hoc manual updates to `testing/marionette/client/setup.py`, `testing/marionette/harness/setup.py`, and `testing/firefox-ui/harness/setup.py`, which have hard-coded regexes that break after the reformat.

5. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-23 20:40:42 +00:00
Marco Castelluccio
21c3bcf759 Bug 1672505 - Make the 'system_symbols' target tasks method select symbol scraping tasks too. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D94393
2020-10-22 15:38:01 +00:00
Dorel Luca
95b44c982f Backed out changeset 7558c8821a07 (bug 1654103) for multiple failures. CLOSED TREE 2020-10-22 03:51:06 +03:00
Ricky Stewart
43baed3c18 Bug 1654103: Standardize on Black for Python code in mozilla-central. r=remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers,devtools-backward-compat-reviewers,jgilbert,preferences-reviewers,sylvestre,maja_zf,webcompat-reviewers,denschub,ntim,whimboo,sparky
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-21 21:27:27 +00:00
Gregory Mierzwinski
1e590fa3ab Bug 1652457 - Remove non-live site tests from Sunday live-site raptor cron. r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D93397
2020-10-14 15:05:06 +00:00
James Graham
d0ee2e3d09 Bug 1666759 - Add a target_tasks filter that enables scheduling uncommon tasks, r=jmaher
In particular this allows scheduling backlog tasks on try with --disable-target-task-filter

Differential Revision: https://phabricator.services.mozilla.com/D91135
2020-09-25 19:48:47 +00:00
Andrew Halberstadt
5a1e5b09f2 Bug 1665312 - Ensure a test task is never completely removed from full_task_graph due to test_manifest_loader, r=taskgraph-reviewers,aki
This causes them to get filtered out at the target tasks phase instead. We need
to do this since backfilling depends on the task existing in the full task
graph.

Differential Revision: https://phabricator.services.mozilla.com/D90579
2020-09-23 18:13:12 +00:00
Gregory Mierzwinski
a42f98cbca Bug 1662777 - Fix cron tasks for power tests. r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D89157
2020-09-08 13:14:25 +00:00
Mihai Tabara
26ab1edc56 Bug 1661673 - remove esr68 references.r=releng-reviewers,aki DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D88618
2020-08-31 07:59:28 +00:00
Mihai Tabara
53f0eb567c Bug 1661673 - make esr78 not next-esr.r=releng-reviewers,aki DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D88591
2020-09-04 20:35:04 +00:00
alexandru.ionescu
81b3ad8af1 Bug 1662061 Remove mobile pageload tests for webextension r=sparky,Bebe,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D88783
2020-09-01 09:58:39 +00:00
Andrew Halberstadt
1a5d28b93c Bug 1660506 - Move backstop determination to the decision task and store it in a parameter, r=marco,taskgraph-reviewers,jmaher
We want to be able to retroactively tell whether a push was a backstop or not.
This patch stores whether or not a push was a "backstop" directly in the
parameters. The optimization strategy now simply returns 'not
params["backstop"]'.

For simplicity, I'm not counting the 'optimized-backstop' as a backstop. It's
unclear if we'll want to be able to detect these types of the pushes in the
future or not, but we can cross that bridge when we get there.

Differential Revision: https://phabricator.services.mozilla.com/D88151
2020-08-26 21:56:05 +00:00
Aki Sasaki
d89b7aaa92 no bug - fix try taskgraph-gen r=taskgraph-reviewers,jmaher DONTBUILD
taskgraph-gen.py dies on try.yml currently.
I'm not sure what the underlying issue is, but this gets things working again.

Differential Revision: https://phabricator.services.mozilla.com/D87691
2020-08-20 15:23:54 +00:00
Florin Strugariu
6220b766cc Bug 1656475 - Activate performance alerting on multi commit Fenix performance tests r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D86020
2020-08-05 16:06:17 +00:00
Geoff Brown
8cf0a50755 Bug 1617684 - Run existing fission web-platform tests as tier 1; r=jmaher
For all fission web-platform tests currently running on mozilla-central as tier 2,
promote to tier 1 and run on all trunk trees.

Differential Revision: https://phabricator.services.mozilla.com/D85512
2020-08-04 14:12:11 +00:00
Joel Maher
2aead6d572 Bug 1652881 - filter out remaining debug tasks on beta/release. r=Callek
filter out remaining debug tasks on beta/release.

Differential Revision: https://phabricator.services.mozilla.com/D85511
2020-07-31 20:10:37 +00:00
Ben Hearsum
c76b6ae359 Bug 1656534: devtools preset no longer runs linux opt fission tests (moved to --full task list). r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D85614
2020-07-31 18:22:02 +00:00
Florin Strugariu
db4e46c63f Bug 1652438 - Schedule all tests to run nightly on test-windows10-64-ref-hw-2017 r=perftest-reviewers,davehunt,jmaher,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D83485
2020-07-31 11:04:21 +00:00
Ben Hearsum
f7bd855261 Bug 1655703: Can't schedule opt tests on try without --full r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D85197
2020-07-30 20:56:36 +00:00
Andrew Sutherland
ec7f2250d4 Bug 1653986 - Add new test metadata taskcluster searchfox task deps. r=kats
The enhancements in Bug 1653986 to display information about tests derives its
data from these 2 jobs and so it's appropriate to explicitly depend on them.

The current status of these jobs in the tree as far as I can tell is that:
- "source-test-file-metadata-test-info-all": Seems to get automatically
  triggered by someone's regularly, so it's always likely to be there for
  our searchfox cron jobs, but it's nice to not depend on that.
- "source-test-wpt-metadata-summary" : Seems to get automatically run, but
  only on commits that touch meta files change, per
  https://searchfox.org/mozilla-central/rev/cf561cece0ca9aeaf0202e68699836d957d0c670/taskcluster/ci/source-test/wpt-metadata.yml#31
  and indeed it wasn't there on today's searchfox jobs.

Differential Revision: https://phabricator.services.mozilla.com/D84933
2020-07-28 09:59:02 +00:00
Ben Hearsum
a517f66228 Bug 1650208: run opt builds by default on autoland; shippable builds by default on central r=tomprince,ahal,marco
Differential Revision: https://phabricator.services.mozilla.com/D83186
2020-07-27 16:25:40 +00:00
Gregory Mierzwinski
4d622e7427 Bug 1652451 - Re-enable youtube-playback 2020 tests. r=perftest-reviewers,AlexandruIonescu
Differential Revision: https://phabricator.services.mozilla.com/D84184
2020-07-27 11:53:38 +00:00
Joel Maher
034fac4385 Bug 1652881 - reduce debug build/test on mozilla-beta and mozilla-release branches r=Callek
reduce debug build/test on mozilla-beta and mozilla-release branches

Differential Revision: https://phabricator.services.mozilla.com/D84279
2020-07-22 08:33:57 +00:00
Tom Prince
a090d5bb84 No bug: Cleanup language. DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D84071
2020-07-18 04:56:52 +00:00
Gregory Mierzwinski
4e75086381 Bug 1652451 - Disable 2020 youtube-playback tests temporarily. r=perftest-reviewers,davehunt
This patch disables all failing youtube-playback tests.

Differential Revision: https://phabricator.services.mozilla.com/D83368
2020-07-13 19:29:12 +00:00
Tom Prince
6a07223760 Bug 1649168: Add scriptworker-canary action and corresponding task; r=rail
Add an action that will trigger a task that runs
`mach release push-scriptworker-canary`
to test a new scriptworker deployment.

Differential Revision: https://phabricator.services.mozilla.com/D82821
2020-07-10 16:12:05 +00:00
Gregory Mierzwinski
2684007f96 Bug 1650871 - Add all browsertime desktop tests. r=perftest-reviewers,AlexandruIonescu
This patch adds all desktop pageload tests to browsertime. It adds taskcluster tasks for these but doesn't enable them in production. They can only be run when --full is used.

Differential Revision: https://phabricator.services.mozilla.com/D82432
2020-07-08 07:48:16 +00:00
Justin Wood
cc3863fa1d Bug 1649383 - don't do geckoview builds on esr. r=jcristau
Differential Revision: https://phabricator.services.mozilla.com/D81742
2020-07-07 16:09:35 +00:00
Gregory Mierzwinski
3de41e362d Bug 1649641 - Re-enable live site Fenix tests. r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D81786
2020-07-01 09:24:15 +00:00
Andi-Bogdan Postelnicu
c3f0d4ad96 Bug 1648709 - run Coverity Static Analysis on mozilla-central once per day. r=sylvestre
Right now we are running `Coverity Static Analysis` for each merge to `mozilla-central`,
this is suboptimal since the resources required to do so are very expensive. It's
enough to run it once a day.

Differential Revision: https://phabricator.services.mozilla.com/D81510
2020-06-29 12:44:51 +00:00
Andrew Creskey
fb1800b073 Bug 1648183 - Disable live site testing for 1 day, or otherwise disable telemetry pings r=davehunt
Disabling these unsheriffed tests to determine if they are causing the spikes in new users that telemetry reveals.

Differential Revision: https://phabricator.services.mozilla.com/D81326
2020-06-26 16:59:38 +00:00
Gregory Mierzwinski
8bd0247163 Bug 1645874 - Simplify the perftest crons and remove some tests in production. r=perftest-reviewers,davehunt
This patch does a few small things to clean up our CI tests:
(1) The GPT cron is simplified so that it can be more manageable. In this change I also include a new helper method to make sure we run our android tests on the build variants that we should be running them on (and no others).
(2) The geckoview browsertime warm tests were running on 1 platform too many - this is no longer the case.
(3) Fennec vismet tests were previously excluded but are now included.
(4) All fennec tests that were in GPT cron have been moved to the Fennec_v68 cron so they only run once a week.

Differential Revision: https://phabricator.services.mozilla.com/D79891
2020-06-22 10:26:39 +00:00
Justin Wood
050683fd9d Bug 1646588 - Add esr78 support. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D79731
2020-06-18 19:57:20 +00:00
Ben Hearsum
623ebe355e Bug 1642004: -p all try syntax selects shippable builds instead of opt r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D79169
2020-06-12 19:08:54 +00:00
Gregory Mierzwinski
66ddb5639f Bug 1641878 - Migrate fennec68 raptor tests to browsertime. r=perftest-reviewers,davehunt
This patch disables and removes the raptor-webext fennec68 tests and replaces them with the browsertime variants. The raptor tests which ran through a cron are also swapped for the browsertime tests.

Differential Revision: https://phabricator.services.mozilla.com/D77674
2020-06-12 11:38:26 +00:00
Gregory Mierzwinski
5a81a52032 Bug 1644491 - Run fennec68 youtube tests once a week. r=perftest-reviewers,davehunt
This patch disables fennec68 youtube playback tests on mozilla-central and runs them once a week through the fennec_v68 cron job.

Differential Revision: https://phabricator.services.mozilla.com/D78937
2020-06-10 17:02:17 +00:00
Joel Maher
8b73b8e0eb Bug 1643284 - require --full to schedule talos/raptor profiling jobs on try. r=davehunt,ahal
require --full to schedule talos/raptor profiling jobs on try.

Differential Revision: https://phabricator.services.mozilla.com/D78250
2020-06-08 15:19:55 +00:00
Andrew Halberstadt
78623411a0 Bug 1641131 - [taskgraph] Filter out devedition builds and tests with |mach try auto|, r=marco
Differential Revision: https://phabricator.services.mozilla.com/D78569
2020-06-05 20:28:44 +00:00
Nathan Froyd
e5b685e75f Bug 1643029 - remove build-.*-aarch64 from being hidden behind --full; r=ahal
It's not good to hide Android AArch64 builds, a tier 1 platform, behind `--full`.

Differential Revision: https://phabricator.services.mozilla.com/D78070
2020-06-03 16:15:43 +00:00
Gregory Mierzwinski
c3b3785d16 Bug 1641555 - Disable some chrome live site tests. r=perftest-reviewers,Bebe
This patch prevents some extra live site tests from running on chrome.

Differential Revision: https://phabricator.services.mozilla.com/D77255
2020-05-28 13:42:58 +00:00
Gregory Mierzwinski
54458cb07c Bug 1638376 - Run recorded sites as live sites once a week. r=perftest-reviewers,alexandru.irimovici
This patch enables a new cron job that runs our recorded sites as live sites once a week through browsertime so we can continuously monitor how well our recordings match with what page the user is seeing.

Differential Revision: https://phabricator.services.mozilla.com/D75575
2020-05-26 11:20:27 +00:00
Ben Hearsum
a1181efe0b Bug 1638014: blacklist shippable tests from try when there is an opt version of the test available r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D76012
2020-05-22 17:45:06 +00:00
Justin Wood
6c62472264 Bug 1617481 - Remove most of nightly attribute from taskcluster/taskgraph. r=aki
We leave the nightly index in place for now in order to support Geckodriver until Bug 1577110 sticks.

Differential Revision: https://phabricator.services.mozilla.com/D74510
2020-05-21 16:31:04 +00:00
Justin Wood
4866099fc7 Bug 1623355 - Part 9/9 - Remove 'pgo' support from performance testing target tasks. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74961
2020-05-21 16:29:51 +00:00
Justin Wood
e65e02bbba Bug 1623355 - Part 2/9 - Add shippable as a valid target for performance test cron targets. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74960
2020-05-21 16:31:23 +00:00
Tom Prince
2ba5dcc8b8 No bug: Rename list of labels to ignore on try to UNCOMMON_TRY_TASK_LABELS; r=ahal
Give it a more descriptive name, and avoid using `blacklist` in the name.

Differential Revision: https://phabricator.services.mozilla.com/D76031
2020-05-20 13:18:19 +00:00