Commit Graph

559 Commits

Author SHA1 Message Date
Gregory Mierzwinski
d9caf9529c Bug 1689377 - Add chromedriver for chrome 88. r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D103334
2021-01-29 15:19:38 +00:00
Yura Zenevich
8f35f81bad Bug 1667998 - [ci] Add cli flag in desktop_unittest.py. Ensure M-a11y-checks runs on Linux x64 opt build. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D102042
2021-01-20 14:25:26 +00:00
Yura Zenevich
97d2ca20f5 Bug 1667998 - [ci] Create a new 'a11y-checks' test variant. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D100840
2021-01-15 18:20:39 +00:00
Noemi Erli
df38f3c75c Backed out 5 changesets (bug 1667998) for breaking a11y checks CLOSED TREE
Backed out changeset 633dda979b22 (bug 1667998)
Backed out changeset c9838cdb1303 (bug 1667998)
Backed out changeset 501c54cf59be (bug 1667998)
Backed out changeset 615b74c822ec (bug 1667998)
Backed out changeset 6d187c01fcb3 (bug 1667998)
2021-01-15 20:16:06 +02:00
Yura Zenevich
d94687ba1c Bug 1667998 - [ci] Create a new 'a11y-checks' test variant. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D100840
2021-01-15 16:54:13 +00:00
Aaron Klotz
f2f9415518 Bug 1654817: Part 1 - Convert e10s-multi transform to an e10s-single transform; r=taskgraph-reviewers,jmaher
Since e10s-multi is going to be enabled by default, this gives us the ability
to run junit in a secondary, e10s-single configuration so that we can see them
both side-by-side for a little while, at least until we're settled in with the
e10s-multi configuration.

Differential Revision: https://phabricator.services.mozilla.com/D94883
2020-11-23 17:16:07 +00:00
Andrew Erickson
e4f7926525 Bug 1665012: configure taskgraph to send jobs to s7g devices at bitbar r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D100157
2020-12-18 21:38:02 +00:00
James Graham
a262b8fcd1 Bug 1680752 - Provide a python-3 opt-in for tests on Taskcluster, , bhearsum r=bc,bhearsum
This requires tests to specify `python-3: true` in order to be run
with Python 3. When nothing is specified things work just like today,
so it's a more conservative change than the one in bug 1672181.

Obviously in the long term we will remove this and switch to Python 3
only, but this unblocks moving harnesses to py3 today.

Differential Revision: https://phabricator.services.mozilla.com/D98766
2020-12-10 14:02:38 +00:00
Mihai Alexandru Michis
bbf4165b83 Backed out changeset ea5674f9a511 (bug 1680752) for causing android failures.
CLOSED TREE
2020-12-09 23:06:23 +02:00
James Graham
3006b268f8 Bug 1680752 - Provide a python-3 opt-in for tests on Taskcluster, , bhearsum r=bc,bhearsum
This requires tests to specify `python-3: true` in order to be run
with Python 3. When nothing is specified things work just like today,
so it's a more conservative change than the one in bug 1672181.

Obviously in the long term we will remove this and switch to Python 3
only, but this unblocks moving harnesses to py3 today.

Differential Revision: https://phabricator.services.mozilla.com/D98766
2020-12-09 16:49:23 +00:00
Sebastian Hengst
2236e7a29e Bug 1681319 - add macOS DevEdition with WebRender enabled as Tier 1 platform. r=jmaher DONTBUILD
Triggered by the platform name change in bug 1673071 when macOS switched to
running its tests with WebRender enabled.

Differential Revision: https://phabricator.services.mozilla.com/D99095
2020-12-08 15:17:47 +00:00
Kimberly Sereduck
8c3e5ed2f2 Bug 1674851 - Add chromedriver for Chrome 87 r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D98357
2020-12-02 17:12:51 +00:00
Razvan Maries
ff57a8dc87 Backed out changeset f5532b7dc480 (bug 1672181) as per Gregory's request. CLOSED TREE 2020-12-01 17:12:11 +02:00
Jeff Gilbert
e6f8d6a0fb Bug 1662516 - Enable m-gli on Linux. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D95096
2020-11-30 18:13:19 +00:00
Andrew Halberstadt
a984c9d503 Bug 1672181 - [taskgraph] Make test tasks py3 by default and add a py2 override r=bc,bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D97669
2020-11-26 17:42:27 +00:00
Bogdan Tara
0fb328ed0e Backed out changeset 951e6717abf4 (bug 1662516) for M-gli failures CLOSED TREE 2020-11-30 09:19:00 +02:00
Jeff Gilbert
89f293b7cc Bug 1662516 - Enable m-gli on Linux. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D95096
2020-11-30 05:44:33 +00:00
Razvan Maries
db8069855e Backed out changeset a39c15378e6f (bug 1672181) for Mochitest perma failures. CLOSED TREE 2020-11-26 19:38:22 +02:00
Andrew Halberstadt
3e58236aa7 Bug 1672181 - [taskgraph] Make test tasks py3 by default and add a py2 override r=bc,bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D97669
2020-11-20 21:45:17 +00:00
Cristina Coroiu
9be43c520a Backed out 2 changesets (bug 1654817) on request by aklotz
Backed out changeset bf721cd8ab14 (bug 1654817)
Backed out changeset fb1c314e6394 (bug 1654817)
2020-11-23 19:12:29 +02:00
Jeff Gilbert
1db30c5291 Bug 1607940 - Extend m-gli variant use until 2021-02-01. r=jmaher DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D97373
2020-11-17 22:01:02 +00:00
Mike Hommey
3e3f1aea03 Bug 1677020 - Always cap try tasks to a 28 days expiry. r=taskgraph-reviewers,jmaher
Currently, if a task defines its own expiry with a very large value,
that will be respected even on try, where we actually don't want that to
happen.

This also helps simplify the setup for docker images.

We also take on the occasion to remove the discrepancy between the
default expiry for tasks in general and tests in particular. Bug 1258497
set the original expiry to 14 days, bug 1281004 added another place
where the expiry was set to 14 days for tests specifically, and then bug
1304180 changed the expiry to 28 days, but it just seems the location
for tests was overlooked rather than deliberately left to 14 days.

Differential Revision: https://phabricator.services.mozilla.com/D96962
2020-11-16 23:51:22 +00:00
Aaron Klotz
a38b3481af Bug 1654817: Part 1 - Convert e10s-multi transform to an e10s-single transform; r=taskgraph-reviewers,jmaher
Since e10s-multi is going to be enabled by default, this gives us the ability
to run junit in a secondary, e10s-single configuration so that we can see them
both side-by-side for a little while, at least until we're settled in with the
e10s-multi configuration.

Differential Revision: https://phabricator.services.mozilla.com/D94883
2020-11-04 17:26:14 +00:00
Sebastian Hengst
094bc841d8 Bug 1675086 - drop references to 'pgo' platforms for Linux and Windows. r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D95802
2020-11-03 22:45:54 +00:00
Sebastian Hengst
6b1a4f95cc Bug 1675051 - run Linux DevEdition tests as the expected tier 1. r=jmaher DONTBUILD
The migration of the task images from Ubuntu 16.04 to Ubuntu 18.04 in
bug 1602863 added the Ubuntu version to the platform. The platform of Linux x64
DevEdition didn't get added and used the default tier 2. We don't run tests
for Linux 32-bit anymore.

Differential Revision: https://phabricator.services.mozilla.com/D95754
2020-11-03 16:48:53 +00:00
Agi Sferro
f1512643d4 Bug 1673100 - Add version of gv-junit that runs with fission. r=esawin,ahal
Differential Revision: https://phabricator.services.mozilla.com/D95062
2020-11-02 19:39:38 +00:00
Kartikaya Gupta
f9f91afa10 Bug 1669478 - Enable WebRender on most of the windows10-64 ccov tests. r=ahal,jrmuizel
This moves most of the windows ccov tests to run with WebRender enabled by
putting them in the windows10-64-ccov-qr test platform. (The -qr suffix causes
the taskgraph code to enable WebRender for these jobs).
The only one skipped is the marionette GPU test because it contains a test that
specifically requires WebRender disabled.

The existing non-regex config keys that referred to `windows10-64-ccov` also
get updated, and in a couple of places we need to add a new non-regex key to
disambiguate between two matching regex keys.

Differential Revision: https://phabricator.services.mozilla.com/D94769
2020-10-28 17:47:56 +00:00
Narcis Beleuzu
1400c85b87 Backed out 2 changesets (bug 1669478) for linting failure on tests.py . CLOSED TREE
Backed out changeset 995156a1234a (bug 1669478)
Backed out changeset 56e6528b37eb (bug 1669478)
2020-10-28 18:37:13 +02:00
Kartikaya Gupta
e29592194e Bug 1669478 - Enable WebRender on most of the windows10-64 ccov tests. r=ahal,jrmuizel
This moves most of the windows ccov tests to run with WebRender enabled by
putting them in the windows10-64-ccov-qr test platform. (The -qr suffix causes
the taskgraph code to enable WebRender for these jobs).
The only one skipped is the marionette GPU test because it contains a test that
specifically requires WebRender disabled.

The existing non-regex config keys that referred to `windows10-64-ccov` also
get updated, and in a couple of places we need to add a new non-regex key to
disambiguate between two matching regex keys.

Differential Revision: https://phabricator.services.mozilla.com/D94769
2020-10-28 16:23:20 +00:00
Jeff Gilbert
eb6fc48a96 Bug 1662603 - Enable m-gli on Windows. r=ahal
Disable webgl-ipc variant on .*-ccov/.* platforms.

Differential Revision: https://phabricator.services.mozilla.com/D92816
2020-10-28 00:14:18 +00:00
Aaron Klotz
122e4ecc08 Bug 1650118: Part 6 - Update test harnesses; r=bc,sparky,perftest-reviewers,jgraham
e10s is no longer a GeckoView option, so I'd like to remove it from test
harnesses when possible.

Depends on D90934

Differential Revision: https://phabricator.services.mozilla.com/D91640
2020-10-27 18:16:30 +00:00
Razvan Maries
23d2a4f2f7 Backed out 8 changesets (bug 1650118) for wpt failures on inside-dedicated-worker.html. CLOSED TREE
Backed out changeset ab6218dd84f5 (bug 1650118)
Backed out changeset a99d1aae6e2e (bug 1650118)
Backed out changeset ed357b8bb07e (bug 1650118)
Backed out changeset cd5155e732d9 (bug 1650118)
Backed out changeset 63cc752924f2 (bug 1650118)
Backed out changeset 7f0a281a399e (bug 1650118)
Backed out changeset 0fd77fef3c95 (bug 1650118)
Backed out changeset f397e86fd61e (bug 1650118)
2020-10-27 18:39:11 +02:00
Aaron Klotz
5276973bb8 Bug 1650118: Part 6 - Update test harnesses; r=bc,sparky,perftest-reviewers,jgraham
e10s is no longer a GeckoView option, so I'd like to remove it from test
harnesses when possible.

Depends on D90934

Differential Revision: https://phabricator.services.mozilla.com/D91640
2020-10-27 11:41:28 +00:00
Ricky Stewart
31b8ca9716 Bug 1654103: Standardize on Black for Python code in mozilla-central.
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Make some ad-hoc manual updates to `testing/marionette/client/setup.py`, `testing/marionette/harness/setup.py`, and `testing/firefox-ui/harness/setup.py`, which have hard-coded regexes that break after the reformat.

5. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-26 18:34:53 +00:00
Bogdan Tara
612312a64c Backed out 10 changesets (bug 1654103, bug 1672023, bug 1518999) for PanZoomControllerTest.touchEventForResult gv-junit failures CLOSED TREE
Backed out changeset ff3fb0b4a512 (bug 1672023)
Backed out changeset e7834b600201 (bug 1654103)
Backed out changeset 807893ca8069 (bug 1518999)
Backed out changeset 13e6b92440e9 (bug 1518999)
Backed out changeset 8b2ac5a6c98a (bug 1518999)
Backed out changeset 575748295752 (bug 1518999)
Backed out changeset 65f07ce7b39b (bug 1518999)
Backed out changeset 4bb80556158d (bug 1518999)
Backed out changeset 8ac8461d7bd7 (bug 1518999)
Backed out changeset e8ba13ee17f5 (bug 1518999)
2020-10-24 03:36:18 +03:00
Ricky Stewart
065d2eb893 Bug 1654103: Standardize on Black for Python code in mozilla-central. r=remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers,devtools-backward-compat-reviewers,jgilbert,preferences-reviewers,sylvestre,maja_zf,webcompat-reviewers,denschub,ntim,whimboo,sparky
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Make some ad-hoc manual updates to `testing/marionette/client/setup.py`, `testing/marionette/harness/setup.py`, and `testing/firefox-ui/harness/setup.py`, which have hard-coded regexes that break after the reformat.

5. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-23 20:40:42 +00:00
Dorel Luca
95b44c982f Backed out changeset 7558c8821a07 (bug 1654103) for multiple failures. CLOSED TREE 2020-10-22 03:51:06 +03:00
Ricky Stewart
43baed3c18 Bug 1654103: Standardize on Black for Python code in mozilla-central. r=remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers,devtools-backward-compat-reviewers,jgilbert,preferences-reviewers,sylvestre,maja_zf,webcompat-reviewers,denschub,ntim,whimboo,sparky
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-21 21:27:27 +00:00
Razvan Maries
c0a9dd04c2 Backed out 6 changesets (bug 1650118) as per Aaron's request. CLOSED TREE
Backed out changeset 4a7fc6398ad6 (bug 1650118)
Backed out changeset b9fa3dd9c05d (bug 1650118)
Backed out changeset 2cb9109dee0a (bug 1650118)
Backed out changeset a6ca38804021 (bug 1650118)
Backed out changeset 66b9527aecad (bug 1650118)
Backed out changeset 74fd3eb970a6 (bug 1650118)
2020-10-21 07:32:57 +03:00
Aaron Klotz
88adf5021d Bug 1650118: Part 6 - Update test harnesses; r=bc,sparky,perftest-reviewers
e10s is no longer a GeckoView option, so I'd like to remove it from test
harnesses when possible.

Differential Revision: https://phabricator.services.mozilla.com/D91640
2020-10-19 18:17:16 +00:00
Kartikaya Gupta
8d1cfb68b9 Bug 1671193 - Don't try to set prefs in jittests as it doesn't work. r=jrmuizel
Differential Revision: https://phabricator.services.mozilla.com/D93575
2020-10-14 20:37:29 +00:00
Cosmin Sabou
3a2662dc32 Backed out changeset b8ba96c90d81 (bug 1662603) for busting gecko decision task. CLOSED TREE 2020-10-14 07:28:16 +03:00
Jeff Gilbert
a54a0083a2 Bug 1662603 - Enable m-gli on Windows. r=ahal
Disable webgl-ipc variant on .*-ccov/.* platforms.

Differential Revision: https://phabricator.services.mozilla.com/D92816
2020-10-13 20:24:47 +00:00
Gregory Mierzwinski
6105193325 Bug 1669534 - Run chrome/chromium pageload tests in browsertime. r=perftest-reviewers,Bebe
This patch fixes various issues that prevented us from running chromium/chrom in raptor-browsertime.
(1) Chromium fetch task now also fetches the latest chromedriver.
(2) FFMPEG failures when recording on chrome/chromium.
(3) Various changes where chromium wasn't considered as a variant of chrome.

Differential Revision: https://phabricator.services.mozilla.com/D92646
2020-10-13 20:36:52 +00:00
Jamie Nicol
ab950d0a54 Bug 1595794 - Run geckoview-junit tests on emulator with webrender enabled. r=geckoview-reviewers,jmaher,agi
Differential Revision: https://phabricator.services.mozilla.com/D52682
2020-10-12 10:34:29 +00:00
Gregory Mierzwinski
957dea8984 Bug 1669783 - Add chromedriver for chrome 86. r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D92801
2020-10-08 13:53:34 +00:00
Jeff Gilbert
b557c0eee9 Bug 1669383 - Force default mochitest-webgl runs to use webgl.out-of-process:false. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D92530
2020-10-07 17:33:13 +00:00
Andrew Halberstadt
bb4ee0dd5b Bug 1643689 - [taskgraph] Replace 'CHUNK_SUITES_BLACKLIST' with the 'test_manifest_loader' key, r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D91588
2020-09-29 16:03:49 +00:00
Andrew Halberstadt
e19c92a846 Bug 1643689 - [taskgraph] Allow tasks to override the configured 'test_manifest_loader', r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D91587
2020-09-29 17:36:01 +00:00
Dorel Luca
acfc8f3c24 Backed out 3 changesets (bug 1643689) for Gecko Decision Task failure. CLOSED TREE
Backed out changeset 2912d91dd291 (bug 1643689)
Backed out changeset 50195a6883bf (bug 1643689)
Backed out changeset 6c2a31b47d0b (bug 1643689)
2020-09-29 19:00:55 +03:00