Commit Graph

69 Commits

Author SHA1 Message Date
Mike Hommey
5dc3361585 Bug 1689467 - Use mozharness virtualenv python to run custom mach commands. r=releng-reviewers,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D103447
2021-01-29 12:08:33 +00:00
James Graham
a262b8fcd1 Bug 1680752 - Provide a python-3 opt-in for tests on Taskcluster, , bhearsum r=bc,bhearsum
This requires tests to specify `python-3: true` in order to be run
with Python 3. When nothing is specified things work just like today,
so it's a more conservative change than the one in bug 1672181.

Obviously in the long term we will remove this and switch to Python 3
only, but this unblocks moving harnesses to py3 today.

Differential Revision: https://phabricator.services.mozilla.com/D98766
2020-12-10 14:02:38 +00:00
Mihai Alexandru Michis
bbf4165b83 Backed out changeset ea5674f9a511 (bug 1680752) for causing android failures.
CLOSED TREE
2020-12-09 23:06:23 +02:00
James Graham
3006b268f8 Bug 1680752 - Provide a python-3 opt-in for tests on Taskcluster, , bhearsum r=bc,bhearsum
This requires tests to specify `python-3: true` in order to be run
with Python 3. When nothing is specified things work just like today,
so it's a more conservative change than the one in bug 1672181.

Obviously in the long term we will remove this and switch to Python 3
only, but this unblocks moving harnesses to py3 today.

Differential Revision: https://phabricator.services.mozilla.com/D98766
2020-12-09 16:49:23 +00:00
Razvan Maries
ff57a8dc87 Backed out changeset f5532b7dc480 (bug 1672181) as per Gregory's request. CLOSED TREE 2020-12-01 17:12:11 +02:00
Andrew Halberstadt
a984c9d503 Bug 1672181 - [taskgraph] Make test tasks py3 by default and add a py2 override r=bc,bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D97669
2020-11-26 17:42:27 +00:00
stransky
9b6f03cc87 Bug 1665844 [Wayland] Fix mutter to start in Wayland mode in Mozilla automation, r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D97161
2020-11-30 07:10:57 +00:00
Razvan Maries
db8069855e Backed out changeset a39c15378e6f (bug 1672181) for Mochitest perma failures. CLOSED TREE 2020-11-26 19:38:22 +02:00
Andrew Halberstadt
3e58236aa7 Bug 1672181 - [taskgraph] Make test tasks py3 by default and add a py2 override r=bc,bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D97669
2020-11-20 21:45:17 +00:00
Noemi Erli
44f9a1d543 Backed out changeset c5f7092adb7a (bug 1665844) for causing mass mochitest automation errors CLOSED TREE 2020-11-17 05:50:06 +02:00
stransky
63b8729e79 Bug 1665844 [Wayland] Fix mutter to start in Wayland mode in Mozilla automation, r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D97161
2020-11-16 18:52:09 +00:00
Andrew Halberstadt
4fe34b143a Bug 1673992 - [taskgraph] Ensure we stop extracting mozharness.zip in the cwd r=bhearsum
Rather than putting a top-level "mozharness" directory in "mozharness.zip",
this puts the root of mozharness at the root of the archive. Then we extract
the archive into a "mozharness" directory. This way the path on disk ends up
being the same, but generic-worker won't attempt to modify the permissions of
files in the cwd.

Differential Revision: https://phabricator.services.mozilla.com/D95138
2020-10-30 13:32:01 +00:00
Razvan Maries
d6cb800212 Backed out changeset e281605f0fd2 (bug 1673992) for Android wrench bustage. CLOSED TREE 2020-10-29 23:10:22 +02:00
Andrew Halberstadt
3a9dda9cc3 Bug 1673992 - [taskgraph] Ensure we stop extracting mozharness.zip in the cwd r=bhearsum
Rather than putting a top-level "mozharness" directory in "mozharness.zip",
this puts the root of mozharness at the root of the archive. Then we extract
the archive into a "mozharness" directory. This way the path on disk ends up
being the same, but generic-worker won't attempt to modify the permissions of
files in the cwd.

Differential Revision: https://phabricator.services.mozilla.com/D95138
2020-10-29 17:30:56 +00:00
stransky
3787265c10 Bug 1663159 [Linux] Add Wayland config to test-linux.sh, r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D89287
2020-09-16 09:48:15 +00:00
Cristina Coroiu
b6828ef69a Backed out changeset 5349493670b9 (bug 1663159) for mass failures on a CLOSED TREE 2020-09-09 17:58:56 +03:00
stransky
fd0e023794 Bug 1663159 [Linux] Add Wayland config to test-linux.sh, r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D89287
2020-09-09 13:34:02 +00:00
Edwin Takahashi
7f01954dc6 Bug 1648674 - fix unary operator expected error in test-liux.sh r=glandium
Changes:
  - use parameter expansion to provide a default value of 'false' if `$NEED_COMPIZ` is not set.

Differential Revision: https://phabricator.services.mozilla.com/D81388
2020-07-02 23:03:49 +00:00
Edwin Takahashi
baa29d664f Bug 1648846 - more robust detection in conditional for xwit to be called in test-linux.sh r=jmaher
Changes:
  - instead of relying only on `$DISPLAY` env var, also use `$NEED_WINDOW_MANAGER` in the check.

Differential Revision: https://phabricator.services.mozilla.com/D81398
2020-06-27 09:19:17 +00:00
Edwin Takahashi
ddc80ceb05 Bug 1607713 - install xwit in ubuntu1804 docker image and set cursor position to 0,0 r=karlt
Changes:
  - install `xwit` package in the ubuntu1804 docker image setup phase.
  - in `test-linux.sh` call xwit to reposition the cursor to a coodinate of 0,0

Differential Revision: https://phabricator.services.mozilla.com/D80698
2020-06-25 18:02:11 +00:00
Mitchell Hentges
10a6419097 Bug 1621960: Change |mach python| default from Python 2 to Python 3 r=rstewart
Depends on D77967

Differential Revision: https://phabricator.services.mozilla.com/D78181
2020-06-10 16:10:08 +00:00
Noemi Erli
62dae1f653 Backed out 4 changesets (bug 1621960) for causing Android bustages CLOSED TREE
Backed out changeset f36a95234a5f (bug 1621960)
Backed out changeset 0e4661c9061d (bug 1621960)
Backed out changeset 3e2cbe4dd777 (bug 1621960)
Backed out changeset d7eb101e5df7 (bug 1621960)
2020-06-09 20:59:26 +03:00
Mitchell Hentges
3e7f18b523 Bug 1621960: Change |mach python| default from Python 2 to Python 3 r=rstewart
Depends on D77967

Differential Revision: https://phabricator.services.mozilla.com/D78181
2020-06-09 16:44:51 +00:00
Edwin Takahashi
e58a0045a6 Bug 1641395 - install amd64 variants of existing i386 packages and insert additional startup parameters for pulseaudio r=jmaher
Changes:
  - install the `amd64` variants of various packages alongside `i386` packages
  - install `amd64` version of `fontconfig` instead
  - additional command line arguments for pulseaudio initialization
  - do not add configuration files to `~/.pulse` in the docker image

Differential Revision: https://phabricator.services.mozilla.com/D77512
2020-06-01 20:44:47 +00:00
Narcis Beleuzu
cfb8426c47 Backed out changeset 4123014cf744 (bug 1633101) for Linting failure on runtests.py . CLOSED TREE 2020-05-14 02:14:18 +03:00
egao
eb4781bc29 Bug 1633101 - consolidate pulseaudio initialization process on linux and migrate to x64 fontconfig package r=jmaher
Changes:

While the ubuntu1804 migration work was taking place, `pulseaudio` related pieces of code were sprinkled across a wide variety of modules.

Now that things have settled down, remove and streamline `pulseaudio` initialization so that there are less places for this to go wrong.

Differential Revision: https://phabricator.services.mozilla.com/D74809
2020-05-13 21:46:55 +00:00
Razvan Maries
0e95e4c5b2 Backed out 2 changesets (bug 1633101) for perma failures at test_getUserMedia_basicAudio_loopback.html. CLOSED TREE
Backed out changeset b85aebbd6fcc (bug 1633101)
Backed out changeset fd6537bc153f (bug 1633101)
2020-05-13 03:47:10 +03:00
Edwin Takahashi
7673ffd668 Bug 1633101 - remove redundant pulseaudio initializations for linux tests r=jmaher
Changes:

While the ubuntu1804 migration work was taking place, `pulseaudio` related pieces of code were sprinkled across a wide variety of modules.

Now that things have settled down, remove and streamline `pulseaudio` initialization so that there are less places for this to go wrong.

Differential Revision: https://phabricator.services.mozilla.com/D74809
2020-05-12 20:59:43 +00:00
Razvan Maries
1f2ac9bc6d Backed out changeset ce270ccc8290 (bug 1633101) for perma failures at test_getUserMedia_basicAudio_loopback.html. CLOSED TREE 2020-05-12 23:55:42 +03:00
Edwin Takahashi
51c82ed110 Bug 1633101 - remove redundant pulseaudio initializations for linux tests r=jmaher
Changes:

While the ubuntu1804 migration work was taking place, `pulseaudio` related pieces of code were sprinkled across a wide variety of modules.

Now that things have settled down, remove and streamline `pulseaudio` initialization so that there are less places for this to go wrong.

Differential Revision: https://phabricator.services.mozilla.com/D74809
2020-05-12 12:20:45 +00:00
Geoff Brown
9a3cc245dd Bug 1612345 - Ensure that most custom retriggers repeat the original task by default; r=bc
Various updates to the custom retrigger action so that, without any custom changes to
parameters, the retriggered task runs with the same parameters as the original task.
Several issues were found and corrected, notably:
 - parameters like --allow-software-gl-layers were ignored
 - MOZHARNESS_TEST_PATHS was ignored
 - many parameter customizations in the desktop mozharness configs were ignored
 - mochitest suite/subsuite/flavor selection was not always correct
 - using repeat=1 by default meant that each test ran twice

Differential Revision: https://phabricator.services.mozilla.com/D70457
2020-04-17 22:11:02 +00:00
Edwin Takahashi
ad1b5ede1f Bug 1621483 - set up separate enviornment for linux1804 marionette and web-platform-tests-wdspec r=jmaher,marionette-reviewers,whimboo
Changes:

As documented in bug 1621483, `marionette` experiences a non-trivial amount of issues when run on ubuntu1804 docker image with GTK/GNOME desktop environment enabled.

GTK/GNOME has a higher degree of asynciness when manipulating window size/position and this leads to `marionette` and the derived suite `web-platform-tests-wdspec` reporting intermittent oranges for a number of tests.

While attempts were made to incorporate a fix for the marionette driver itself, the best attempts have only been able to achieve a ~50% reliability in green runs.

This patch reintroduces the use of bare `compiz` window manager exclusively for these two problematic test suites so that at least the tests are running on non-legacy software.

Differential Revision: https://phabricator.services.mozilla.com/D66482
2020-03-12 21:43:56 +00:00
Edwin Takahashi
d73d26de50 Bug 1610069 - remove NEED_COMPIZ flag throught the tree r=gbrown
Changes:

Bug 1552563 introduced the notion that `compiz` should only be run where it was required. This was an attempt to save some seconds through the CI system as `compiz` takes 15 seconds to return an exit code.

Now that majority of tests are running under ubuntu1804, which runs the GNOME desktop environment, the flag `NEED_COMPIZ` is no longer necessary.

Differential Revision: https://phabricator.services.mozilla.com/D60342
2020-01-20 19:31:34 +00:00
Edwin Takahashi
655edfc0c8 Bug 1596526 - use docker entrypoint to initialize dbus for Ubuntu 18.04 test image and set desktop session parameters accordingly in test-linux.sh r=jmaher
Changes:

Properly detect the distribution and release-version, and set the desktop session variable in `test-linux.sh` appropriately.

Use docker `entrypoint` for initializing `dbus`.

This change is critical for reducing the number of failures on GNOME-shell based systems, such as Ubuntu 18.04 as outlined in bug 1596526 comment 0.

Differential Revision: https://phabricator.services.mozilla.com/D53089
2019-11-23 02:10:04 +00:00
Edwin Takahashi
f5a50bca50 Bug 1565332 - change how pulseaudio is initialized for Debian 10 test image without affecting existing Ubuntu 16.04 process r=jlund,dustin
Changes:
- for Debian platforms, do not initialize pulseaudio in `test-linux.sh`; instead initialize pulseaudio if required in the `desktop_unittest.py` mozharness script

Differential Revision: https://phabricator.services.mozilla.com/D45768
2019-10-21 16:34:43 +00:00
Edwin Takahashi
eb2ca2644d Bug 1565332 - restore set -e in the debian-specific block in test-linux.sh r=gbrown
I found that I did not restore the `set -e` flag after temporarily disabling it in the debian10-specific piece of experimental code in `test-linux.sh`, and this caused a bunch of my try pushes to register as successful despite having multiple unexpected failures.

Differential Revision: https://phabricator.services.mozilla.com/D44774
2019-09-06 13:37:54 +00:00
Edwin Takahashi
aea0e69fd3 Bug 1565332 - add new dockerfile for debian 10 (buster) test image and add necessary piping without switching the main CI pipeline from ubuntu 16.04 r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D42597
2019-08-31 09:59:43 +00:00
Tom Prince
fbdc39ba32 Bug 1553915: Check for mach binary before trying to use it to run python; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D33175
2019-05-30 20:20:57 +00:00
Edwin Gao
af3c3c4e59 Bug 1552563 - remove mochitest-media from whitelist not requiring compiz CLOSED TREE
Summary:
Changes:
- remove `mochitest-media` from the whiteslist - compiz is required.

Test Plan: https://treeherder.mozilla.org/#/jobs?repo=try&resultStatus=pending%2Crunning%2Csuperseded%2Cusercancel%2Cretry%2Csuccess%2Ctestfailed%2Cbusted%2Cexception&classifiedState=unclassified&group_state=expanded&revision=f16b0ce4af9e575ef2ec877b405698c0b0c62f92

Reviewers: jmaher, gbrown

Bug #: 1552563

Differential Revision: https://phabricator.services.mozilla.com/D32383
2019-05-23 23:53:21 +03:00
Andreea Pavel
ed4501236c Backed out changeset 52e365586577 (bug 1552563) for failing test_getUserMedia_basicScreenshare.html on a CLOSED TREE 2019-05-23 23:52:19 +03:00
Edwin Gao
00ed40302b Bug 1552563 - do not run compiz on linux tests unless needed by tests r=jmaher
Changes:

- removed UBUNTU_1604 detection mechanism at top of `test-linux.sh` file, since all tests are run on Ubuntu 16.04 anyway
- added new environment value `NEED_COMPIZ`, defaulting to `true`, which will inform the test if compiz is required for tests
- from `test-linux.sh` remove unconditional invocation of compiz, and replace it with detection of `NEED_COMPIZ` environment variable

Differential Revision: https://phabricator.services.mozilla.com/D31724
2019-05-21 16:33:43 +00:00
Edwin Gao
887e9b4328 Bug 1548924 - task efficiency: remove sleep 15 clause from test-linux.sh r=gbrown,jmaher CLOSED TREE
Changes:
- remove the `sleep 15` clause.

Differential Revision: https://phabricator.services.mozilla.com/D30251
2019-05-07 23:06:53 +00:00
Mihai Alexandru Michis
b2f1c74141 Backed out changeset 0e9e744accd3 (bug 1548924) for causing leaks 2019-05-08 09:35:04 +03:00
Edwin Gao
afe14942a5 Bug 1548924 - task efficiency: remove sleep 15 clause from test-linux.sh r=gbrown,jmaher
Changes:
- remove the `sleep 15` clause.

Differential Revision: https://phabricator.services.mozilla.com/D30251
2019-05-07 23:06:53 +00:00
Andrew Halberstadt
4e2e62f97e Bug 1195299 - [ci] Use 'mach python' to run mozharness scripts when we have a srcdir r=catlee
This makes sure that the mozharness scripts have access to all the packages in
the build system virtualenv (namely mozbase).

Differential Revision: https://phabricator.services.mozilla.com/D22184
2019-04-05 15:39:50 +00:00
Bogdan Tara
1aeb7a6046 Backed out 2 changesets (bug 1195299) for l10n bustages a=backout
Backed out changeset 9645ac1a9851 (bug 1195299)
Backed out changeset 4de7f94119fd (bug 1195299)
2019-04-05 14:11:45 +03:00
Andrew Halberstadt
a2140475ce Bug 1195299 - [ci] Use 'mach python' to run mozharness scripts when we have a srcdir r=catlee
This makes sure that the mozharness scripts have access to all the packages in
the build system virtualenv (namely mozbase).

Differential Revision: https://phabricator.services.mozilla.com/D22184
2019-04-04 18:41:12 +00:00
Mike Shal
43bbd255d4 Bug 632954 - Add support for MOZHARNESS_OPTIONS to test-linux.sh; r=tomprince
The mozharness.py transform passes in "options" parameters through the
MOZHARNESS_OPTIONS environment variable. This will allow the Android PGO
run task to pass in the mozharness script name to test-linux.sh

Differential Revision: https://phabricator.services.mozilla.com/D22822
2019-03-18 23:53:06 +00:00
Mike Shal
0c0df988a3 Bug 632954 - Add execute bit to test-linux.sh; r=tomprince
In order to call test-linux.sh with the job-script parameter, it needs
to have executable permissions.

Differential Revision: https://phabricator.services.mozilla.com/D22821
2019-03-18 23:53:01 +00:00
Noemi Erli
37aa5ac5f6 Backed out 12 changesets (bug 632954) for causing Android Bpgo(run) pending jobs CLOSED TREE
Backed out changeset 429c96e4de32 (bug 632954)
Backed out changeset de8beacc5eb4 (bug 632954)
Backed out changeset c151ebf303ca (bug 632954)
Backed out changeset b96dd954a456 (bug 632954)
Backed out changeset 26031d362333 (bug 632954)
Backed out changeset 097f141a499d (bug 632954)
Backed out changeset 6f5fc0d644dd (bug 632954)
Backed out changeset 53d3443e55d9 (bug 632954)
Backed out changeset 503bcac73583 (bug 632954)
Backed out changeset 142ae187478d (bug 632954)
Backed out changeset 0615c775a0cf (bug 632954)
Backed out changeset 3dfc0e4f8e7c (bug 632954)
2019-03-20 11:58:18 +02:00