Commit Graph

116 Commits

Author SHA1 Message Date
Mike Hommey
5dc3361585 Bug 1689467 - Use mozharness virtualenv python to run custom mach commands. r=releng-reviewers,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D103447
2021-01-29 12:08:33 +00:00
James Graham
a262b8fcd1 Bug 1680752 - Provide a python-3 opt-in for tests on Taskcluster, , bhearsum r=bc,bhearsum
This requires tests to specify `python-3: true` in order to be run
with Python 3. When nothing is specified things work just like today,
so it's a more conservative change than the one in bug 1672181.

Obviously in the long term we will remove this and switch to Python 3
only, but this unblocks moving harnesses to py3 today.

Differential Revision: https://phabricator.services.mozilla.com/D98766
2020-12-10 14:02:38 +00:00
Mihai Alexandru Michis
bbf4165b83 Backed out changeset ea5674f9a511 (bug 1680752) for causing android failures.
CLOSED TREE
2020-12-09 23:06:23 +02:00
James Graham
3006b268f8 Bug 1680752 - Provide a python-3 opt-in for tests on Taskcluster, , bhearsum r=bc,bhearsum
This requires tests to specify `python-3: true` in order to be run
with Python 3. When nothing is specified things work just like today,
so it's a more conservative change than the one in bug 1672181.

Obviously in the long term we will remove this and switch to Python 3
only, but this unblocks moving harnesses to py3 today.

Differential Revision: https://phabricator.services.mozilla.com/D98766
2020-12-09 16:49:23 +00:00
Razvan Maries
ff57a8dc87 Backed out changeset f5532b7dc480 (bug 1672181) as per Gregory's request. CLOSED TREE 2020-12-01 17:12:11 +02:00
Andrew Halberstadt
a984c9d503 Bug 1672181 - [taskgraph] Make test tasks py3 by default and add a py2 override r=bc,bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D97669
2020-11-26 17:42:27 +00:00
stransky
9b6f03cc87 Bug 1665844 [Wayland] Fix mutter to start in Wayland mode in Mozilla automation, r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D97161
2020-11-30 07:10:57 +00:00
Razvan Maries
db8069855e Backed out changeset a39c15378e6f (bug 1672181) for Mochitest perma failures. CLOSED TREE 2020-11-26 19:38:22 +02:00
Andrew Halberstadt
3e58236aa7 Bug 1672181 - [taskgraph] Make test tasks py3 by default and add a py2 override r=bc,bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D97669
2020-11-20 21:45:17 +00:00
Noemi Erli
44f9a1d543 Backed out changeset c5f7092adb7a (bug 1665844) for causing mass mochitest automation errors CLOSED TREE 2020-11-17 05:50:06 +02:00
stransky
63b8729e79 Bug 1665844 [Wayland] Fix mutter to start in Wayland mode in Mozilla automation, r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D97161
2020-11-16 18:52:09 +00:00
Andrew Halberstadt
4fe34b143a Bug 1673992 - [taskgraph] Ensure we stop extracting mozharness.zip in the cwd r=bhearsum
Rather than putting a top-level "mozharness" directory in "mozharness.zip",
this puts the root of mozharness at the root of the archive. Then we extract
the archive into a "mozharness" directory. This way the path on disk ends up
being the same, but generic-worker won't attempt to modify the permissions of
files in the cwd.

Differential Revision: https://phabricator.services.mozilla.com/D95138
2020-10-30 13:32:01 +00:00
Razvan Maries
d6cb800212 Backed out changeset e281605f0fd2 (bug 1673992) for Android wrench bustage. CLOSED TREE 2020-10-29 23:10:22 +02:00
Andrew Halberstadt
3a9dda9cc3 Bug 1673992 - [taskgraph] Ensure we stop extracting mozharness.zip in the cwd r=bhearsum
Rather than putting a top-level "mozharness" directory in "mozharness.zip",
this puts the root of mozharness at the root of the archive. Then we extract
the archive into a "mozharness" directory. This way the path on disk ends up
being the same, but generic-worker won't attempt to modify the permissions of
files in the cwd.

Differential Revision: https://phabricator.services.mozilla.com/D95138
2020-10-29 17:30:56 +00:00
stransky
3787265c10 Bug 1663159 [Linux] Add Wayland config to test-linux.sh, r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D89287
2020-09-16 09:48:15 +00:00
Cristina Coroiu
b6828ef69a Backed out changeset 5349493670b9 (bug 1663159) for mass failures on a CLOSED TREE 2020-09-09 17:58:56 +03:00
stransky
fd0e023794 Bug 1663159 [Linux] Add Wayland config to test-linux.sh, r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D89287
2020-09-09 13:34:02 +00:00
Butkovits Atila
d6eeb350e1 Backed out 3 changesets (bug 1648851) for webgl issues. CLOSED TREE
Backed out changeset 1f0d6e32a0f4 (bug 1648851)
Backed out changeset df5ec3dbab05 (bug 1648851)
Backed out changeset fbda45ebde5c (bug 1648851)
2020-07-20 12:44:43 +03:00
Edwin Takahashi
e3cbc79884 Bug 1648851 - Part 2: create android-specific bootstrapping script r=jmaher,gbrown
Changes:
  - create a `test-android.sh` script that is based on, but removes non-android related paths from the `test-linux.sh` script.

Differential Revision: https://phabricator.services.mozilla.com/D82252
2020-07-17 22:02:41 +00:00
Razvan Maries
e7753b4ebd Backed out 4 changesets (bug 1648851) for perma failues on test_2_conformance2__glsl3__matrix-row-major-dynamic-indexing.html and test_2_conformance__state__gl-get-calls.html. CLOSED TREE
Backed out changeset 2d2686a389dc (bug 1648851)
Backed out changeset e05b2f2fdbb2 (bug 1648851)
Backed out changeset b576e680a9fa (bug 1648851)
Backed out changeset 901f16e24a60 (bug 1648851)
2020-07-17 02:19:47 +03:00
Edwin Takahashi
e5cff168d0 Bug 1648851 - Part 2: create android-specific bootstrapping script r=jmaher,gbrown
Changes:
  - create a `test-android.sh` script that is based on, but removes non-android related paths from the `test-linux.sh` script.

Differential Revision: https://phabricator.services.mozilla.com/D82252
2020-07-14 22:51:40 +00:00
Edwin Takahashi
7f01954dc6 Bug 1648674 - fix unary operator expected error in test-liux.sh r=glandium
Changes:
  - use parameter expansion to provide a default value of 'false' if `$NEED_COMPIZ` is not set.

Differential Revision: https://phabricator.services.mozilla.com/D81388
2020-07-02 23:03:49 +00:00
Edwin Takahashi
baa29d664f Bug 1648846 - more robust detection in conditional for xwit to be called in test-linux.sh r=jmaher
Changes:
  - instead of relying only on `$DISPLAY` env var, also use `$NEED_WINDOW_MANAGER` in the check.

Differential Revision: https://phabricator.services.mozilla.com/D81398
2020-06-27 09:19:17 +00:00
Edwin Takahashi
ddc80ceb05 Bug 1607713 - install xwit in ubuntu1804 docker image and set cursor position to 0,0 r=karlt
Changes:
  - install `xwit` package in the ubuntu1804 docker image setup phase.
  - in `test-linux.sh` call xwit to reposition the cursor to a coodinate of 0,0

Differential Revision: https://phabricator.services.mozilla.com/D80698
2020-06-25 18:02:11 +00:00
Mitchell Hentges
10a6419097 Bug 1621960: Change |mach python| default from Python 2 to Python 3 r=rstewart
Depends on D77967

Differential Revision: https://phabricator.services.mozilla.com/D78181
2020-06-10 16:10:08 +00:00
Noemi Erli
62dae1f653 Backed out 4 changesets (bug 1621960) for causing Android bustages CLOSED TREE
Backed out changeset f36a95234a5f (bug 1621960)
Backed out changeset 0e4661c9061d (bug 1621960)
Backed out changeset 3e2cbe4dd777 (bug 1621960)
Backed out changeset d7eb101e5df7 (bug 1621960)
2020-06-09 20:59:26 +03:00
Mitchell Hentges
3e7f18b523 Bug 1621960: Change |mach python| default from Python 2 to Python 3 r=rstewart
Depends on D77967

Differential Revision: https://phabricator.services.mozilla.com/D78181
2020-06-09 16:44:51 +00:00
Mitchell Hentges
1236d6b0dc Bug 1642411: Removes unused test-macosx.sh script r=ahal
A grep through the repository and a brief discussion with #releng seems to point towards this script not being used.

Differential Revision: https://phabricator.services.mozilla.com/D77689
2020-06-02 18:55:35 +00:00
Edwin Takahashi
e58a0045a6 Bug 1641395 - install amd64 variants of existing i386 packages and insert additional startup parameters for pulseaudio r=jmaher
Changes:
  - install the `amd64` variants of various packages alongside `i386` packages
  - install `amd64` version of `fontconfig` instead
  - additional command line arguments for pulseaudio initialization
  - do not add configuration files to `~/.pulse` in the docker image

Differential Revision: https://phabricator.services.mozilla.com/D77512
2020-06-01 20:44:47 +00:00
Narcis Beleuzu
cfb8426c47 Backed out changeset 4123014cf744 (bug 1633101) for Linting failure on runtests.py . CLOSED TREE 2020-05-14 02:14:18 +03:00
egao
eb4781bc29 Bug 1633101 - consolidate pulseaudio initialization process on linux and migrate to x64 fontconfig package r=jmaher
Changes:

While the ubuntu1804 migration work was taking place, `pulseaudio` related pieces of code were sprinkled across a wide variety of modules.

Now that things have settled down, remove and streamline `pulseaudio` initialization so that there are less places for this to go wrong.

Differential Revision: https://phabricator.services.mozilla.com/D74809
2020-05-13 21:46:55 +00:00
Razvan Maries
0e95e4c5b2 Backed out 2 changesets (bug 1633101) for perma failures at test_getUserMedia_basicAudio_loopback.html. CLOSED TREE
Backed out changeset b85aebbd6fcc (bug 1633101)
Backed out changeset fd6537bc153f (bug 1633101)
2020-05-13 03:47:10 +03:00
Edwin Takahashi
7673ffd668 Bug 1633101 - remove redundant pulseaudio initializations for linux tests r=jmaher
Changes:

While the ubuntu1804 migration work was taking place, `pulseaudio` related pieces of code were sprinkled across a wide variety of modules.

Now that things have settled down, remove and streamline `pulseaudio` initialization so that there are less places for this to go wrong.

Differential Revision: https://phabricator.services.mozilla.com/D74809
2020-05-12 20:59:43 +00:00
Razvan Maries
1f2ac9bc6d Backed out changeset ce270ccc8290 (bug 1633101) for perma failures at test_getUserMedia_basicAudio_loopback.html. CLOSED TREE 2020-05-12 23:55:42 +03:00
Edwin Takahashi
51c82ed110 Bug 1633101 - remove redundant pulseaudio initializations for linux tests r=jmaher
Changes:

While the ubuntu1804 migration work was taking place, `pulseaudio` related pieces of code were sprinkled across a wide variety of modules.

Now that things have settled down, remove and streamline `pulseaudio` initialization so that there are less places for this to go wrong.

Differential Revision: https://phabricator.services.mozilla.com/D74809
2020-05-12 12:20:45 +00:00
Geoff Brown
9a3cc245dd Bug 1612345 - Ensure that most custom retriggers repeat the original task by default; r=bc
Various updates to the custom retrigger action so that, without any custom changes to
parameters, the retriggered task runs with the same parameters as the original task.
Several issues were found and corrected, notably:
 - parameters like --allow-software-gl-layers were ignored
 - MOZHARNESS_TEST_PATHS was ignored
 - many parameter customizations in the desktop mozharness configs were ignored
 - mochitest suite/subsuite/flavor selection was not always correct
 - using repeat=1 by default meant that each test ran twice

Differential Revision: https://phabricator.services.mozilla.com/D70457
2020-04-17 22:11:02 +00:00
Edwin Takahashi
ad1b5ede1f Bug 1621483 - set up separate enviornment for linux1804 marionette and web-platform-tests-wdspec r=jmaher,marionette-reviewers,whimboo
Changes:

As documented in bug 1621483, `marionette` experiences a non-trivial amount of issues when run on ubuntu1804 docker image with GTK/GNOME desktop environment enabled.

GTK/GNOME has a higher degree of asynciness when manipulating window size/position and this leads to `marionette` and the derived suite `web-platform-tests-wdspec` reporting intermittent oranges for a number of tests.

While attempts were made to incorporate a fix for the marionette driver itself, the best attempts have only been able to achieve a ~50% reliability in green runs.

This patch reintroduces the use of bare `compiz` window manager exclusively for these two problematic test suites so that at least the tests are running on non-legacy software.

Differential Revision: https://phabricator.services.mozilla.com/D66482
2020-03-12 21:43:56 +00:00
Edwin Takahashi
d73d26de50 Bug 1610069 - remove NEED_COMPIZ flag throught the tree r=gbrown
Changes:

Bug 1552563 introduced the notion that `compiz` should only be run where it was required. This was an attempt to save some seconds through the CI system as `compiz` takes 15 seconds to return an exit code.

Now that majority of tests are running under ubuntu1804, which runs the GNOME desktop environment, the flag `NEED_COMPIZ` is no longer necessary.

Differential Revision: https://phabricator.services.mozilla.com/D60342
2020-01-20 19:31:34 +00:00
Edwin Takahashi
655edfc0c8 Bug 1596526 - use docker entrypoint to initialize dbus for Ubuntu 18.04 test image and set desktop session parameters accordingly in test-linux.sh r=jmaher
Changes:

Properly detect the distribution and release-version, and set the desktop session variable in `test-linux.sh` appropriately.

Use docker `entrypoint` for initializing `dbus`.

This change is critical for reducing the number of failures on GNOME-shell based systems, such as Ubuntu 18.04 as outlined in bug 1596526 comment 0.

Differential Revision: https://phabricator.services.mozilla.com/D53089
2019-11-23 02:10:04 +00:00
Edwin Takahashi
f5a50bca50 Bug 1565332 - change how pulseaudio is initialized for Debian 10 test image without affecting existing Ubuntu 16.04 process r=jlund,dustin
Changes:
- for Debian platforms, do not initialize pulseaudio in `test-linux.sh`; instead initialize pulseaudio if required in the `desktop_unittest.py` mozharness script

Differential Revision: https://phabricator.services.mozilla.com/D45768
2019-10-21 16:34:43 +00:00
Edwin Takahashi
eb2ca2644d Bug 1565332 - restore set -e in the debian-specific block in test-linux.sh r=gbrown
I found that I did not restore the `set -e` flag after temporarily disabling it in the debian10-specific piece of experimental code in `test-linux.sh`, and this caused a bunch of my try pushes to register as successful despite having multiple unexpected failures.

Differential Revision: https://phabricator.services.mozilla.com/D44774
2019-09-06 13:37:54 +00:00
Edwin Takahashi
aea0e69fd3 Bug 1565332 - add new dockerfile for debian 10 (buster) test image and add necessary piping without switching the main CI pipeline from ubuntu 16.04 r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D42597
2019-08-31 09:59:43 +00:00
Tom Prince
fbdc39ba32 Bug 1553915: Check for mach binary before trying to use it to run python; r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D33175
2019-05-30 20:20:57 +00:00
Edwin Gao
af3c3c4e59 Bug 1552563 - remove mochitest-media from whitelist not requiring compiz CLOSED TREE
Summary:
Changes:
- remove `mochitest-media` from the whiteslist - compiz is required.

Test Plan: https://treeherder.mozilla.org/#/jobs?repo=try&resultStatus=pending%2Crunning%2Csuperseded%2Cusercancel%2Cretry%2Csuccess%2Ctestfailed%2Cbusted%2Cexception&classifiedState=unclassified&group_state=expanded&revision=f16b0ce4af9e575ef2ec877b405698c0b0c62f92

Reviewers: jmaher, gbrown

Bug #: 1552563

Differential Revision: https://phabricator.services.mozilla.com/D32383
2019-05-23 23:53:21 +03:00
Andreea Pavel
ed4501236c Backed out changeset 52e365586577 (bug 1552563) for failing test_getUserMedia_basicScreenshare.html on a CLOSED TREE 2019-05-23 23:52:19 +03:00
Edwin Gao
00ed40302b Bug 1552563 - do not run compiz on linux tests unless needed by tests r=jmaher
Changes:

- removed UBUNTU_1604 detection mechanism at top of `test-linux.sh` file, since all tests are run on Ubuntu 16.04 anyway
- added new environment value `NEED_COMPIZ`, defaulting to `true`, which will inform the test if compiz is required for tests
- from `test-linux.sh` remove unconditional invocation of compiz, and replace it with detection of `NEED_COMPIZ` environment variable

Differential Revision: https://phabricator.services.mozilla.com/D31724
2019-05-21 16:33:43 +00:00
Edwin Gao
887e9b4328 Bug 1548924 - task efficiency: remove sleep 15 clause from test-linux.sh r=gbrown,jmaher CLOSED TREE
Changes:
- remove the `sleep 15` clause.

Differential Revision: https://phabricator.services.mozilla.com/D30251
2019-05-07 23:06:53 +00:00
Mihai Alexandru Michis
b2f1c74141 Backed out changeset 0e9e744accd3 (bug 1548924) for causing leaks 2019-05-08 09:35:04 +03:00
Edwin Gao
afe14942a5 Bug 1548924 - task efficiency: remove sleep 15 clause from test-linux.sh r=gbrown,jmaher
Changes:
- remove the `sleep 15` clause.

Differential Revision: https://phabricator.services.mozilla.com/D30251
2019-05-07 23:06:53 +00:00
Andrew Halberstadt
4e2e62f97e Bug 1195299 - [ci] Use 'mach python' to run mozharness scripts when we have a srcdir r=catlee
This makes sure that the mozharness scripts have access to all the packages in
the build system virtualenv (namely mozbase).

Differential Revision: https://phabricator.services.mozilla.com/D22184
2019-04-05 15:39:50 +00:00