Commit Graph

166 Commits

Author SHA1 Message Date
Alex Gaynor
478321d9d3 Bug 1294641 - whitelist reads from the .app directory in the macOS sandbox r=froydnj,haik
This patch does a few things:
a) Adds the resources location from the .app directory to the read whitelist
b) When it's a non-packaged build, mach run (and various mach tests) set an environment variable for the repo location which we allow reads from.

r=haik,froydnj

MozReview-Commit-ID: KNvAoUs5Ati
2017-04-07 14:53:19 -04:00
Sebastian Hengst
155e26d497 Backed out changeset 225683fed1d1 (bug 1294641) for breaking crashtests, reftests and Windows builds. r=backout on a CLOSED TREE 2017-04-17 16:29:52 +02:00
Alex Gaynor
d7af07ecbe Bug 1294641 - whitelist reads from the .app directory in the macOS sandbox r=froydnj,haik
This patch does a few things:
a) Adds the resources location from the .app directory to the read whitelist
b) When it's a non-packaged build, mach run (and various mach tests) set an environment variable for the repo location which we allow reads from.

r=haik,froydnj

MozReview-Commit-ID: KNvAoUs5Ati
2017-04-07 14:53:19 -04:00
Geoff Brown
eefd2fe813 Bug 1355222 - When debug logging requested for android mach test commands, enable devicemanager logging; r=jmaher 2017-04-11 09:21:37 -06:00
Wes Kocher
1ae5314550 Merge m-c to inbound, a=merge
MozReview-Commit-ID: GjXiiENYBmx
2017-03-21 16:20:08 -07:00
Geoff Brown
b72a74a2a6 Bug 1340584 - Remove devicemanagerSUT and references to sutagent; r=wlach
sutagent is no longer built or used; devicemanagerSUT is completely
unused. After this change, devicemanagerADB is the only implementation of
devicemanager, and test harness options like --dm_trans are eliminated.
2017-03-21 12:20:01 -06:00
Jan Henning
376f5627c0 Bug 1348114 - Use correct default path for Robocop APK when building with Gradle. r=nalexander
./mach robocop calls through to mochitest_options.py to validate the passed command line options, so it's not necessary to define a default Robocop APK path from two different places.

MozReview-Commit-ID: 8CryDqOKDBF
2017-03-16 22:22:25 +01:00
J. Ryan Stinnett
4eca0d1a79 Bug 929535 - Use wait-for-jsdebugger with mochitests. r=Gijs
By using --wait-for-jsdebugger, we can allow the test suite to start
automatically and also ensure the JS debugger has a chance to connect.

There's still an extra click to get the tests running though (at least on macOS)
because the test harness needs to be focused and the extra process used for the
Browser Toolbox removes the focus from it.

MozReview-Commit-ID: 1Eg7lqG3KST
2017-03-13 11:10:04 -05:00
Kartikaya Gupta
f9c9933d83 Bug 1341476 - Make the dump-dmd-after-test mochitest option work again. r=jmaher
MozReview-Commit-ID: 85oqrrzyYUR
2017-02-23 19:36:08 -05:00
Xidorn Quan
a96d0c0d0e Bug 1337674 part 3 - Add failure pattern file support to mochitest. r=jmaher
MozReview-Commit-ID: EcK8AJbXfwh
2017-02-16 16:41:50 +11:00
Bob Clary
a979244678 Bug 1279259 - make TURN server port configurable, r=jmaher. 2017-01-25 01:56:45 -08:00
Luke Wagner
79d58ceeb4 Bug 1332312 - remove JS_DISABLE_SLOW_SCRIPT_SIGNALS (r=bbouvier)
MozReview-Commit-ID: 6uyBGnbAimG
2017-01-19 14:06:24 -06:00
Andrew Halberstadt
a189067a1a Bug 1312739 - Use ALL_FLAVORS dict when running mochitest from an interactive loaner, r=jmaher
MozReview-Commit-ID: Kpxepe9KecV
2016-12-20 11:24:33 -05:00
Andrew Halberstadt
c687b7c9a9 Bug 1312739 - Move mochitest 'ALL_FLAVORS' dict from mach_commands.py to mochitest_options.py, r=jmaher
Information in the ALL_FLAVORS dict is needed by interactive loaners (in the mach_test_package_commands.py
file). Because the normal mach_commands.py file doesn't get copied to the tests.zip, this commit refactors
ALL_FLAVORS into mochitest_options.py (which is copied to tests.zip) to avoid duplicating it. A side
benefit of moving ALL_FLAVORS to mochitest_options.py, is that mochitest_options.py itself can make use of
this dict. This means we no longer need to redefine the --flavor argument in the mach command.

The __init__.py file is added to turn the testing/mochitest directory into a python module. This allows
things like mach_commands.py to do things like 'from mochitest import runtests'. Mach commands are able to
find this module because the 'testing' directory is already added to sys.path in the mach bootstrap.

In the future, having mochitest as an importable module should help with running it from the srcdir. So this
is a change we should start making anyway. Unfortunately, we still need to import the main runtests.py file
from the objdir, as lots of things depend on the SCRIPT_DIR variable being in the objdir. We could probably
fix this with minimal work, but that is scope bloat for this bug.

MozReview-Commit-ID: KtWCk91bX0K
2016-12-20 10:50:43 -05:00
Phil Ringnalda
5d05be41ea Backed out 3 changesets (bug 1312739) for "'NoneType' object has no attribute 'startswith'" bustage in everything mochitest
CLOSED TREE

Backed out changeset 1f3f88337227 (bug 1312739)
Backed out changeset ecb1d15e8075 (bug 1312739)
Backed out changeset b2adce340421 (bug 1312739)
2016-12-21 20:19:24 -08:00
Andrew Halberstadt
f455ae48a3 Bug 1312739 - Use ALL_FLAVORS dict when running mochitest from an interactive loaner, r=jmaher
MozReview-Commit-ID: Kpxepe9KecV
2016-12-20 11:24:33 -05:00
Andrew Halberstadt
884161c923 Bug 1312739 - Move mochitest 'ALL_FLAVORS' dict from mach_commands.py to mochitest_options.py, r=jmaher
Information in the ALL_FLAVORS dict is needed by interactive loaners (in the mach_test_package_commands.py
file). Because the normal mach_commands.py file doesn't get copied to the tests.zip, this commit refactors
ALL_FLAVORS into mochitest_options.py (which is copied to tests.zip) to avoid duplicating it. A side
benefit of moving ALL_FLAVORS to mochitest_options.py, is that mochitest_options.py itself can make use of
this dict. This means we no longer need to redefine the --flavor argument in the mach command.

The __init__.py file is added to turn the testing/mochitest directory into a python module. This allows
things like mach_commands.py to do things like 'from mochitest import runtests'. Mach commands are able to
find this module because the 'testing' directory is already added to sys.path in the mach bootstrap.

In the future, having mochitest as an importable module should help with running it from the srcdir. So this
is a change we should start making anyway. Unfortunately, we still need to import the main runtests.py file
from the objdir, as lots of things depend on the SCRIPT_DIR variable being in the objdir. We could probably
fix this with minimal work, but that is scope bloat for this bug.

MozReview-Commit-ID: KtWCk91bX0K
2016-12-20 10:50:43 -05:00
Andrew Halberstadt
0b5479bf7c Bug 1308202 - Remove all b2g and mulet related code from testing/mochitest, r=jmaher
MozReview-Commit-ID: BfIJLp6oGHO
2016-10-06 10:05:27 -04:00
Andrew McCreight
63930c0dc5 Back out de84b1059f7f (bug 1299871) because it doesn't help the issue it was supposed to. 2016-09-07 11:09:15 -07:00
Andrew Halberstadt
ce3cd0f69b Bug 1300163 - Add a --adbpath argument to mochitest Android to allow explicitly setting the adb binary, r=gbrown
In mozdevice, it's possible to pass in the path to the adb binary (rather than requiring it to be on the path). The
mochitest android options don't provide any means to set this however (even though the b2g options do). This patch
adds that option in.

This will be used by the mach environment on interactive loaners.

MozReview-Commit-ID: 4lsKGpizfH7
2016-09-02 14:26:16 -04:00
Andrew McCreight
6bcedddd5b Bug 1299871 - Increase leak threshold on OS X to paper over increased layers leak. r=erahm
MozReview-Commit-ID: 2QQa5uxmO5J
2016-09-01 11:04:09 -07:00
Andrew Halberstadt
9e6b28f4ea Bug 1293295 - Replace all mochitest 'flavor' options with a single --flavor argument, r=jmaher
This accomplishes three things:

1) Easier to use CLI when running without the benefit of testing/mochitest/mach_commands.py
2) Guarantees these arguments are mutually exclusive
3) Simplifies a bunch of logic in the test harness

The primary motivation for this change is to slightly improve the UX when running mochitest
from a taskcluster interactive loaner. However, this is more of a bandaid solution that was
easy to implement before the proper fix in bug 1293259 can be landed.

MozReview-Commit-ID: IeHBGrJ0Sji
2016-08-08 11:48:49 -04:00
Andrew Halberstadt
cfc6df1ca7 Bug 1288827 - Allow running mochitest from test-package without specifying --appname, r=armenzg
Because it is now possible for options.app to get set after 'parse_args' time, we need to make sure
the argument validation happens later. To accomplish this we pass in the parser instance to
'run_test_harness' and do parser.validate there. This unfortunately requires some minor uses of
global to accomplish easily due to how mach handles parsers.

MozReview-Commit-ID: s3Js1aZlSE
2016-07-20 11:13:30 -04:00
Carsten "Tomcat" Book
2d709b2fa1 Backed out changeset 6dcb52d270c7 (bug 1288827) for breaking mochitests 2016-07-28 17:04:42 +02:00
Andrew Halberstadt
e77f6c00c3 Bug 1288827 - Allow running mochitest from test-package without specifying --appname, r=armenzg
Because it is now possible for options.app to get set after 'parse_args' time, we need to make sure
the argument validation happens later. To accomplish this we pass in the parser instance to
'run_test_harness' and do parser.validate there. This unfortunately requires some minor uses of
global to accomplish easily due to how mach handles parsers.

MozReview-Commit-ID: s3Js1aZlSE
2016-07-20 11:13:30 -04:00
Geoff Brown
d905d04224 Bug 1274395 - Delete pending crash reports before running tests; r=jmaher 2016-05-25 14:48:42 -06:00
Andrew Halberstadt
30b4b782ef Bug 1274002 - Disable e10s when running mochitest-chrome locally with mach, r=jmaher
MozReview-Commit-ID: 1r2aZtnB3lo
2016-05-18 15:17:13 -04:00
Andrew McCreight
3e81eaf887 Bug 1273246 - Fix use of bindir in mochitest mach --dmd code. r=ahal 2016-05-17 07:55:49 -07:00
Andrew Halberstadt
85e76aff37 Bug 1243083 - Enable e10s by default when running mochitests, r=jmaher
MozReview-Commit-ID: NlTGwdQ2nw
2016-04-01 10:59:12 -04:00
Myk Melez
11388a70ad Bug 1238079 - remove the desktop web runtime; r=fabrice,mossop,gps,jryans,jmaher,marco 2016-03-07 13:33:12 -08:00
Stanley Mwangi
db8c66f2c1 Bug 1243083 - Added --disable-e10s to mochitest_options.py and reftestcommandline.py. r=ahal
MozReview-Commit-ID: I3UIS8eEZ8D
2016-03-02 16:33:13 -05:00
Andrew Halberstadt
d186ef1c12 Bug 1248056 - Increase marionette connection timeouts in mochitest when running with valgrind, r=chmanchester
MozReview-Commit-ID: 71d5XIgqcCJ
2016-02-16 10:04:52 -05:00
Andrew Halberstadt
5302f3c79d Bug 1247639 - Fix uncaught exception when running |mach mochitest| on Android, r=gbrown
MozReview-Commit-ID: 1s8x4zIhZSS
2016-02-11 16:09:45 -05:00
Andrew Halberstadt
9dcfc81d19 Bug 1231784 - Install specialpowers and mochikit extensions at runtime via AddonManager.loadTemporaryAddon(), r=jgriffin
MozReview-Commit-ID: 9I56x6Vnbf7
2016-01-25 09:55:57 -05:00
Andrew McCreight
aa768e428e Bug 1091917 - Stop ignoring failures to leak log on Windows. r=chmanchester 2016-02-10 10:29:20 -08:00
Julian Seward
bb0b32c97c Bug 1246719 - mach mochitest --valgrind: use comma as separator for --valgrind-args. r=james@hoppipolla.co.uk. 2016-02-09 14:38:55 +01:00
Wes Kocher
c4797ad496 Backed out 3 changesets (bug 1231784) for breaking 10.10 opt jetpack tests
Backed out changeset 653df21ca861 (bug 1231784)
Backed out changeset 0aac20bc3619 (bug 1231784)
Backed out changeset edcbd7c0aa36 (bug 1231784)
2016-02-03 17:38:12 -08:00
Andrew Halberstadt
f84ba669d4 Bug 1231784 - Install specialpowers and mochikit extensions at runtime via AddonManager.loadTemporaryAddon(), r=jgriffin 2016-01-25 09:55:57 -05:00
Julian Seward
30ddacbbc2 Bug 1229348 - Add a "valgrind-plain" suite to all_mochitest_suites. r=cmanchester. 2016-02-03 18:43:05 +01:00
Chris Manchester
c6915ad943 Bug 1229598 - Add a mode to browser-chrome tests to summarize per-test code coverage. r=ahal 2015-12-23 14:04:49 -08:00
Andrew Halberstadt
91a712cc51 Bug 1225903 - Drop support for b2g desktop in mochitest, r=jgriffin
Mochitests on b2g desktop are no longer being run on any trunk branches, including
b2g-inbound. Dropping support for it significantly reduces complexity
in the mochitest harness.
2015-11-18 13:35:38 -05:00
Wes Kocher
c0a054438a Backed out changeset 6ab228593820 (bug 1225903) for android robocop bustage CLOSED TREE 2015-11-19 11:54:17 -08:00
Andrew Halberstadt
d6e9ed3e7f Bug 1225903 - Drop support for b2g desktop in mochitest, r=jgriffin
Mochitests on b2g desktop are no longer being run on any trunk branches, including
b2g-inbound. Dropping support for it significantly reduces complexity
in the mochitest harness.
2015-11-18 13:35:38 -05:00
Andrew Halberstadt
21a1942ba7 Bug 1219442 - Re-write specialpowers as a restartless addon, r=jmaher
In order to meet the addon signing requirement for tests, specialpowers
needs to be installed at gecko runtime. This means it must be restartless.
This patch packages specialpowers as a restartless addon, but it does not
yet install it at runtime.
2015-11-05 10:00:59 -05:00
Chris Manchester
32ca035aaa Bug 1224305 - Add an option to the mochitest harness to provide a copy of the extra chrome manifest it writes. r=ahal 2015-11-13 16:14:40 -08:00
Nick Alexander
0354170ec8 Bug 938994 - Move build/mobile/robocop into mobile/android/tests/browser/robocop. r=gbrown
This builds the Robocop tests with |mach build mobile/android|, making
it easier for developers to build Fennec and the tests at the same
time.
2015-11-09 12:55:38 -08:00
Edgar Chen
10b301890f Bug 1211407 - Make |mach mochitest| use the adb under out/host/*/bin if no --adbpath specified. r=ahal 2015-10-05 19:11:52 +08:00
Julian Seward
ad8e3b37e6 Bug 1185244 - Improve mach support for running mochitests on Valgrind. r=jgraham, njn. 2015-09-28 12:01:42 +02:00
Wes Kocher
ca09e9719a Backed out changeset feceb41f1c3c (bug 1185244) for breaking running tests locally CLOSED TREE a=backout 2015-09-22 17:08:37 -07:00
Julian Seward
a9dcbc18a5 Bug 1185244 - Improve mach support for running mochitests on Valgrind. r=jgraham, njn. 2015-09-22 12:00:57 +02:00