Commit Graph

191 Commits

Author SHA1 Message Date
Sylvestre Ledru
0650e71d3a Bug 1050715 - Update the description of the various tests targed proposed by './mach help' r=jmaher 2014-08-09 15:37:29 +02:00
Gijs Kruitbosch
a3f601c69e Bug 1051066 - fix mochitest-chrome for single test runs, r=ted 2014-08-09 09:26:53 +01:00
Ryan VanderMeulen
504dff3913 Merge fx-team to m-c. a=merge 2014-08-07 17:24:52 -04:00
Steven Lee
26676bec47 Bug 1046515 - Add support for the "repeat" and "run-until-failure" mach commands on B2G. r=ahal 2014-08-04 23:29:00 -04:00
Ahmed Kachkach
a83ca4356f Bug 1034267 - Structured Logging for robocop. r=gbrown 2014-07-29 14:11:00 +02:00
Ahmed Kachkach
75a8e87b19 Bug 1042979 - Clean up unused imports, variables, and dead code in mochitest. r=ahal 2014-07-24 06:23:00 +02:00
Jonathan Griffin
3c82e66e41 Bug 1042270 - Add is_mulet condition to mach, r=ahal 2014-07-22 14:41:09 -07:00
Ahmed Kachkach
b8c72656b6 Bug 1041944 - Printing mochitest failures at the end of the execution (with mach). r=ahal 2014-07-22 11:56:00 +02:00
Gijs Kruitbosch
0b35426fc5 Bug 1014062 - expose harness parameters via SimpleTest, always use the harness, pass keep-open for single test runs with mach, r=ted,f=bz 2014-05-22 20:09:21 +01:00
Andrew Halberstadt
a89dd57f4c Bug 1037858 - B2G mochitest mach command should fail early if running with PRODUCTION=1 or VARIANT=user, r=jgriffin, DONTBUILD, a=NPOTB 2014-07-17 13:38:20 -04:00
Giovanni Sferro
e0f5c08053 Bug 1032530 - mach mochitest takes --setpref argument. r=gps 2014-07-13 10:04:00 +02:00
Ting-Yu Lin
bdc15321bf Bug 982560 - Fix mach fails to find tests in subdirectory. r=gps
Make the test paths relative to topsrcdir before passing them to
TestResolver. Also do not passing cwd to TestResolver since it will
filter out tests that do not live under the directory where the mach
command is executed.

Verification steps:
Execute a mach test command from any subdirectory. For example:
$ cd testing/tps/
$ ../../mach xpcshell-test ../../services/fxaccounts/tests/xpcshell/
$ ../../mach test ../../services/fxaccounts/tests/xpcshell/
2014-07-01 23:21:00 +02:00
Vaibhav Agrawal
05898789a0 Bug 1014125 - Bisection Base Patch. r=ahal 2014-07-04 13:55:00 +02:00
Andrew Halberstadt
0aff809b2a Bug 1028746 - Running mach mochitest-remote from gecko srcdir raises AttributeError instead of being helpful, r=gps, DONTBUILD, a=NPOTB 2014-06-24 13:47:19 -04:00
Wes Kocher
eadbb03685 Merge m-c to fx-team 2014-06-19 18:33:19 -07:00
Gregory Szorc
23ed868d9e Bug 920193 - mach mochitest can now receive test objects; r=AutomatedTester
Similar to the previous patch, we now teach `mach mochitest` how to
execute test objects directly.
2014-06-18 11:19:45 -07:00
Gregory Szorc
784fee7b5e Bug 938712 - Add --flavor to mach mochitest; r=AutomatedTester
`mach mochitest` now accepts a --flavor argument to limit execution to
tests of a certain flavor. Executing `mach mochitest --flavor=X` should
be equivalent to executing `mach mochitest-X`.

This paves the road to deprecating the various `mach mochitest-X`
commands.
2014-06-17 15:49:41 -07:00
Gregory Szorc
4b6373f026 Bug 938712 - Implement mach mochitest; r=AutomatedTester
The `mach mochitest` command is now implemented. Given test path
arguments, it will identify mochitests of any flavor and run the
appropriate mochitest suite.

If tests from multiple suites are present, it will invoke each suite
separately. Although, the output in this mode isn't very friendly.

There are a number of enhancements that could be made to this command,
including the abilities to filter by flavor and sub-suite. These will
come in another patch.
2014-06-17 15:42:08 -07:00
Andrew Halberstadt
df364bfcf8 Bug 997244 - Move emulator.py out of marionette and into mozrunner, r=wlach,mdas,jgriffin 2014-06-19 14:17:26 -04:00
Joel Maher
7c6d249bbb Bug 992911 - (run-by-dir) add the ability to run mochitests per directory in a loop. r=ahal 2014-06-03 11:19:28 -04:00
Carsten "Tomcat" Book
8a19488ae8 Backed out changeset 86d0bd2a0233 (bug 992911) for android 2.3 bustage 2014-06-02 13:36:51 +02:00
Joel Maher
398ab89b6c Bug 992911 - (run-by-dir) add the ability to run mochitests per directory in a loop. r=ahal 2014-06-02 06:54:23 -04:00
Andrew Halberstadt
c5f99a89f1 Bug 957768 - Backout no longer needed --hide-subtests mochitest option (bug 937181 implemented the same thing but better), r=jmaher 2014-05-09 14:59:18 -04:00
Boris Zbarsky
5db725acc4 Bug 990289. Make running a single mochitest run it in a way where the subtest results can be accessed. r=ted 2014-05-08 22:20:54 -04:00
Ted Mielczarek
19f5b638b3 bug 815002 - allow using loopback devices in WebRTC mochitests on Linux when available. r=jsmith,jmaher 2014-05-01 07:18:00 -04:00
Gijs Kruitbosch
d77a939cb2 Bug 1004410 - allow running mochitests against an arbitrary binary, r=jmaher 2014-05-01 11:05:36 +01:00
Vicamo Yang
23091844af Bug 996443: carry emulator arch automatically for mach commands. r=ahal 2014-05-01 00:57:39 +08:00
Nathan Froyd
5dea1a3726 Bug 999407 - add --setenv option for mochitests run through mach; r=jmaher
DONTBUILD because NPOTB
2014-04-22 09:09:47 -04:00
Manish Goregaokar
1bf757e498 Bug 991348 - Give the ability to take screnshots on all test failures. r=jmaher 2014-04-12 04:23:00 +02:00
Ms2ger
4cc2a41d2c Backed out changeset c63d8f19a893 for failures in Android mochitests. 2014-04-12 12:00:37 +02:00
Manish Goregaokar
71a6e555fa Bug 991348 - Support taking screenshots on all test failures in mochitests; r=jmaher 2014-04-12 11:08:34 +02:00
Michael Ratcliffe
4cc10271fe Bug 983948 - Add mach mochitest-devtools r=jmaher 2014-03-25 16:52:53 +00:00
Vicamo Yang
d96efb1aa4 Bug 975442: recognize as emulator if device name begins with 'emulator'. r=jgriffin 2014-04-09 10:14:07 +08:00
Nathan Froyd
e51d903f0a Bug 969437 - part 1 - introduce a --quiet option for mochitests; r=jmaher 2014-03-07 11:42:07 -05:00
Gregory Szorc
4a13011778 Bug 987414 - Pass multiple test arguments to mach testing commands; r=ahal
Previously, mach xpcshell-test and mochitest-* were limited to a single
test "path" argument. This patch enables multiple arguments to be passed
in.

TestResolver in the build system has gained the ability to process
multiple paths in a single invocation. The mach commands have been
modified to utilize this new feature.

Only mach code paths that pass manifestdestiny.TestManifest instances
into the test runner can accept multiple arguments. This is because
there is no other way to pass a custom set of tests into the test
runner. If multiple test arguments are used but not supported, a warning
is emitted.
2014-03-24 16:19:57 -07:00
Gregory Szorc
a5fc13bfc1 Bug 987398 - Part 1: Run mochitests from manifests with mach; r=ahal
The mochitest mach commands now consult the all-tests.json file for
resolving the test argument/path. The mochitest runner has been modified
to accept a manifestdestiny.TestManifest instance instead of a path to a
manifest file. The mach commands construct an in-memory TestManifest and
pass it to the mochitest runner.

While I was here, I cleaned up some old JSON serializing code.
2014-03-24 14:35:06 -07:00
Jonathan Griffin
6e999f2f64 Bug 979650 - Always build with Marionette for Firefox, b2g desktop, r=ted 2014-03-11 13:22:34 -07:00
Carsten "Tomcat" Book
21de42de7b Merge mozilla-central to b2g-inbound 2014-03-19 16:30:49 +01:00
Andrew Halberstadt
5299f6c37e Bug 983262 - Remove obsolete b2g mochitest json manifests, r=jmaher 2014-03-19 11:23:29 -04:00
Bill McCloskey
e6e12d5833 Bug 938019 - Run mochitests from manifests (r=ted,gps) 2014-03-18 08:03:51 -07:00
Nils Ohlmeier [:drno]
5aaa728e70 Bug 962919 - Filter a given test directory by the B2G manifest. r=ahal 2014-02-10 15:58:46 -05:00
Ehsan Akhgari
4dc6b4bce6 Bug 957729 - Disable the slow script signal handler by default when running mochitests under a debugger through mach; r=gps 2014-02-07 23:25:45 -05:00
Nathan Froyd
cfb744d268 Bug 960612 - update |mach mochitest*| for DMD's new shared library location in dist/bin/; r=jmaher 2014-01-16 12:23:32 -05:00
Andrew Halberstadt
23f56959b0 Bug 958395 - mochitest-plain mach command should add kwargs to options, r=jmaher, DONTBUILD, a=NPOTB 2014-01-10 10:45:52 -05:00
Andrew Halberstadt
bc8acd8665 Bug 957768 - Add an option to hide mochitest subtest results, r=jmaher 2014-01-09 15:41:54 -05:00
Kamil Muszyński
ed0e26f8f8 Bug 932948 - Running mach mochitest-a11y with installed extension. r=ted 2013-12-17 10:56:29 -05:00
Andrew Halberstadt
4e3dd52d91 Bug 946722 - Fix typo causing b2g mochitest mach command to use wrong manifest, r=ato, DONTBUILD, a=NPOTB 2013-12-05 10:48:46 -05:00
Jed Davis
46747fef7d Bug 943141 - Set up breakpad symbol path for ./mach mochitest-remote. r=ahal 2013-11-26 17:25:25 -05:00
Jed Davis
d0de99aad3 Bug 936278 - Pass through mach mochitest-remote options correctly. r=jgriffin 2013-11-25 09:12:50 -05:00
Mark Hammond
7c9c4b36cf Bug 932186 - Allow mach to specify a manifest file as a test path. r=ted 2013-11-25 10:33:11 +11:00