Commit Graph

151 Commits

Author SHA1 Message Date
Bob Owen
d1a7ae9ac3 Bug 1067301 - Add mach / mochitest option to run tests with Windows content sandbox. r=jmaher 2014-09-16 08:20:07 +01:00
Edwin Flores
782c1b7715 Bug 1044742 - Make ClearKey CDM accessible to mochitests - r=ted 2014-09-24 10:04:49 +12:00
Dave Townsend
2fa34afa9a Bug 1035512: Add a new common JS testing harness based on the mochitest test runner. r=gps, ted, erikvold, jmaher 2014-09-22 11:08:06 -07:00
Nick Alexander
583cc2c1dc Bug 874729 - Part 4: Add |mach robocop|. r=gps 2014-09-08 16:23:12 -07:00
Tomasz Kołodziejski
1379365ac6 Bug 1057453 - 'mach test filename' should test a single file. r=gps 2014-09-03 13:06:00 +02:00
Ahmed Kachkach
1e912e2d06 Bug 1056329 - Activate structured logging command line args for other mochitest suites. r=ahal 2014-08-25 12:32:00 -04:00
Qeole
be1eaa06fe Bug 1045209 - Updating tests for new OpenH264 plugin path handling. r=unfocused,ted,jmaher 2014-08-25 17:23:34 +02:00
Gijs Kruitbosch
faf3ab2c45 Bug 1057328 - get gmp path for app-override tests, r=ted 2014-08-22 16:28:04 +02:00
Ahmed Kachkach
16da20cb97 Bug 1039833 - Add structured logging command line arguments for mochitest/mach. r=chmanchester, r=ahal 2014-08-13 12:03:00 -04:00
Ryan VanderMeulen
50afc15bdf Merge inbound to m-c. a=merge 2014-08-09 11:19:46 -04:00
Sylvestre Ledru
0650e71d3a Bug 1050715 - Update the description of the various tests targed proposed by './mach help' r=jmaher 2014-08-09 15:37:29 +02:00
Gijs Kruitbosch
a3f601c69e Bug 1051066 - fix mochitest-chrome for single test runs, r=ted 2014-08-09 09:26:53 +01:00
Ryan VanderMeulen
504dff3913 Merge fx-team to m-c. a=merge 2014-08-07 17:24:52 -04:00
Steven Lee
26676bec47 Bug 1046515 - Add support for the "repeat" and "run-until-failure" mach commands on B2G. r=ahal 2014-08-04 23:29:00 -04:00
Ahmed Kachkach
a83ca4356f Bug 1034267 - Structured Logging for robocop. r=gbrown 2014-07-29 14:11:00 +02:00
Ahmed Kachkach
75a8e87b19 Bug 1042979 - Clean up unused imports, variables, and dead code in mochitest. r=ahal 2014-07-24 06:23:00 +02:00
Jonathan Griffin
3c82e66e41 Bug 1042270 - Add is_mulet condition to mach, r=ahal 2014-07-22 14:41:09 -07:00
Ahmed Kachkach
b8c72656b6 Bug 1041944 - Printing mochitest failures at the end of the execution (with mach). r=ahal 2014-07-22 11:56:00 +02:00
Gijs Kruitbosch
0b35426fc5 Bug 1014062 - expose harness parameters via SimpleTest, always use the harness, pass keep-open for single test runs with mach, r=ted,f=bz 2014-05-22 20:09:21 +01:00
Andrew Halberstadt
a89dd57f4c Bug 1037858 - B2G mochitest mach command should fail early if running with PRODUCTION=1 or VARIANT=user, r=jgriffin, DONTBUILD, a=NPOTB 2014-07-17 13:38:20 -04:00
Giovanni Sferro
e0f5c08053 Bug 1032530 - mach mochitest takes --setpref argument. r=gps 2014-07-13 10:04:00 +02:00
Ting-Yu Lin
bdc15321bf Bug 982560 - Fix mach fails to find tests in subdirectory. r=gps
Make the test paths relative to topsrcdir before passing them to
TestResolver. Also do not passing cwd to TestResolver since it will
filter out tests that do not live under the directory where the mach
command is executed.

Verification steps:
Execute a mach test command from any subdirectory. For example:
$ cd testing/tps/
$ ../../mach xpcshell-test ../../services/fxaccounts/tests/xpcshell/
$ ../../mach test ../../services/fxaccounts/tests/xpcshell/
2014-07-01 23:21:00 +02:00
Vaibhav Agrawal
05898789a0 Bug 1014125 - Bisection Base Patch. r=ahal 2014-07-04 13:55:00 +02:00
Andrew Halberstadt
0aff809b2a Bug 1028746 - Running mach mochitest-remote from gecko srcdir raises AttributeError instead of being helpful, r=gps, DONTBUILD, a=NPOTB 2014-06-24 13:47:19 -04:00
Wes Kocher
eadbb03685 Merge m-c to fx-team 2014-06-19 18:33:19 -07:00
Gregory Szorc
23ed868d9e Bug 920193 - mach mochitest can now receive test objects; r=AutomatedTester
Similar to the previous patch, we now teach `mach mochitest` how to
execute test objects directly.
2014-06-18 11:19:45 -07:00
Gregory Szorc
784fee7b5e Bug 938712 - Add --flavor to mach mochitest; r=AutomatedTester
`mach mochitest` now accepts a --flavor argument to limit execution to
tests of a certain flavor. Executing `mach mochitest --flavor=X` should
be equivalent to executing `mach mochitest-X`.

This paves the road to deprecating the various `mach mochitest-X`
commands.
2014-06-17 15:49:41 -07:00
Gregory Szorc
4b6373f026 Bug 938712 - Implement mach mochitest; r=AutomatedTester
The `mach mochitest` command is now implemented. Given test path
arguments, it will identify mochitests of any flavor and run the
appropriate mochitest suite.

If tests from multiple suites are present, it will invoke each suite
separately. Although, the output in this mode isn't very friendly.

There are a number of enhancements that could be made to this command,
including the abilities to filter by flavor and sub-suite. These will
come in another patch.
2014-06-17 15:42:08 -07:00
Andrew Halberstadt
df364bfcf8 Bug 997244 - Move emulator.py out of marionette and into mozrunner, r=wlach,mdas,jgriffin 2014-06-19 14:17:26 -04:00
Joel Maher
7c6d249bbb Bug 992911 - (run-by-dir) add the ability to run mochitests per directory in a loop. r=ahal 2014-06-03 11:19:28 -04:00
Carsten "Tomcat" Book
8a19488ae8 Backed out changeset 86d0bd2a0233 (bug 992911) for android 2.3 bustage 2014-06-02 13:36:51 +02:00
Joel Maher
398ab89b6c Bug 992911 - (run-by-dir) add the ability to run mochitests per directory in a loop. r=ahal 2014-06-02 06:54:23 -04:00
Andrew Halberstadt
c5f99a89f1 Bug 957768 - Backout no longer needed --hide-subtests mochitest option (bug 937181 implemented the same thing but better), r=jmaher 2014-05-09 14:59:18 -04:00
Boris Zbarsky
5db725acc4 Bug 990289. Make running a single mochitest run it in a way where the subtest results can be accessed. r=ted 2014-05-08 22:20:54 -04:00
Ted Mielczarek
19f5b638b3 bug 815002 - allow using loopback devices in WebRTC mochitests on Linux when available. r=jsmith,jmaher 2014-05-01 07:18:00 -04:00
Gijs Kruitbosch
d77a939cb2 Bug 1004410 - allow running mochitests against an arbitrary binary, r=jmaher 2014-05-01 11:05:36 +01:00
Vicamo Yang
23091844af Bug 996443: carry emulator arch automatically for mach commands. r=ahal 2014-05-01 00:57:39 +08:00
Nathan Froyd
5dea1a3726 Bug 999407 - add --setenv option for mochitests run through mach; r=jmaher
DONTBUILD because NPOTB
2014-04-22 09:09:47 -04:00
Manish Goregaokar
1bf757e498 Bug 991348 - Give the ability to take screnshots on all test failures. r=jmaher 2014-04-12 04:23:00 +02:00
Ms2ger
4cc2a41d2c Backed out changeset c63d8f19a893 for failures in Android mochitests. 2014-04-12 12:00:37 +02:00
Manish Goregaokar
71a6e555fa Bug 991348 - Support taking screenshots on all test failures in mochitests; r=jmaher 2014-04-12 11:08:34 +02:00
Michael Ratcliffe
4cc10271fe Bug 983948 - Add mach mochitest-devtools r=jmaher 2014-03-25 16:52:53 +00:00
Vicamo Yang
d96efb1aa4 Bug 975442: recognize as emulator if device name begins with 'emulator'. r=jgriffin 2014-04-09 10:14:07 +08:00
Nathan Froyd
e51d903f0a Bug 969437 - part 1 - introduce a --quiet option for mochitests; r=jmaher 2014-03-07 11:42:07 -05:00
Gregory Szorc
4a13011778 Bug 987414 - Pass multiple test arguments to mach testing commands; r=ahal
Previously, mach xpcshell-test and mochitest-* were limited to a single
test "path" argument. This patch enables multiple arguments to be passed
in.

TestResolver in the build system has gained the ability to process
multiple paths in a single invocation. The mach commands have been
modified to utilize this new feature.

Only mach code paths that pass manifestdestiny.TestManifest instances
into the test runner can accept multiple arguments. This is because
there is no other way to pass a custom set of tests into the test
runner. If multiple test arguments are used but not supported, a warning
is emitted.
2014-03-24 16:19:57 -07:00
Gregory Szorc
a5fc13bfc1 Bug 987398 - Part 1: Run mochitests from manifests with mach; r=ahal
The mochitest mach commands now consult the all-tests.json file for
resolving the test argument/path. The mochitest runner has been modified
to accept a manifestdestiny.TestManifest instance instead of a path to a
manifest file. The mach commands construct an in-memory TestManifest and
pass it to the mochitest runner.

While I was here, I cleaned up some old JSON serializing code.
2014-03-24 14:35:06 -07:00
Jonathan Griffin
6e999f2f64 Bug 979650 - Always build with Marionette for Firefox, b2g desktop, r=ted 2014-03-11 13:22:34 -07:00
Carsten "Tomcat" Book
21de42de7b Merge mozilla-central to b2g-inbound 2014-03-19 16:30:49 +01:00
Andrew Halberstadt
5299f6c37e Bug 983262 - Remove obsolete b2g mochitest json manifests, r=jmaher 2014-03-19 11:23:29 -04:00
Bill McCloskey
e6e12d5833 Bug 938019 - Run mochitests from manifests (r=ted,gps) 2014-03-18 08:03:51 -07:00