Commit Graph

119 Commits

Author SHA1 Message Date
Julian Seward
ad8e3b37e6 Bug 1185244 - Improve mach support for running mochitests on Valgrind. r=jgraham, njn. 2015-09-28 12:01:42 +02:00
Wes Kocher
ca09e9719a Backed out changeset feceb41f1c3c (bug 1185244) for breaking running tests locally CLOSED TREE a=backout 2015-09-22 17:08:37 -07:00
Julian Seward
a9dcbc18a5 Bug 1185244 - Improve mach support for running mochitests on Valgrind. r=jgraham, njn. 2015-09-22 12:00:57 +02:00
Gijs Kruitbosch
07b8f4b1eb Bug 1196320 - ensure --appname is included in mochitest's ./mach command help, r=ahal 2015-09-14 19:28:55 +01:00
Nathan Froyd
31e6934af8 Bug 1198944 - remove vmware recording support from mochitest; r=khuey
VMWare's record/replay bits are unsupported, and they only work with
programs compiled with VS2010, which we no longer support.
2015-08-27 16:00:14 -04:00
Karl Tomlinson
9c4e5d8f9f revert 521e2b4d97b8 given workaround from bug 1193922 2015-09-01 18:38:07 +12:00
Vaibhav Agrawal
ecb57cc8d5 Bug 1197543 - Add --extra-mozinfo-json option in mochitest to filter tests for a given mozinfo file. r=ahal
CLOSED TREE
2015-08-22 18:57:19 -07:00
Vaibhav Agrawal
228761e931 Bug 1197541 - Add --dump-tests option to mochitest and xpcshell for all tests that will be run. r=ahal 2015-08-21 17:16:11 -07:00
Andrew Halberstadt
67cec80bd8 Bug 1185761 - [mochitest] Allow boolean values to --keep-open for overriding the default, r=ted
Most of the time the default is to close the browser after tests run. And that can be overridden with
--keep-open. But in some corner cases, the default is to leave the browser open after tests have run.
In these cases, it is not currently possible to override.

This patch allows the syntax --keep-open or --keep-open=false, the latter overrides the edge case
default.
2015-08-06 17:40:54 -04:00
Andrew McCreight
00cd7c6636 Bug 1193917 - Paper over web audio leaks revealed by event loop changes. r=erahm CLOSED TREE 2015-08-12 12:47:43 -07:00
Andrew Halberstadt
ffc4d5d396 Bug 1192235 - Update misleading mochitest usage string, r=chmanchester, DONTBUILD 2015-08-07 10:19:32 -04:00
Chris Manchester
064508f499 Bug 1188730 - Select tests in the plugins subsuite by manifest rather than path to fix unintended interaction with mach try. r=ahal
This prevents mach try's filtering of the master mochitest manifest from
interacting with the plugins subsuite by selecting by manifest rather than
test path. The way we run mochitest other could use a lot of cleanup --
this is a quick fix to prevent misleading output on treeherder when using
mach try.
2015-07-29 00:10:06 -07:00
Andrew Halberstadt
5c1241cd79 Bug 1014760 - Move mozlog.structured to mozlog; Move mozlog to mozlog.unstructured, r=jgraham
Mozlog currently has two implementations. The top level package is based on the logging module and is
deprecated. The newer structured logging implementation lives in mozlog.structured. This patch swaps the
two, so the top level mozlog module contains the recommended implementation, while mozlog.unstructured
contains the old one.
2015-07-16 10:38:40 -04:00
Geoff Brown
149d025aa3 Bug 1179981 - A new test harness for robocop; r=jmaher 2015-07-09 12:30:01 -06:00
Andrew Halberstadt
480e4e8ab6 Bug 1171602 - Run mochitest using mach from a tests.zip, r=chmanchester 2015-05-26 10:12:51 -04:00
Andrew Halberstadt
2651e9f398 Bug 1171971 - Move test_paths argument out of mach and into mochitest; remove --test-path, r=chmanchester 2015-06-05 13:28:29 -04:00
Andrew McCreight
14ab29d4f3 Bug 1157308 - part 2 - Reduce the content process leak limit on OS X. r=erahm
The intermittent media leak seems to have been fixed.
2015-05-27 09:33:00 +02:00
Andrew McCreight
1bdcc788c7 Bug 1157308 - part 1 - Reduce the leak threshold for content processes more. r=erahm 2015-05-27 07:53:00 +02:00
Andrew Halberstadt
1f417e6f21 Bug 1162479 - Fix mochitest make target regression with duplicate extraProfilePath, r=chmanchester 2015-05-07 14:38:43 -04:00
Andrew Halberstadt
78301891b2 Bug 1162226 - Fix mach mochitest regression on b2g desktop builds, r=chmanchester 2015-05-06 16:44:01 -04:00
Andrew Halberstadt
8162ad7d63 Bug 1155338 - Move mach command arguments into mochitest harness, r=chmanchester,gbrown 2015-04-30 13:47:01 -04:00
Phil Ringnalda
32ac011754 Back out f4f4e2be3765 (bug 1155338) for Android 4.0/debug mochitest bustage
CLOSED TREE
2015-05-04 18:28:16 -07:00
Andrew Halberstadt
8d7332d88e Bug 1155338 - Move mach command arguments into mochitest harness, r=chmanchester,gbrown 2015-04-30 13:47:01 -04:00
Mike Conley
10928e993b Bug 1152864 - Disable unsafe CPOW warnings when running mochitests by default, and add option to re-enable. r=ahal.
--enable-cpow-warnings can now be passed when running a mochitest to re-enable the warnings,
should one wish to do that.
2015-04-10 13:45:22 -04:00
Kershaw Chang
3fd7480ed7 Bug 1152242 - Enable e10s in mozinfo. r=ted 2015-04-08 20:03:00 -04:00
Andrew Halberstadt
0f300312cf Bug 1147129 - upgrade mochitest from optparse to argparse and move android cli to mochitest_options.py, r=chmanchester 2015-03-24 17:42:24 -04:00
Carsten "Tomcat" Book
161182bfc9 merge mozilla-inbound to mozilla-central a=merge 2015-03-31 14:43:50 +02:00
J. Ryan Stinnett
f0b83f9006 Bug 1138591 - Remove the chrome-enabled pref. r=past 2015-03-28 03:42:33 -05:00
Andrew Halberstadt
baf7554392 Bug 987360 - Add ability to tag tests with arbitrary strings and run them, r=chmanchester
Add a `tags` attribute to a test or DEFAULT section in a manifest:

[test_foo]
tags = foo

Then run all tests with a given tag by passing in `--tag foo` to a supported test harness. So far mochitest, xpcshell and marionette are supported.
2015-03-19 16:15:33 -04:00
Andrew Halberstadt
2e8d5ebe71 Bug 1142050 - Add --chunk-by-runtime option to mochitest, r=jmaher
With --chunk-by-runtime enabled, test runtime data collected from automation is used to try and make all chunks take the same amount of time. So far only data for mochitest browser-chrome is added.
2015-03-26 15:21:45 -04:00
Ryan VanderMeulen
beab04f3c0 Backed out changesets acbab9e22691 and 3c34fd480729 (bug 987360) for Android/B2G xpcshell bustage.
CLOSED TREE
2015-03-27 13:12:19 -04:00
Andrew Halberstadt
90da2d6c5b Bug 987360 - Add ability to tag tests with arbitrary strings and run them, r=chmanchester
Add a `tags` attribute to a test or DEFAULT section in a manifest:

[test_foo]
tags = foo

Then run all tests with a given tag by passing in `--tag foo` to a supported test harness. So far mochitest, xpcshell and marionette are supported.
2015-03-19 16:15:33 -04:00
Vaibhav Agrawal
4c0d44425d Bug 1144573 - Cleanup after removing android*.json. r=ahal, r=jmaher
CLOSED TREE
2015-03-26 14:39:57 +08:00
Bill McCloskey
00a105c3f5 Bug 1121676 - Use a lock to protect the list of top-level actors (r=bent) 2015-03-20 12:02:41 -07:00
Mike Hommey
f40c9ee960 Bug 1139719 - Properly say what binary is missing for --use-test-media-devices. r=jmaher 2015-03-10 10:01:54 +09:00
Nathan Froyd
d0a8529382 Bug 1136700 - enable tweaking of the maximum number of timeouts for mochitests; r=jmaher
When running tests locally, it's occasionally useful to be able to
increase the number of tests permitted to timeout before declaring the
test run a failure.  This patch adds the necessary bits to SimpleTest
and the appropriate amount of plumbing to runtests.py and mach to make
that so.
2015-02-25 09:23:54 -05:00
Andrew Halberstadt
a729c1fa7d Bug 1127376 - PEP8-ify all mochitest .py files (auto-generated), r=ted
This change was generated using the `autopep8` module [1]. To replicate:

    $ pip install --upgrade autopep8
    $ cd gecko
    $ autopep8 -i -a -a -r testing/mochitest --exclude 'testing/mochitest/pywebsocket/*'

[1] https://github.com/hhatto/autopep8
2015-02-13 14:42:02 -05:00
Andrew Halberstadt
a74852785a Bug 1123763 - [manifestparser] Implement filter system for manifest.active_tests(), r=ted
A filter is a callable that accepts an iterable of tests and a dictionary of values (e.g mozinfo.info) and returns an iterable of tests. Note filtering can mean modifying tests in addition to removing them. For example, this implements a "timeout-if" tag in the manifest:

    from manifestparser import expression
    import mozinfo

    def timeout_if(tests, values):
        for test in tests:
            if 'timeout-if' in test:
                timeout, condition = test['timeout-if'].split(',', 1)
                if expression.parse(condition, **values):
                    test['timeout'] = timeout
        yield test

    tests = mp.active_tests(filters=[timeout_if], **mozinfo.info)
2015-02-10 09:38:29 -05:00
Wes Kocher
68c12d8208 Backed out changeset ea625e85c72a (bug 1123763) for checktest orange on a CLOSED TREE 2015-02-09 14:00:13 -08:00
Andrew Halberstadt
5d4b7ab6cb Bug 1123763 - [manifestparser] Implement filter system for manifest.active_tests(), r=ted
A filter is a callable that accepts an iterable of tests and a dictionary of values (e.g mozinfo.info) and returns an iterable of tests. Note filtering can mean modifying tests in addition to removing them. For example, this implements a "timeout-if" tag in the manifest:

    from manifestparser import expression
    import mozinfo

    def timeout_if(tests, values):
        for test in tests:
            if 'timeout-if' in test:
                timeout, condition = test['timeout-if'].split(',', 1)
                if expression.parse(condition, **values):
                    test['timeout'] = timeout
            yield test

    tests = mp.active_tests(filters=[timeout_if], **mozinfo.info)
2015-02-09 16:13:00 -05:00
Andrew McCreight
3112c827ed Bug 1128486 - Increase tab process leak threshold a little. r=erahm
The GeckoMediaPluginService leak slowly grows, so hide it for a little longer.
2015-02-09 11:42:20 -08:00
Andrew McCreight
1f6ba82133 Bug 1121263 - Bump the leak threshold again for test_ipc. r=RyanVM
CLOSED TREE
2015-01-16 09:30:43 -08:00
Andrew McCreight
0fe24ab3b7 Bug 1121263 - Increase tab process leak threshold on OSX to paper over intermittent leak. r=jmaher 2015-01-14 10:06:46 -08:00
Andrew McCreight
b283308c06 Bug 1087613 - Reduce content process leak threshold to 20KB. r=erahm 2015-01-13 12:32:35 -08:00
Andrew McCreight
cd85a82886 Bug 1083897, part 2 - Don't require leak logs for tab processes on Windows. r=jmaher 2015-01-13 12:32:35 -08:00
Andrew McCreight
e9bbdaad55 Bug 1083897, part 1 - Require leak logs for tab processes on desktop. r=khuey 2015-01-13 12:32:35 -08:00
Kershaw Chang
2d0229cdd6 Bug 1038620 - Add --nested_oop option to mach test commands, r=ted.mielczarek 2015-01-13 02:07:00 +01:00
Bill McCloskey
ada88eb3e2 Bug 1110938 - Add timeout for CPOWs (default to 0) (r=dvander) 2014-12-18 17:35:44 -08:00
Chih-Kai (Patrick) Wang
10c4e7eb02 Bug 970307: Part 4: Increase leak checking threshold. r=nfroyd 2014-12-18 17:01:54 +08:00
Bob Clary
ed8ccf2eff Bug 1110940 - mochitest - support configurable tests.json manifest file name, r=jmaher. 2014-12-14 18:18:39 -08:00