Commit Graph

106 Commits

Author SHA1 Message Date
Geoff Brown
149d025aa3 Bug 1179981 - A new test harness for robocop; r=jmaher 2015-07-09 12:30:01 -06:00
Andrew Halberstadt
480e4e8ab6 Bug 1171602 - Run mochitest using mach from a tests.zip, r=chmanchester 2015-05-26 10:12:51 -04:00
Andrew Halberstadt
2651e9f398 Bug 1171971 - Move test_paths argument out of mach and into mochitest; remove --test-path, r=chmanchester 2015-06-05 13:28:29 -04:00
Andrew McCreight
14ab29d4f3 Bug 1157308 - part 2 - Reduce the content process leak limit on OS X. r=erahm
The intermittent media leak seems to have been fixed.
2015-05-27 09:33:00 +02:00
Andrew McCreight
1bdcc788c7 Bug 1157308 - part 1 - Reduce the leak threshold for content processes more. r=erahm 2015-05-27 07:53:00 +02:00
Andrew Halberstadt
1f417e6f21 Bug 1162479 - Fix mochitest make target regression with duplicate extraProfilePath, r=chmanchester 2015-05-07 14:38:43 -04:00
Andrew Halberstadt
78301891b2 Bug 1162226 - Fix mach mochitest regression on b2g desktop builds, r=chmanchester 2015-05-06 16:44:01 -04:00
Andrew Halberstadt
8162ad7d63 Bug 1155338 - Move mach command arguments into mochitest harness, r=chmanchester,gbrown 2015-04-30 13:47:01 -04:00
Phil Ringnalda
32ac011754 Back out f4f4e2be3765 (bug 1155338) for Android 4.0/debug mochitest bustage
CLOSED TREE
2015-05-04 18:28:16 -07:00
Andrew Halberstadt
8d7332d88e Bug 1155338 - Move mach command arguments into mochitest harness, r=chmanchester,gbrown 2015-04-30 13:47:01 -04:00
Mike Conley
10928e993b Bug 1152864 - Disable unsafe CPOW warnings when running mochitests by default, and add option to re-enable. r=ahal.
--enable-cpow-warnings can now be passed when running a mochitest to re-enable the warnings,
should one wish to do that.
2015-04-10 13:45:22 -04:00
Kershaw Chang
3fd7480ed7 Bug 1152242 - Enable e10s in mozinfo. r=ted 2015-04-08 20:03:00 -04:00
Andrew Halberstadt
0f300312cf Bug 1147129 - upgrade mochitest from optparse to argparse and move android cli to mochitest_options.py, r=chmanchester 2015-03-24 17:42:24 -04:00
Carsten "Tomcat" Book
161182bfc9 merge mozilla-inbound to mozilla-central a=merge 2015-03-31 14:43:50 +02:00
J. Ryan Stinnett
f0b83f9006 Bug 1138591 - Remove the chrome-enabled pref. r=past 2015-03-28 03:42:33 -05:00
Andrew Halberstadt
baf7554392 Bug 987360 - Add ability to tag tests with arbitrary strings and run them, r=chmanchester
Add a `tags` attribute to a test or DEFAULT section in a manifest:

[test_foo]
tags = foo

Then run all tests with a given tag by passing in `--tag foo` to a supported test harness. So far mochitest, xpcshell and marionette are supported.
2015-03-19 16:15:33 -04:00
Andrew Halberstadt
2e8d5ebe71 Bug 1142050 - Add --chunk-by-runtime option to mochitest, r=jmaher
With --chunk-by-runtime enabled, test runtime data collected from automation is used to try and make all chunks take the same amount of time. So far only data for mochitest browser-chrome is added.
2015-03-26 15:21:45 -04:00
Ryan VanderMeulen
beab04f3c0 Backed out changesets acbab9e22691 and 3c34fd480729 (bug 987360) for Android/B2G xpcshell bustage.
CLOSED TREE
2015-03-27 13:12:19 -04:00
Andrew Halberstadt
90da2d6c5b Bug 987360 - Add ability to tag tests with arbitrary strings and run them, r=chmanchester
Add a `tags` attribute to a test or DEFAULT section in a manifest:

[test_foo]
tags = foo

Then run all tests with a given tag by passing in `--tag foo` to a supported test harness. So far mochitest, xpcshell and marionette are supported.
2015-03-19 16:15:33 -04:00
Vaibhav Agrawal
4c0d44425d Bug 1144573 - Cleanup after removing android*.json. r=ahal, r=jmaher
CLOSED TREE
2015-03-26 14:39:57 +08:00
Bill McCloskey
00a105c3f5 Bug 1121676 - Use a lock to protect the list of top-level actors (r=bent) 2015-03-20 12:02:41 -07:00
Mike Hommey
f40c9ee960 Bug 1139719 - Properly say what binary is missing for --use-test-media-devices. r=jmaher 2015-03-10 10:01:54 +09:00
Nathan Froyd
d0a8529382 Bug 1136700 - enable tweaking of the maximum number of timeouts for mochitests; r=jmaher
When running tests locally, it's occasionally useful to be able to
increase the number of tests permitted to timeout before declaring the
test run a failure.  This patch adds the necessary bits to SimpleTest
and the appropriate amount of plumbing to runtests.py and mach to make
that so.
2015-02-25 09:23:54 -05:00
Andrew Halberstadt
a729c1fa7d Bug 1127376 - PEP8-ify all mochitest .py files (auto-generated), r=ted
This change was generated using the `autopep8` module [1]. To replicate:

    $ pip install --upgrade autopep8
    $ cd gecko
    $ autopep8 -i -a -a -r testing/mochitest --exclude 'testing/mochitest/pywebsocket/*'

[1] https://github.com/hhatto/autopep8
2015-02-13 14:42:02 -05:00
Andrew Halberstadt
a74852785a Bug 1123763 - [manifestparser] Implement filter system for manifest.active_tests(), r=ted
A filter is a callable that accepts an iterable of tests and a dictionary of values (e.g mozinfo.info) and returns an iterable of tests. Note filtering can mean modifying tests in addition to removing them. For example, this implements a "timeout-if" tag in the manifest:

    from manifestparser import expression
    import mozinfo

    def timeout_if(tests, values):
        for test in tests:
            if 'timeout-if' in test:
                timeout, condition = test['timeout-if'].split(',', 1)
                if expression.parse(condition, **values):
                    test['timeout'] = timeout
        yield test

    tests = mp.active_tests(filters=[timeout_if], **mozinfo.info)
2015-02-10 09:38:29 -05:00
Wes Kocher
68c12d8208 Backed out changeset ea625e85c72a (bug 1123763) for checktest orange on a CLOSED TREE 2015-02-09 14:00:13 -08:00
Andrew Halberstadt
5d4b7ab6cb Bug 1123763 - [manifestparser] Implement filter system for manifest.active_tests(), r=ted
A filter is a callable that accepts an iterable of tests and a dictionary of values (e.g mozinfo.info) and returns an iterable of tests. Note filtering can mean modifying tests in addition to removing them. For example, this implements a "timeout-if" tag in the manifest:

    from manifestparser import expression
    import mozinfo

    def timeout_if(tests, values):
        for test in tests:
            if 'timeout-if' in test:
                timeout, condition = test['timeout-if'].split(',', 1)
                if expression.parse(condition, **values):
                    test['timeout'] = timeout
            yield test

    tests = mp.active_tests(filters=[timeout_if], **mozinfo.info)
2015-02-09 16:13:00 -05:00
Andrew McCreight
3112c827ed Bug 1128486 - Increase tab process leak threshold a little. r=erahm
The GeckoMediaPluginService leak slowly grows, so hide it for a little longer.
2015-02-09 11:42:20 -08:00
Andrew McCreight
1f6ba82133 Bug 1121263 - Bump the leak threshold again for test_ipc. r=RyanVM
CLOSED TREE
2015-01-16 09:30:43 -08:00
Andrew McCreight
0fe24ab3b7 Bug 1121263 - Increase tab process leak threshold on OSX to paper over intermittent leak. r=jmaher 2015-01-14 10:06:46 -08:00
Andrew McCreight
b283308c06 Bug 1087613 - Reduce content process leak threshold to 20KB. r=erahm 2015-01-13 12:32:35 -08:00
Andrew McCreight
cd85a82886 Bug 1083897, part 2 - Don't require leak logs for tab processes on Windows. r=jmaher 2015-01-13 12:32:35 -08:00
Andrew McCreight
e9bbdaad55 Bug 1083897, part 1 - Require leak logs for tab processes on desktop. r=khuey 2015-01-13 12:32:35 -08:00
Kershaw Chang
2d0229cdd6 Bug 1038620 - Add --nested_oop option to mach test commands, r=ted.mielczarek 2015-01-13 02:07:00 +01:00
Bill McCloskey
ada88eb3e2 Bug 1110938 - Add timeout for CPOWs (default to 0) (r=dvander) 2014-12-18 17:35:44 -08:00
Chih-Kai (Patrick) Wang
10c4e7eb02 Bug 970307: Part 4: Increase leak checking threshold. r=nfroyd 2014-12-18 17:01:54 +08:00
Bob Clary
ed8ccf2eff Bug 1110940 - mochitest - support configurable tests.json manifest file name, r=jmaher. 2014-12-14 18:18:39 -08:00
Carsten "Tomcat" Book
167d0143fc Backed out changeset 9877aca65ef5 (bug 1038620) for causing Test Bustage on a CLOSED TREE 2014-12-12 14:57:39 +01:00
Kershaw Chang
5e27436702 Bug 1038620 - Add --nested-oop option to mach test commands - v5. r=ted.mielczarek 2014-12-12 01:30:00 +01:00
Bob Owen
1ff1eb96b8 Bug 1103946 Part 1: Change --content-sandbox mach / mochitest option to --strict-content-sandbox. r=jmaher
Also, change tests that are skipped using (contentSandbox != off) to (strictContentSandbox).
2014-12-10 09:34:03 +00:00
Ryan VanderMeulen
59b00f5e6f Backed out changesets 9beb53e53951, 4420bb4e5e7c, de1da65301a8, and cd9c2aaf1343 (bug 970307) for causing frequent B2G debug mochitest-11 crashes. 2014-11-24 17:18:27 -05:00
Patrick Wang (Chih-Kai Wang)
f811b6bf7c Bug 970307: Part 4: Increas leak checking threshold. r=nfroyd 2014-11-24 15:22:49 +08:00
Nazma Panjwani
d73089f15c Bug 1091280 - moved options from AutomationUtils.addCommonOptions to runreftest.py, mochitest_options.py, runxpcshelltests.py and removed the addCommonOptions from automationUtils and automation.py.in, r=ahal 2014-11-19 12:31:45 -08:00
Pankaj Malhotra(:bitgeeky)
ebf9456905 Bug 1091270 - Move isURL out of automationutils; r=jgriffin 2014-11-04 16:59:40 -08:00
Andrew McCreight
65a1526a9d Bug 1090201 - Increase GMP process leak threshold a little more. r=erahm 2014-10-28 14:00:44 -07:00
Andrew McCreight
fab5faaa8c Bug 1035454 - increase the tab process leak threshold to 2MB while we deal with landing fallout. r= CLOSED TREE 2014-10-16 10:05:23 -07:00
Andrew McCreight
77412939a5 Bug 1035454, part 1 - Increase the leak threshold for tab processes. r=khuey 2014-10-15 20:04:32 -07:00
Andrew McCreight
1110203434 Bug 1082788 - Increase GMP process threshold a little. r=jesup 2014-10-14 13:04:00 +02:00
Andrew McCreight
30014b26b9 Bug 1068276, part 1 - Allow configuring which type of processes we complain about when there's no leak log. r=jmaher
Then don't warn for missing logs from tab and geckomediaplugin processes, or default processes on B2G.
2014-09-30 14:17:27 -07:00
Andrew McCreight
4c9a0b67c6 Bug 1067664, part 1 - Allow different leak thresholds for different types of processes. r=jmaher 2014-09-30 09:54:25 -07:00