Commit Graph

231 Commits

Author SHA1 Message Date
Alex Gaynor
478321d9d3 Bug 1294641 - whitelist reads from the .app directory in the macOS sandbox r=froydnj,haik
This patch does a few things:
a) Adds the resources location from the .app directory to the read whitelist
b) When it's a non-packaged build, mach run (and various mach tests) set an environment variable for the repo location which we allow reads from.

r=haik,froydnj

MozReview-Commit-ID: KNvAoUs5Ati
2017-04-07 14:53:19 -04:00
Sebastian Hengst
155e26d497 Backed out changeset 225683fed1d1 (bug 1294641) for breaking crashtests, reftests and Windows builds. r=backout on a CLOSED TREE 2017-04-17 16:29:52 +02:00
Alex Gaynor
d7af07ecbe Bug 1294641 - whitelist reads from the .app directory in the macOS sandbox r=froydnj,haik
This patch does a few things:
a) Adds the resources location from the .app directory to the read whitelist
b) When it's a non-packaged build, mach run (and various mach tests) set an environment variable for the repo location which we allow reads from.

r=haik,froydnj

MozReview-Commit-ID: KNvAoUs5Ati
2017-04-07 14:53:19 -04:00
Ting-Yu Chou
9c40f931c5 Bug 1333003 part 6 - Fix test scripts to run ASan on Windows. r=ted
MozReview-Commit-ID: 6F9UXgTRb2Y
2017-03-10 12:08:34 +08:00
Brendan Dahl
85f151ac59 Bug 1338004 - Add headless browser mode. r=jrmuizel, r=ted
Supports creating a windowless browser on Linux without an X server. Most of the
changes are just adding branches to avoid calls in to GTK which calls
into X. Some of the bigger additions were adding a separate headless widget
which implements just enough to render a page. A headless look and
feel were also added since there are many calls into GTK in the platform
specific one.
2017-04-04 10:22:00 -04:00
Wes Kocher
3095b422dc Backed out 7 changesets (bug 1333003) for windows asan failures a=backout
Backed out changeset 3d2b2eeda8d3 (bug 1333003)
Backed out changeset 400d409ba4ca (bug 1333003)
Backed out changeset 1ba027abdfc9 (bug 1333003)
Backed out changeset 70114135bd8c (bug 1333003)
Backed out changeset 5715b15e33c0 (bug 1333003)
Backed out changeset 375e952bd738 (bug 1333003)
Backed out changeset d5d4112599f2 (bug 1333003)

MozReview-Commit-ID: DZUHJTdjX7V
2017-03-23 11:01:44 -07:00
Ting-Yu Chou
f66b5c4835 Bug 1333003 part 6 - Fix test scripts to run ASan on Windows. r=ted
MozReview-Commit-ID: 6F9UXgTRb2Y
2017-03-10 12:08:34 +08:00
Carsten "Tomcat" Book
88dfdca025 Backed out changeset 18fd8676751a (bug 1333003) 2017-03-23 10:38:04 +01:00
Ting-Yu Chou
f761f3c2a3 Bug 1333003 part 6 - Fix test scripts to run ASan on Windows. r=ted
MozReview-Commit-ID: 6F9UXgTRb2Y
2017-03-10 12:08:34 +08:00
Honza Bambas
d380c324d0 Bug 1321026 - Have an argument to change the number of parallel tests when running xpcshelltests, r=ted 2017-03-06 05:39:00 +01:00
Sebastian Hengst
6b2f608e3e Backed out changeset a293a617ebed (bug 1321026) on suspicion of causing xpcshell bustage. r=backout on a CLOSED TREE 2017-03-06 23:35:17 +01:00
Honza Bambas
82ce68f9b1 Bug 1321026 - Have an argument to change the number of parallel tests when running xpcshelltests. r=ted 2017-03-06 08:44:00 -05:00
Andrew Halberstadt
89b137ea65 Bug 1340551 - Log tests by manifest from suite_start in xpcshell harness, r=jgraham
MozReview-Commit-ID: G7P20w0G0fM
2017-02-22 14:34:29 -05:00
Chris Peterson
6bb2787575 Bug 1336776 - Log more useful error messages if MOZ_NODE_PATH or MOZHTTP2_PORT environment variables are not set correctly. r=nwgh
MozReview-Commit-ID: Fevu9smKdu3
2017-02-04 16:21:58 -08:00
Greg Mierzwinski
a9323edf9f Bug 1301197 - Add xpcshell code coverage to linux64-jsdcov and the 'coverage' mozinfo flag. r=jmaher
This patch makes it possible to collect code coverage for xpcshell tests using the linux64-jsdcov build. It also enables the use of a 'coverage' flag to disable tests when they are instrumented with the js debugger for code coverage. Lastly, it uses the 'coverage' flag to disable certain tests.

MozReview-Commit-ID: 97VFkJmlwQn
2016-11-08 15:57:21 -05:00
Mark Banner
ee78c2e613 Bug 503613 - Remove the tail file functionality from xpcshell; r=gps
MozReview-Commit-ID: JcglhFl89DX
2017-01-17 15:27:55 +00:00
Nicholas Hurley
87c16d8d6c Bug 1310855 - Remove hasNode xpcshell.ini variable r=mcmanus
MozReview-Commit-ID: Hx2e1JYfUfy
2016-10-18 10:54:33 -07:00
Andrew Halberstadt
58e3ab082c Bug 1316309 - Use mozcrash.kill_and_get_minidump() in xpcshell instead of automation.py, r=ted
There are a number of things that were going wrong with XPCShell on windows, this patch address them:

1) We were erroring out in Automation.killAndGetStack(), both failing to produce a minidump and failing
to kill the process. This patch fixes both these issues by using mozcrash instead.

2) Occasionally we were occasionally raising a psutil.NoSuchProcess error when attempting to kill the
process after the test. This appears to be caused by a race condition, but is safe to ignore as if the
process doesn't exist, then we don't need to kill it.

3) Spurious "Unable to remove directory" errors in cleanup. This uses mozfile.remove to remedy this.

MozReview-Commit-ID: 1g5qO8fpM7R
2016-11-09 10:32:46 -05:00
Andrew Halberstadt
b5202cebb3 Bug 1316408 - Remove all b2g related code from testing/xpcshell, r=jmaher
MozReview-Commit-ID: KF5Pw5WBleX
2016-11-09 14:50:45 -05:00
Phil Ringnalda
74a62f1b6e Backed out changeset 4777ed22d16d (bug 1261197) for xpcshell "logged while not in progress" failures 2016-11-08 21:11:50 -08:00
pyang
f6425045cc Bug 1261197 - Use StructuredOutputParser for parsing xpcshell test results r=ahal
MozReview-Commit-ID: 3kg8oEAecR7
2016-11-08 11:17:42 +08:00
Phil Ringnalda
28a0e4723b Backed out changeset 143f26b923d0 (bug 1310855) for WinXP xpcshell failures starting with test_register_success_http2.js 2016-11-07 18:42:57 -08:00
Nicholas Hurley
0b381a0479 Bug 1310855 - Remove hasNode xpcshell.ini variable r=mcmanus
MozReview-Commit-ID: Hx2e1JYfUfy
2016-10-18 10:54:33 -07:00
Chris Manchester
c4aba81fb1 Bug 1282522 - Ensure stderr is printed in case of a shutdown crash in a passing xpcshell test. r=gps
There were two assumptions preventing this output from being logged, both
related to the case a test passes and xpcshell returns 0. The first was
that we would not find crash dumps in this case, and would therefore not
need to log the full output of the test process (in the case xpcshell
returned non-zero or a test failed, we would log this output prior to checking
for crashes). The second was that if a test was eligible to retry, we wouldn't
need to store a test's output at all, because this output would only relate to
a failure that we would consider non-fatal.

The first assumption does not hold because it's possible to fatally assert
at shutdown in tests spawning child processes without causing a test failure
or non-zero exit code.

The second assumption followed from the first, and is violated when the first
is violated, because in this case we would consider a found crash fatal even
when a test was eligible to retry.

This patch reverses these assumptions and logs the full output of a test that
passes but produces crash dumps. It's not clear that the existing code intended
for a crash to ever be considered fatal when a test was eligible to retry, but
to change this criteria now would reduce our effective test coverage by
ignoring crashes that are now considered fatal, so after this patch we continue
to consider this scenario fatal. If it is determined these crashes are related
to these tests running in parallel with other tests, or they are not relevant
for some other reason, these tests should be run sequentially, or this criteria
should be changed.


MozReview-Commit-ID: 2PaFSGx2MVR
2016-09-12 23:02:44 -07:00
Nicholas Hurley
3ed39d224f Bug 1296280 (part 0b) - Make debugging node h2 server work better r=mcmanus
MozReview-Commit-ID: 6QoGiUKGTzA
2016-09-07 09:43:47 -07:00
Masatoshi Kimura
8b7e6c6a08 Bug 1248198 - Set "hasNode" only if the node version is >=5.0.0 because older node does not support ALPN. r=glandium
MozReview-Commit-ID: D4rrp92R5YS
2016-07-15 21:08:42 +09:00
Nicholas Hurley
5bd2184bfd Bug 1248197 - Remove spdy/3.1 support. r=mcmanus
MozReview-Commit-ID: 1RgzxOY00Le
2016-07-15 15:13:49 -07:00
Greg Mierzwinski
4cc8cf9258 Bug 1278649 - Add code coverage to xpcshell tests. r=chmanchester
This adds the ability to use the command line flag '--jscov-dir-prefix' to collect javascript code coverage from xpcshell tests and output it into the specified directory as a JSON file.

MozReview-Commit-ID: 3MZm73SNChL
2016-06-08 09:41:04 -04:00
Gregory Szorc
2dd9fb2182 Bug 1272851 - Allow temporary directory to be specified to xpcshell test harness; r=ted
A subsequent commit will change where the temporary directory is located
in certain test invocations. To do this, we need to teach the xpcshell
harness to use an alternate temporary directory instead of using the system
default (likely specified from TEMP* environment variables).

MozReview-Commit-ID: IUUlYaLBiEC
2016-05-26 12:09:46 -07:00
Kris Maglione
62ba00e812 Bug 1269501: Part 1 - Add $PYTHON variable to environment for subprocess xpcshell tests. r=glandium
I'm not especially happy with this method, but the DMD tests are the only
other tests I can find doing anything like this, and I don't have a better
solution than doing it the same way.

MozReview-Commit-ID: JlclyKoUhRf
2016-05-08 20:33:36 -07:00
Sebastian Hengst
3344303db0 Backed out 5 changesets (bug 1269501) for failing the added test_subprocess.js on Windows (didn't fold it into the last backout). r=backout
Backed out changeset 3e1d7c5d1a58 (bug 1269501)
Backed out changeset 167e407cb1fc (bug 1269501)
Backed out changeset 6438b11898cf (bug 1269501)
Backed out changeset 1cbbf940ec35 (bug 1269501)
Backed out changeset ed35c5f4d756 (bug 1269501)
2016-05-28 12:38:25 +02:00
Kris Maglione
4976d8b97a Bug 1269501: Part 1 - Add $PYTHON variable to environment for subprocess xpcshell tests. r=glandium
I'm not especially happy with this method, but the DMD tests are the only
other tests I can find doing anything like this, and I don't have a better
solution than doing it the same way.

MozReview-Commit-ID: JlclyKoUhRf
2016-05-08 20:33:36 -07:00
Andreas Tolfsen
a5114bd995 Bug 1240723 - Harmonise xpcshell head- and tail list computation; r=ted.mielczarek
Head- and tail entries in manifest files are not mandatory on
local/desktop xpcshell tests, and they should not be on remote/B2G either.

This change makes remotexpcshelltests and runxpcshelltests agree on how
to get head- and tail files.
2016-01-19 13:48:53 +00:00
Julian Seward
c3e7f8c2eb Bug 1222043 - Make "mach xpcshell-test" more TSan-friendly. r=ahalberstadt. 2015-11-25 12:38:20 +01:00
James Graham
8ee5cf605c Bug 1207747 - Ensure that logging command line options are always available when running xpcshell tests, r=chmanchester 2015-10-08 10:28:15 +01:00
Nicholas Hurley
d98fedcb8f Bug 1197847 - make debugging h2 and spdy test servers easier. r=mcmanus 2015-10-05 13:13:05 -07:00
Andrew Halberstadt
47ccfb9842 Bug 1206073 - [xpcshell] Fix default value for testingModulesDir when running from mach, r=jgraham 2015-09-18 10:00:40 -04:00
James Graham
2e444ca098 Bug 1193257 - Make xpcshell harness command line arguments path filters for tests, r=ahal 2015-09-17 10:51:02 +01:00
James Graham
1e629f9bf0 Bug 1193224 - Remove vestigial --tests-root-dir option from xpcshell tests, r=ahal 2015-09-17 10:51:00 +01:00
Nathan Froyd
0c4198a14a Bug 1196430 - part 6 - move cut-and-paste stack fixer code into mozrunner; r=wlach
This code is cut-and-pasted in several different places around the tree.
Let's put it in a common place.
2015-08-26 19:57:36 -04:00
Vaibhav Agrawal
228761e931 Bug 1197541 - Add --dump-tests option to mochitest and xpcshell for all tests that will be run. r=ahal 2015-08-21 17:16:11 -07:00
Nathan Froyd
6a4d92e5f5 Bug 1192291 - use llvm-symbolizer when running xpcshell tests under TSan; r=ted 2015-08-07 02:58:05 -04:00
Hiroyuki Ikezoe
ef939ac4ca Bug 1150818 - Part 2: Load mozinfo.json into xpcshell tests. r=ted 2015-08-20 16:06:00 -04:00
Andrew Halberstadt
5c1241cd79 Bug 1014760 - Move mozlog.structured to mozlog; Move mozlog to mozlog.unstructured, r=jgraham
Mozlog currently has two implementations. The top level package is based on the logging module and is
deprecated. The newer structured logging implementation lives in mozlog.structured. This patch swaps the
two, so the top level mozlog module contains the recommended implementation, while mozlog.unstructured
contains the old one.
2015-07-16 10:38:40 -04:00
Chris Manchester
aa30a01aa0 Bug 487494 - Pipe xpcshell's output through a stack fixer.;r=ted 2015-06-11 11:21:13 -07:00
Robert Strong
6ea6780b49 Bug 1169729 - Add prefixes to the mkdtemp calls in runxpcshelltests.py so it is easy to determine the directories that cause 'INFO Failed to remove directory' messages. r=ted 2015-06-01 11:52:21 -07:00
Wes Kocher
6b4d65d584 Merge inbound to m-c a=merge 2015-04-13 17:13:10 -07:00
Carsten "Tomcat" Book
ce29d8a0fc Merge mozilla-central to fx-team 2015-04-13 12:10:00 +02:00
Mark Hammond
ff13ce8179 Bug 1074014 - allow verbose=true in xpcshell test manifests. r=ted 2015-04-13 10:32:55 +10:00
Ehsan Akhgari
d1fd0f5c17 Bug 952211 follow-up: Only access path if debuggerInfo is set
Landed on a CLOSED TREE as bustage fix
2015-04-10 14:45:52 -04:00