Commit Graph

420 Commits

Author SHA1 Message Date
Alex Gaynor
478321d9d3 Bug 1294641 - whitelist reads from the .app directory in the macOS sandbox r=froydnj,haik
This patch does a few things:
a) Adds the resources location from the .app directory to the read whitelist
b) When it's a non-packaged build, mach run (and various mach tests) set an environment variable for the repo location which we allow reads from.

r=haik,froydnj

MozReview-Commit-ID: KNvAoUs5Ati
2017-04-07 14:53:19 -04:00
Sebastian Hengst
155e26d497 Backed out changeset 225683fed1d1 (bug 1294641) for breaking crashtests, reftests and Windows builds. r=backout on a CLOSED TREE 2017-04-17 16:29:52 +02:00
Alex Gaynor
d7af07ecbe Bug 1294641 - whitelist reads from the .app directory in the macOS sandbox r=froydnj,haik
This patch does a few things:
a) Adds the resources location from the .app directory to the read whitelist
b) When it's a non-packaged build, mach run (and various mach tests) set an environment variable for the repo location which we allow reads from.

r=haik,froydnj

MozReview-Commit-ID: KNvAoUs5Ati
2017-04-07 14:53:19 -04:00
Geoff Brown
44ef1ea889 Bug 1355800 - Improve test web server shutdown to avoid delays; r=jmaher
This eliminates a 2 minute timeout seen at the end of Android mochitests
and reftests. Attempts to shutdown the web server were failing because
they were directed at IP 10.0.2.2 -- the loopback address for the
Android emulator.
2017-04-13 14:33:42 -06:00
Geoff Brown
e2116c3fec Bug 1354042 - Delete pending crash reports between mochitests; r=jmaher 2017-04-09 11:31:19 -06:00
Chris Manchester
89472fea42 Bug 1354265 - Run process output through the stack fixer in mochitests. r=jgraham
MozReview-Commit-ID: LA4LCk9TetD
2017-04-06 12:58:28 -07:00
James Graham
bca13fbc91 Bug 1353858 - Fix ASAN leak detection in mochitest, r=ato
The gecko messages are now in the "process_output" action, rather than
in the "log" action (except for a few legacy cases), so examine both
when looking for LSAN messages.

MozReview-Commit-ID: 82r1p8WLwFa
2017-04-06 17:15:01 +01:00
Ting-Yu Chou
9c40f931c5 Bug 1333003 part 6 - Fix test scripts to run ASan on Windows. r=ted
MozReview-Commit-ID: 6F9UXgTRb2Y
2017-03-10 12:08:34 +08:00
Wes Kocher
3095b422dc Backed out 7 changesets (bug 1333003) for windows asan failures a=backout
Backed out changeset 3d2b2eeda8d3 (bug 1333003)
Backed out changeset 400d409ba4ca (bug 1333003)
Backed out changeset 1ba027abdfc9 (bug 1333003)
Backed out changeset 70114135bd8c (bug 1333003)
Backed out changeset 5715b15e33c0 (bug 1333003)
Backed out changeset 375e952bd738 (bug 1333003)
Backed out changeset d5d4112599f2 (bug 1333003)

MozReview-Commit-ID: DZUHJTdjX7V
2017-03-23 11:01:44 -07:00
Ting-Yu Chou
f66b5c4835 Bug 1333003 part 6 - Fix test scripts to run ASan on Windows. r=ted
MozReview-Commit-ID: 6F9UXgTRb2Y
2017-03-10 12:08:34 +08:00
Carsten "Tomcat" Book
88dfdca025 Backed out changeset 18fd8676751a (bug 1333003) 2017-03-23 10:38:04 +01:00
Ting-Yu Chou
f761f3c2a3 Bug 1333003 part 6 - Fix test scripts to run ASan on Windows. r=ted
MozReview-Commit-ID: 6F9UXgTRb2Y
2017-03-10 12:08:34 +08:00
Madeleine Chercover
fcb8c6aea1 Bug 1347241 - Enable linux64-ccov coverage collection for common tests set; r=gmierz,jmaher
MozReview-Commit-ID: FLyjCwMGb6L
2017-03-14 11:40:59 -07:00
J. Ryan Stinnett
4eca0d1a79 Bug 929535 - Use wait-for-jsdebugger with mochitests. r=Gijs
By using --wait-for-jsdebugger, we can allow the test suite to start
automatically and also ensure the JS debugger has a chance to connect.

There's still an extra click to get the tests running though (at least on macOS)
because the test harness needs to be focused and the extra process used for the
Browser Toolbox removes the focus from it.

MozReview-Commit-ID: 1Eg7lqG3KST
2017-03-13 11:10:04 -05:00
Andrew Halberstadt
5372c38ce5 Bug 1344346 - [mochitest] Log unstructured output as 'process_output', r=jgraham
Mochitest currently converts unstructured logs (e.g output from gecko) to 'info' messages. But
this means those messages won't be validated against mozharness' error logs. This change first
gets unstructured messages logged as process_output, and also ensures the StructuredOutputParser
in mozharness checks process_output messages against the error list.

MozReview-Commit-ID: KPTQnulwzyK
2017-03-03 16:28:22 -05:00
Iris Hsiao
235550c59e Backed out 3 changesets (bug 1344346) for mochitest shutdownleaks
Backed out changeset 71e3443cdc43 (bug 1344346)
Backed out changeset cd8993e4d0dd (bug 1344346)
Backed out changeset 8e03e57d44aa (bug 1344346)
2017-03-10 10:44:13 +08:00
Andrew Halberstadt
3adca9bea8 Bug 1344346 - [mochitest] Log unstructured output as 'process_output', r=jgraham
Mochitest currently converts unstructured logs (e.g output from gecko) to 'info' messages. But
this means those messages won't be validated against mozharness' error logs. This change first
gets unstructured messages logged as process_output, and also ensures the StructuredOutputParser
in mozharness checks process_output messages against the error list.

MozReview-Commit-ID: KPTQnulwzyK
2017-03-03 16:28:22 -05:00
Sebastian Hengst
3fe6c9ef3e Backed out changeset e6376870fa41 (bug 1344346) for failing at least web-platform-tests and robocop tests. r=backout 2017-03-09 18:36:39 +01:00
Andrew Halberstadt
9858dfa60f Bug 1344346 - [mochitest] Log unstructured output as 'process_output', r=jgraham
Mochitest currently converts unstructured logs (e.g output from gecko) to 'info' messages. But
this means those messages won't be validated against mozharness' error logs. This change first
gets unstructured messages logged as process_output, and also ensures the StructuredOutputParser
in mozharness checks process_output messages against the error list.

MozReview-Commit-ID: KPTQnulwzyK
2017-03-03 16:28:22 -05:00
Andrew Halberstadt
bef5cc1565 Bug 1340551 - Log tests by manifest from suite_start in mochitest harness, r=jgraham
MozReview-Commit-ID: 1lcw62fmofa
2017-02-22 14:36:31 -05:00
Greg Mierzwinski
c71d2a6dd7 Bug 1301984 - Add code coverage to mochitest-plain tests. r=jmaher
This patch allows the use of the flag '--jscov-dir-prefix' for mochitest plain tests to enable code coverage collection with the JS Debugger. It also enables the mochitest-plain tests for the linux64-jsdcov build platform.

MozReview-Commit-ID: 6RqMEZ1I0D7
2017-02-20 22:55:59 -05:00
Xidorn Quan
a96d0c0d0e Bug 1337674 part 3 - Add failure pattern file support to mochitest. r=jmaher
MozReview-Commit-ID: EcK8AJbXfwh
2017-02-16 16:41:50 +11:00
Andrew Halberstadt
20aafd83e6 Bug 1337828 - Improve mochitest 'no tests' error message, r=maja_zf
Include the current flavor in the "No tests found" error message. Also suggest
what may have went wrong.

MozReview-Commit-ID: 5LEQFVDoJrT
2017-02-09 09:55:23 -05:00
Bob Clary
a979244678 Bug 1279259 - make TURN server port configurable, r=jmaher. 2017-01-25 01:56:45 -08:00
Andrew Halberstadt
8632d2b677 Bug 1333049 - Remove leakcheck hack from mochitest harness, r=jmaher
MozReview-Commit-ID: LIamko4HHrX
2017-01-23 08:57:08 -05:00
Andrew Halberstadt
56f62a9777 Bug 1332573 - Always set status in mochitest even if no tests were found, r=pyang
This fixes a regression in bug 1332573 where if no tests are found by the getActiveTests
function, the status variable never gets set. This ensures that we always set status, and
that it will be set to a non-zero return code if any of the calls to runApp fail.

MozReview-Commit-ID: 20M7FcBs0DF
2017-01-20 09:37:52 -05:00
Phil Ringnalda
544a6303d7 Merge m-i to m-c, a=merge 2017-01-19 22:04:52 -08:00
Luke Wagner
79d58ceeb4 Bug 1332312 - remove JS_DISABLE_SLOW_SCRIPT_SIGNALS (r=bbouvier)
MozReview-Commit-ID: 6uyBGnbAimG
2017-01-19 14:06:24 -06:00
Wes Kocher
433f4d1d64 Merge m-c to inbound, a=merge
MozReview-Commit-ID: EMipuOLERUq
2017-01-18 15:39:49 -08:00
Wes Kocher
e05c5a9c50 Merge inbound to m-c a=merge
MozReview-Commit-ID: 3cGydlfeaPN
2017-01-18 14:17:10 -08:00
Geoff Brown
b741a421d0 Bug 1329034 - Increase default timeout on debug browser mochitests; r=jmaher 2017-01-18 07:56:49 -07:00
Andrew Halberstadt
c9519b3cc2 Bug 1331482 - Upload a list of manifests as an artifact in mochitest jobs r=jgraham
MozReview-Commit-ID: C0sVKADG70C
2017-01-12 15:29:47 -05:00
Kris Maglione
59798dbf4e Bug 1326456: Re-enable leak checks on OS-X. r=jmaher
MozReview-Commit-ID: 18a18QFaiEC
2017-01-05 14:53:55 -08:00
Phil Ringnalda
86429d1d93 Merge m-i to m-c, a=merge
MozReview-Commit-ID: 1NtOkt6oQ7d
2017-01-14 09:38:58 -08:00
Chris Peterson
acad849bd8 Bug 1330496 - Part 2: Remove mochitest use of MOZ_WIN_INHERIT_STD_HANDLES_PRE_VISTA. r=jmaher
MozReview-Commit-ID: LX8F53hVySp
2017-01-10 23:47:32 -08:00
pyang
9293d787ca Bug 1330867 - Clean urlOpts after each round of mochitest r=ahal
MozReview-Commit-ID: KThra7apcvp
2017-01-13 11:58:25 +08:00
pyang
1bb96c44c0 Bug 1286312 - cleanup with latest coding style r=ahal
MozReview-Commit-ID: wG2gTHl1H6
2017-01-06 21:52:33 +08:00
pyang
8d4b33418e Bug 1286312 - Add mochitest option to run tests using https r=ahal
MozReview-Commit-ID: EHooQEjEDfF
2017-01-06 21:51:13 +08:00
John Paul Adrian Glaubitz
a69adaf6ff Bug 1326496 - testing:mochitest: Use find_library to get libc filename. r=ahal
On architectures like alpha and ia64, the glibc does not use the
canonical ABI version number 6 but 6.1 and therefore the filename
of the C library is not libc.so.6 but libc.so.6.1. We're therefore
making the Python code more flexible and use find_library from
ctypes.util to determine the filename from the environment instead
of hard-coding it.
2016-12-30 14:34:51 +01:00
Andrew McCreight
a1c27b6ec8 Bug 1325275 - Re-enable leak testing on OSX in the prompts directory. r=ahal
MozReview-Commit-ID: FWoPApp6BRw
2017-01-09 10:27:28 -08:00
Andrew McCreight
e405b14d61 Bug 1325438 - Remove leak checking whitelist for tests/dom/xhr/tests. r=jmaher
MozReview-Commit-ID: 48elhM564zJ
2017-01-06 13:15:53 -08:00
Ryan VanderMeulen
127c9e5534 Merge inbound to m-c. a=merge 2017-01-07 11:22:47 -05:00
Andrew McCreight
1cb368cc03 Bug 1325277 - Re-enable leak checking for dom/animation/test/css-animations. r=ahal
MozReview-Commit-ID: LSlEw5tCcTx
2017-01-06 11:04:41 -08:00
Kris Maglione
e16b391efe Bug 1325141: Fix leak in Z-constrained windows on OS-X. r=enn,jmaher
MozReview-Commit-ID: J4NRd315XnT
2016-12-30 16:16:08 -08:00
Kris Maglione
a4bd91c8fa Bug 1325158: Part 5 - Re-enable leak checks for extension tests. r=jmaher
MozReview-Commit-ID: DnwAa2cdw7c
2016-12-29 11:55:20 -08:00
Joel Maher
e86b82ad71 Bug 1324592 - enable leak checking for gamepad mochitests. r=ahal
MozReview-Commit-ID: CvzAMkMJYt7
2017-01-06 11:33:45 -05:00
Andrew Halberstadt
6abf031bc5 Bug 1325148 - Temporarily disable mochitest leakchecking for directories containing known leaks, r=jmaher
Leak checking in mochitest was failing to turn the jobs orange for a period of time. Several leaks slipped
through in the interim. In order to land the fix ASAP to avoid further bustage, these leaks are being
whitelisted. See the patch or the dependency graph of bug 1325148 for the list of leaks/bugs that are being
disabled.

While these bugs won't show up in treeherder, they are a priority to fix, as they could represent leaks that
are already landed in the code.

MozReview-Commit-ID: JY7Gpvswp4r
2016-12-21 16:22:50 -05:00
Sebastian Hengst
1262e48c95 Backed out changeset 95ad94f3ef4b (bug 1325148) 2016-12-27 15:14:13 +01:00
Andrew Halberstadt
0c454b53c1 Bug 1325148 - Temporarily disable mochitest leakchecking for directories containing known leaks, r=jmaher
Leak checking in mochitest was failing to turn the jobs orange for a period of time. Several leaks slipped
through in the interim. In order to land the fix ASAP to avoid further bustage, these leaks are being
whitelisted. See the patch or the dependency graph of bug 1325148 for the list of leaks/bugs that are being
disabled.

While these bugs won't show up in treeherder, they are a priority to fix, as they could represent leaks that
are already landed in the code.

MozReview-Commit-ID: JY7Gpvswp4r
2016-12-21 16:22:50 -05:00
Andrew Halberstadt
611952d8c5 Bug 1324047 - Update testing/runtimes/writeruntimes.py for new e10s schema in ActiveData, r=jgriffin
At some point ActiveData stopped considering 'e10s' as a separate suite and instead stored this information
in the "run.type" field. This updates the writeruntimes.py script and mochitest runtime file resolving accordingly.

MozReview-Commit-ID: LSk2q0hafcm
2016-12-19 12:09:10 -05:00