Commit Graph

31 Commits

Author SHA1 Message Date
Geoff Brown
f6246c5baa Bug 1340233 - Take more care when killing browser before starting Android tests; r=jmaher
The devicemanager killProcess() is updated to use force-stop first, then
use kill if force-stop does not work.

Browser test harnesses are updated to check if killProcess() worked, and
warn if it failed.
2017-04-12 09:15:53 -06:00
Geoff Brown
b72a74a2a6 Bug 1340584 - Remove devicemanagerSUT and references to sutagent; r=wlach
sutagent is no longer built or used; devicemanagerSUT is completely
unused. After this change, devicemanagerADB is the only implementation of
devicemanager, and test harness options like --dm_trans are eliminated.
2017-03-21 12:20:01 -06:00
Andrew Halberstadt
5372c38ce5 Bug 1344346 - [mochitest] Log unstructured output as 'process_output', r=jgraham
Mochitest currently converts unstructured logs (e.g output from gecko) to 'info' messages. But
this means those messages won't be validated against mozharness' error logs. This change first
gets unstructured messages logged as process_output, and also ensures the StructuredOutputParser
in mozharness checks process_output messages against the error list.

MozReview-Commit-ID: KPTQnulwzyK
2017-03-03 16:28:22 -05:00
Iris Hsiao
235550c59e Backed out 3 changesets (bug 1344346) for mochitest shutdownleaks
Backed out changeset 71e3443cdc43 (bug 1344346)
Backed out changeset cd8993e4d0dd (bug 1344346)
Backed out changeset 8e03e57d44aa (bug 1344346)
2017-03-10 10:44:13 +08:00
Andrew Halberstadt
3adca9bea8 Bug 1344346 - [mochitest] Log unstructured output as 'process_output', r=jgraham
Mochitest currently converts unstructured logs (e.g output from gecko) to 'info' messages. But
this means those messages won't be validated against mozharness' error logs. This change first
gets unstructured messages logged as process_output, and also ensures the StructuredOutputParser
in mozharness checks process_output messages against the error list.

MozReview-Commit-ID: KPTQnulwzyK
2017-03-03 16:28:22 -05:00
Andrew Halberstadt
bef5cc1565 Bug 1340551 - Log tests by manifest from suite_start in mochitest harness, r=jgraham
MozReview-Commit-ID: 1lcw62fmofa
2017-02-22 14:36:31 -05:00
Chris Peterson
acad849bd8 Bug 1330496 - Part 2: Remove mochitest use of MOZ_WIN_INHERIT_STD_HANDLES_PRE_VISTA. r=jmaher
MozReview-Commit-ID: LX8F53hVySp
2017-01-10 23:47:32 -08:00
Ehsan Akhgari
9916b175a4 Bug 1318879 - Remove the app related code from mozprofile; r=ahal 2016-11-21 18:56:08 -05:00
Andrew Halberstadt
ef275026dc Bug 1308202 - Merge MochitestBase and MochitestDesktop into a single class, r=jmaher
MozReview-Commit-ID: 737L08LhLDp
2016-10-06 10:16:06 -04:00
Prabhjyot Singh Sodhi
55ca3ed6d4 Bug 1280571 - Add testing/mochitest to the flake8 linter, r=ahal
MozReview-Commit-ID: INBZaZzcPmF
2016-09-28 08:28:04 -04:00
Wes Kocher
18fb5792ef Backed out changeset e1d144423657 (bug 1280571) for making leaks hard to diagnose a=backout CLOSED TREE 2016-09-21 16:56:50 -07:00
Prabhjyot Singh Sodhi
ade7a9a0d9 Bug 1280571 - Add testing/mochitest to the flake8 linter, r=ahal
This also adds E402 (no imports at top of file) to the global ignore list. The
other error codes added were previously ignored by default, but now that we
have started a custom ignore list, need to be listed explicitly.

MozReview-Commit-ID: RtMuVEX6i5
2016-09-21 08:49:46 -04:00
Andrew Halberstadt
cfc6df1ca7 Bug 1288827 - Allow running mochitest from test-package without specifying --appname, r=armenzg
Because it is now possible for options.app to get set after 'parse_args' time, we need to make sure
the argument validation happens later. To accomplish this we pass in the parser instance to
'run_test_harness' and do parser.validate there. This unfortunately requires some minor uses of
global to accomplish easily due to how mach handles parsers.

MozReview-Commit-ID: s3Js1aZlSE
2016-07-20 11:13:30 -04:00
Michael Comella
f8043d69fd Bug 1261494 - Reduce telemetry init delay to 1 second for integration testing. r=gbrown
My one concern is that this change could increase the amount of processing
time spent on telemetry initialization, causing the runtime of the robocop
test suite to increase. Checking my try push [1] against other try pushes,
it doesn't seem to have made a significant difference, but the change
in runtime between pushes can be large (e.g. > 5min) so it's hard to
tell.

[1]: https://treeherder.mozilla.org/#/jobs?repo=try&revision=2017843315fe&selectedJob=24641374

MozReview-Commit-ID: LeeGgNEp74h
2016-07-27 08:05:12 -07:00
Nathan Froyd
a8f5fc3828 Bug 1269349 - make robocop honor --timeout; r=gbrown
Our testsuites normally disable timeouts when --debugger or similar
options are specified.  Robocop doesn't do this, because apparently the
best way to debug Robocop tests is to |mach robocop [TEST-NAMES...]|,
wait for the browser window to show, and then connect a debugger.  This
setup seems suboptimal.

The setup being what it is, though, implies that runrobocop.py has no
knowledge of a debugger being connected, and therefore no idea that the
test really shouldn't time out.  Which then leads to the test going away
at that crucial moment when you are this > < close to figuring out the
bug.  Let's make runrobocop.py understand that --timeout means something
useful for such a context.
2016-05-05 11:25:54 -04:00
Nathan Froyd
f6abe50862 Bug 1266198 - support --setenv options for robocop tests; r=gbrown 2016-04-21 11:13:14 -04:00
Honza Bambas
24d2808e57 Bug 1248565 - Make test infra use MOZ_LOG_FILE and MOZ_LOG_MODULES. r=jmaher 2016-03-11 08:27:00 -05:00
Andrew Halberstadt
83a6a0e8b7 Bug 1250616 - Update extension names in runrobocop.py, r=gbrown
MozReview-Commit-ID: 5QAJiIL3pph
2016-03-08 10:35:38 -05:00
Phil Ringnalda
559d0a70c5 Back out 3 changesets (bug 1250616, bug 1251372) for failing browser_checkAddonCompatibility.js after the version bump
CLOSED TREE

Backed out changeset 4fa5b5a25f04 (bug 1251372)
Backed out changeset 502cf531ec26 (bug 1250616)
Backed out changeset 2f25d03334b2 (bug 1250616)
2016-03-08 19:04:46 -08:00
Andrew Halberstadt
b861a2ee32 Bug 1250616 - Update extension names in runrobocop.py, r=gbrown
MozReview-Commit-ID: 5QAJiIL3pph
2016-03-08 10:35:38 -05:00
Geoff Brown
440b6cdd9c Bug 1252868 - Do not install superfluous addons for Android tests; r=jmaher 2016-03-02 09:23:42 -07:00
Andrew Halberstadt
5302f3c79d Bug 1247639 - Fix uncaught exception when running |mach mochitest| on Android, r=gbrown
MozReview-Commit-ID: 1s8x4zIhZSS
2016-02-11 16:09:45 -05:00
Simon Gareste
388e7bd6f8 Bug 1231806 - Fix trailing space in function description. r=ted 2015-12-28 03:22:43 -05:00
Simon Gareste
a31a4bcb8a Bug 1231806 - Fix continuation line under-indented for visual indent. r=ted 2015-12-21 14:22:06 -05:00
Andrew Halberstadt
91a712cc51 Bug 1225903 - Drop support for b2g desktop in mochitest, r=jgriffin
Mochitests on b2g desktop are no longer being run on any trunk branches, including
b2g-inbound. Dropping support for it significantly reduces complexity
in the mochitest harness.
2015-11-18 13:35:38 -05:00
Nick Alexander
467819eda0 Bug 1219058 - Part 1: Normalize Robocop test source layout. r=gbrown,mfinkle
This moves the Robocop test code into src/org/mozilla/gecko/tests.
The org/mozilla/gecko/tests matches the package name we have now.
2015-10-27 16:45:00 -07:00
Nick Alexander
67c8886684 Backed out changesets fb5765dffe01 and 0447429a5627 (Bug 1219058). r=me
I realize I wanted to shorten these paths in response to review
comments.  I'll reland shortly.
2015-10-28 14:47:14 -07:00
Nick Alexander
02f15bcb09 Bug 1219058 - Part 1: Normalize Robocop test source layout. r=gbrown,mfinkle
This moves the Robocop test code into
src/androidTest/java/org/mozilla/gecko/tests.  The
src/androidTest/java is Gradle standard; the org/mozilla/gecko/tests
matches the package name we have now.
2015-10-27 16:45:00 -07:00
Geoff Brown
eb093f9e91 Bug 1207461 - Fix symbols path for robocop crash reporting; r=jmaher 2015-10-05 15:37:20 -06:00
Geoff Brown
eb2268da9a Bug 1196814 - Fail Android mochitest, robocop, reftests when Fennec is not installed; r=jmaher 2015-09-02 14:20:01 -06:00
Geoff Brown
149d025aa3 Bug 1179981 - A new test harness for robocop; r=jmaher 2015-07-09 12:30:01 -06:00