Commit Graph

200 Commits

Author SHA1 Message Date
Geoff Brown
f6246c5baa Bug 1340233 - Take more care when killing browser before starting Android tests; r=jmaher
The devicemanager killProcess() is updated to use force-stop first, then
use kill if force-stop does not work.

Browser test harnesses are updated to check if killProcess() worked, and
warn if it failed.
2017-04-12 09:15:53 -06:00
Andrew Halberstadt
5372c38ce5 Bug 1344346 - [mochitest] Log unstructured output as 'process_output', r=jgraham
Mochitest currently converts unstructured logs (e.g output from gecko) to 'info' messages. But
this means those messages won't be validated against mozharness' error logs. This change first
gets unstructured messages logged as process_output, and also ensures the StructuredOutputParser
in mozharness checks process_output messages against the error list.

MozReview-Commit-ID: KPTQnulwzyK
2017-03-03 16:28:22 -05:00
Iris Hsiao
235550c59e Backed out 3 changesets (bug 1344346) for mochitest shutdownleaks
Backed out changeset 71e3443cdc43 (bug 1344346)
Backed out changeset cd8993e4d0dd (bug 1344346)
Backed out changeset 8e03e57d44aa (bug 1344346)
2017-03-10 10:44:13 +08:00
Andrew Halberstadt
3adca9bea8 Bug 1344346 - [mochitest] Log unstructured output as 'process_output', r=jgraham
Mochitest currently converts unstructured logs (e.g output from gecko) to 'info' messages. But
this means those messages won't be validated against mozharness' error logs. This change first
gets unstructured messages logged as process_output, and also ensures the StructuredOutputParser
in mozharness checks process_output messages against the error list.

MozReview-Commit-ID: KPTQnulwzyK
2017-03-03 16:28:22 -05:00
Sebastian Hengst
3fe6c9ef3e Backed out changeset e6376870fa41 (bug 1344346) for failing at least web-platform-tests and robocop tests. r=backout 2017-03-09 18:36:39 +01:00
Andrew Halberstadt
9858dfa60f Bug 1344346 - [mochitest] Log unstructured output as 'process_output', r=jgraham
Mochitest currently converts unstructured logs (e.g output from gecko) to 'info' messages. But
this means those messages won't be validated against mozharness' error logs. This change first
gets unstructured messages logged as process_output, and also ensures the StructuredOutputParser
in mozharness checks process_output messages against the error list.

MozReview-Commit-ID: KPTQnulwzyK
2017-03-03 16:28:22 -05:00
Chris Peterson
acad849bd8 Bug 1330496 - Part 2: Remove mochitest use of MOZ_WIN_INHERIT_STD_HANDLES_PRE_VISTA. r=jmaher
MozReview-Commit-ID: LX8F53hVySp
2017-01-10 23:47:32 -08:00
Andrew Halberstadt
4a195c2f56 Bug 1020516 - Pass options.quiet into mochitest MessageLogger via constructor, r=ted
For some reason we have a 'buffering' parameter in the MessageLogger constructor, but
then rather than using this, the mochitest harness modifies state after instantiation.
Using the constructor is easier to understand, and simplifies some of the logic in the
next couple of patches.

MozReview-Commit-ID: Jkd9hOlmiGZ
2016-11-02 13:42:57 -04:00
Andrew Halberstadt
ef275026dc Bug 1308202 - Merge MochitestBase and MochitestDesktop into a single class, r=jmaher
MozReview-Commit-ID: 737L08LhLDp
2016-10-06 10:16:06 -04:00
Andrew Halberstadt
0b5479bf7c Bug 1308202 - Remove all b2g and mulet related code from testing/mochitest, r=jmaher
MozReview-Commit-ID: BfIJLp6oGHO
2016-10-06 10:05:27 -04:00
Prabhjyot Singh Sodhi
55ca3ed6d4 Bug 1280571 - Add testing/mochitest to the flake8 linter, r=ahal
MozReview-Commit-ID: INBZaZzcPmF
2016-09-28 08:28:04 -04:00
Wes Kocher
18fb5792ef Backed out changeset e1d144423657 (bug 1280571) for making leaks hard to diagnose a=backout CLOSED TREE 2016-09-21 16:56:50 -07:00
Prabhjyot Singh Sodhi
ade7a9a0d9 Bug 1280571 - Add testing/mochitest to the flake8 linter, r=ahal
This also adds E402 (no imports at top of file) to the global ignore list. The
other error codes added were previously ignored by default, but now that we
have started a custom ignore list, need to be listed explicitly.

MozReview-Commit-ID: RtMuVEX6i5
2016-09-21 08:49:46 -04:00
Andrew Halberstadt
9e6b28f4ea Bug 1293295 - Replace all mochitest 'flavor' options with a single --flavor argument, r=jmaher
This accomplishes three things:

1) Easier to use CLI when running without the benefit of testing/mochitest/mach_commands.py
2) Guarantees these arguments are mutually exclusive
3) Simplifies a bunch of logic in the test harness

The primary motivation for this change is to slightly improve the UX when running mochitest
from a taskcluster interactive loaner. However, this is more of a bandaid solution that was
easy to implement before the proper fix in bug 1293259 can be landed.

MozReview-Commit-ID: IeHBGrJ0Sji
2016-08-08 11:48:49 -04:00
Andrew Halberstadt
cfc6df1ca7 Bug 1288827 - Allow running mochitest from test-package without specifying --appname, r=armenzg
Because it is now possible for options.app to get set after 'parse_args' time, we need to make sure
the argument validation happens later. To accomplish this we pass in the parser instance to
'run_test_harness' and do parser.validate there. This unfortunately requires some minor uses of
global to accomplish easily due to how mach handles parsers.

MozReview-Commit-ID: s3Js1aZlSE
2016-07-20 11:13:30 -04:00
Geoff Brown
f08c875540 Bug 1285663 - Optimize profile pushes and do not chmod files on /sdcard; r=bc 2016-07-14 10:36:31 -06:00
Honza Bambas
24d2808e57 Bug 1248565 - Make test infra use MOZ_LOG_FILE and MOZ_LOG_MODULES. r=jmaher 2016-03-11 08:27:00 -05:00
Geoff Brown
440b6cdd9c Bug 1252868 - Do not install superfluous addons for Android tests; r=jmaher 2016-03-02 09:23:42 -07:00
Andrew Halberstadt
5302f3c79d Bug 1247639 - Fix uncaught exception when running |mach mochitest| on Android, r=gbrown
MozReview-Commit-ID: 1s8x4zIhZSS
2016-02-11 16:09:45 -05:00
Andrew Halberstadt
9dcfc81d19 Bug 1231784 - Install specialpowers and mochikit extensions at runtime via AddonManager.loadTemporaryAddon(), r=jgriffin
MozReview-Commit-ID: 9I56x6Vnbf7
2016-01-25 09:55:57 -05:00
Wes Kocher
c4797ad496 Backed out 3 changesets (bug 1231784) for breaking 10.10 opt jetpack tests
Backed out changeset 653df21ca861 (bug 1231784)
Backed out changeset 0aac20bc3619 (bug 1231784)
Backed out changeset edcbd7c0aa36 (bug 1231784)
2016-02-03 17:38:12 -08:00
Andrew Halberstadt
f84ba669d4 Bug 1231784 - Install specialpowers and mochikit extensions at runtime via AddonManager.loadTemporaryAddon(), r=jgriffin 2016-01-25 09:55:57 -05:00
Bob Clary
6ff66c3513 Bug 1237465 - Work around Android 5.1+ permission restrictions by changing pushed directory permissions to rwx, r=gbrown. 2016-01-09 15:40:17 -08:00
Geoff Brown
baa90b3890 Bug 1228060 - Allow resource://testing-common references in Android mochitests; r=jmaher 2015-11-27 11:57:15 -07:00
Andrew Halberstadt
91a712cc51 Bug 1225903 - Drop support for b2g desktop in mochitest, r=jgriffin
Mochitests on b2g desktop are no longer being run on any trunk branches, including
b2g-inbound. Dropping support for it significantly reduces complexity
in the mochitest harness.
2015-11-18 13:35:38 -05:00
Wes Kocher
c0a054438a Backed out changeset 6ab228593820 (bug 1225903) for android robocop bustage CLOSED TREE 2015-11-19 11:54:17 -08:00
Andrew Halberstadt
d6e9ed3e7f Bug 1225903 - Drop support for b2g desktop in mochitest, r=jgriffin
Mochitests on b2g desktop are no longer being run on any trunk branches, including
b2g-inbound. Dropping support for it significantly reduces complexity
in the mochitest harness.
2015-11-18 13:35:38 -05:00
Andrew Halberstadt
0328985a1e Bug 1042998 - Use StructuredLog.jsm for mochitest logging, r=chmanchester 2015-09-04 14:37:32 -04:00
Geoff Brown
eb2268da9a Bug 1196814 - Fail Android mochitest, robocop, reftests when Fennec is not installed; r=jmaher 2015-09-02 14:20:01 -06:00
Kaustabh Datta Choudhury
79beb7ae9f Bug 1162003 - Enable run-by-dir mode on Fx desktop opt builds. r=jmaher 2015-08-11 08:25:00 -04:00
Geoff Brown
2b9a6d4589 Bug 1190975 - Do not dump device info and logcat when running mochitest via mach; r=jmaher 2015-08-06 07:27:47 -06:00
Geoff Brown
149d025aa3 Bug 1179981 - A new test harness for robocop; r=jmaher 2015-07-09 12:30:01 -06:00
Julien Pagès
9bd7c862a6 Bug 1177780 - remove useless stuff in automation.py. r=jgriffin 2015-06-26 22:45:18 +02:00
Andrew Halberstadt
2651e9f398 Bug 1171971 - Move test_paths argument out of mach and into mochitest; remove --test-path, r=chmanchester 2015-06-05 13:28:29 -04:00
Geoff Brown
80e831ccf6 Bug 1171303 - Set pref extensions.autoupdate.enabled to false to avoid testOfflinePage failures; r=mfinkle 2015-06-05 10:10:40 -06:00
Nick Alexander
f72af9b890 Bug 1169476 -- Implement |mach robocop --serve|. r=gbrown
This adds a flag to |mach robocop| that does everything to run a
Robocop test except launch the actual test.  Instead of launching the
test, it starts the mochi.test server and launches Fennec with a test
profile; then it sits and waits forever.

This allows regular Java IDEs (IntelliJ, but previously Eclipse) to
run Robocop tests like regular instrumentation tests, "injecting" them
into the prepared testing environment.  It's quite nice!
2015-05-29 17:18:07 -07:00
Nick Alexander
dd2910c8c6 Bug 1170332 - Fix |mach robocop SINGLE_TEST|. r=ahal,gbrown
This patch declares robocop.ini an instrumentation manifest.  It's not
currently possible to declare tests that don't correspond to files, so
we include the .java extension.  (This could be revisited.)

In |mach robocop|, we use the generic test resolving infrastructure to
select the 'instrumentation'/'robocop' flavor/subsuite tests.  In
|runtestsremote.py|, we fall back to robocop.ini, as we always have.
2015-06-01 14:45:48 -07:00
Carsten "Tomcat" Book
5fdf49ec4a Backed out changeset e91ac9a35f86 (bug 1169476) for android rc2 crashes 2015-06-01 09:38:42 +02:00
Nick Alexander
888eeac8d5 Bug 1169476 -- Implement |mach robocop --serve|. r=gbrown
This adds a flag to |mach robocop| that does everything to run a
Robocop test except launch the actual test.  Instead of launching the
test, it starts the mochi.test server and launches Fennec with a test
profile; then it sits and waits forever.

This allows regular Java IDEs (IntelliJ, but previously Eclipse) to
run Robocop tests like regular instrumentation tests, "injecting" them
into the prepared testing environment.  It's quite nice!
2015-05-25 14:27:21 -07:00
Geoff Brown
76cb837800 Bug 1162285 - Remove unused environment vars on Android; r=jmaher 2015-05-07 18:49:15 -06:00
Andrew Halberstadt
8162ad7d63 Bug 1155338 - Move mach command arguments into mochitest harness, r=chmanchester,gbrown 2015-04-30 13:47:01 -04:00
Phil Ringnalda
32ac011754 Back out f4f4e2be3765 (bug 1155338) for Android 4.0/debug mochitest bustage
CLOSED TREE
2015-05-04 18:28:16 -07:00
Andrew Halberstadt
8d7332d88e Bug 1155338 - Move mach command arguments into mochitest harness, r=chmanchester,gbrown 2015-04-30 13:47:01 -04:00
Nick Alexander
8ef8e986c9 Bug 1160324 - Handle missing robocopApk files in runtestsremote.py. r=gbrown 2015-04-30 14:28:14 -07:00
Andrew Halberstadt
0f300312cf Bug 1147129 - upgrade mochitest from optparse to argparse and move android cli to mochitest_options.py, r=chmanchester 2015-03-24 17:42:24 -04:00
JW Wang
d62906cd4d Bug 1043403 - Support clear-key in Mochitest on B2G. r=ted. 2015-03-31 10:32:15 +08:00
Andrew Halberstadt
37afafc1a3 Bug 1131098 - Make mochitest use manifestparser's chunking algorithms and remove JS based ones, r=jmaher 2015-03-10 09:55:30 -04:00
Geoff Brown
5859050614 Bug 1134245 - Improve formatting of devicemanager getInfo() data; r=bc 2015-02-27 13:15:00 -07:00
Andrew Halberstadt
a729c1fa7d Bug 1127376 - PEP8-ify all mochitest .py files (auto-generated), r=ted
This change was generated using the `autopep8` module [1]. To replicate:

    $ pip install --upgrade autopep8
    $ cd gecko
    $ autopep8 -i -a -a -r testing/mochitest --exclude 'testing/mochitest/pywebsocket/*'

[1] https://github.com/hhatto/autopep8
2015-02-13 14:42:02 -05:00
Masatoshi Kimura
f4636fca5b Bug 1092835 - Workaround for old ssltunnel from hostutils. r=jmaher 2014-12-13 20:09:00 +09:00