Commit Graph

124 Commits

Author SHA1 Message Date
Shing Lyu
31f3c06eb7 Bug 1359288 - Enable Android reftest to resume from crashes. r=jmaher
MozReview-Commit-ID: EqTOdEwfTWi
2017-05-10 10:38:48 +08:00
Shing Lyu
a4a7e11348 Bug 1344991 - Continue reftest after a crash r=dbaron,jmaher
MozReview-Commit-ID: CTUaweql66d
2017-03-09 10:49:20 +08:00
Geoff Brown
44ef1ea889 Bug 1355800 - Improve test web server shutdown to avoid delays; r=jmaher
This eliminates a 2 minute timeout seen at the end of Android mochitests
and reftests. Attempts to shutdown the web server were failing because
they were directed at IP 10.0.2.2 -- the loopback address for the
Android emulator.
2017-04-13 14:33:42 -06:00
Carsten "Tomcat" Book
cd13d12db4 Backed out changeset 6bbf9c0c5dac (bug 1344991) for causing bug 1356002 2017-04-13 09:47:01 +02:00
Wes Kocher
15e788d2f7 Merge inbound to central, a=merge 2017-04-12 14:39:09 -07:00
Geoff Brown
f6246c5baa Bug 1340233 - Take more care when killing browser before starting Android tests; r=jmaher
The devicemanager killProcess() is updated to use force-stop first, then
use kill if force-stop does not work.

Browser test harnesses are updated to check if killProcess() worked, and
warn if it failed.
2017-04-12 09:15:53 -06:00
Geoff Brown
eefd2fe813 Bug 1355222 - When debug logging requested for android mach test commands, enable devicemanager logging; r=jmaher 2017-04-11 09:21:37 -06:00
Shing Lyu
2774d8a2f0 Bug 1344991 - Continue reftest after a crash r=dbaron,jmaher
MozReview-Commit-ID: CTUaweql66d
2017-03-09 10:49:20 +08:00
Geoff Brown
b72a74a2a6 Bug 1340584 - Remove devicemanagerSUT and references to sutagent; r=wlach
sutagent is no longer built or used; devicemanagerSUT is completely
unused. After this change, devicemanagerADB is the only implementation of
devicemanager, and test harness options like --dm_trans are eliminated.
2017-03-21 12:20:01 -06:00
Deepa
bb63c1ff3d Bug 1280572 - Add layout/tools/reftest to flake8 linter r=ahal
MozReview-Commit-ID: Cqllz9BeV7X
2017-02-15 01:20:56 +05:30
Andrew Halberstadt
431727cd2d Bug 1301431 - Pass in adb_path to devicemanager if specified in Android reftests, r=gbrown
When using an interactive loaner, we compute an explicit path to the adb binary. Passing it in
directly to mozdevice seems a bit cleaner than modifying the $PATH. This also does a minor
refactor around how the DM instances are instantiated.

MozReview-Commit-ID: 5HMfm64wmK2
2016-09-13 09:07:05 -04:00
Andrew Halberstadt
15edcff113 Bug 1301431 - Change reftest harness to accept Namespace object instead of kwargs, r=armenzg
Reftests hackily create a second argument parser and set defaults on it to get around the fact
that the mach command sends the harness a dict rather than a Namespace object. This is bad because:

1. It's much less hacky to just create a Namespace object directly (rather than making a second parser)
2. Most other mach commands actually *do* return a Namespace object, reftest is the odd one out here.

So this patch makes the reftest mach commands convert to the Namespace object, which allows us to get
rid of the hacks in the reftest harness. This also does some light refactoring of the entry points to
the reftest harness so make it more consistent with mochitest and xpcshell.

MozReview-Commit-ID: 5HMfm64wmK2
2016-09-13 09:26:09 -04:00
Geoff Brown
274e07563a Bug 1298023 - Remove some redundant android reftest prefs; r=jmaher 2016-09-02 15:09:03 -06:00
Benjamin Smedberg
b6342360ed Bug 1277905 - Remove in-product links to plugincheck. Also remove support for startup prompting about outdated plugins, since that's annoying to users. r=Gijs r=mconley
MozReview-Commit-ID: 69tMivPVxuW
2016-07-01 11:01:07 -04:00
Andrew Halberstadt
d126feb632 Bug 1245092 - Install reftest and specialpowers extensions at runtime via AddonManager.installTemporaryAddon, r=jgriffin
MozReview-Commit-ID: 5HSa3nFVTeF
2016-03-09 14:38:13 -05:00
chaithanya
831e1eaef7 Bug 1243435 Remove unused prefs toolkit.telemetry.prompted / toolkit.telemetry.notifiedOptOut from test suites r=Dexter
MozReview-Commit-ID: 83IOB4Xvf8I
2016-02-18 10:51:24 -08:00
Carsten "Tomcat" Book
dd5022dba4 Backed out changeset 53b0b5b29776 (bug 1243435) 2016-02-17 15:00:51 +01:00
chaithanya
9a90dcbb99 Bug 1243435 - Remove unused prefs toolkit.telemetry.prompted / toolkit.telemetry.notifiedOptOut from test suite. r=Dexter 2016-02-16 05:11:00 +01:00
Andrew Halberstadt
a8bca414a2 Bug 1247054 - Fix |mach reftest| on Android, r=gbrown
There is an ImportError on Android, as well as a log related
regression from the structured log patch once that is fixed.

MozReview-Commit-ID: KxSEotr38qO
2016-02-09 16:19:44 -05:00
Andrew Halberstadt
94aeaa27a9 Bug 1034290 - Use structured log output for test results in reftest, r=jmaher
Structured logs bring many benefits. We can stop parsing the logs for magic strings, we
can modify the format without breaking things, and we can stream results into systems like
ActiveData. The structured logs originate primarily in reftest.js. StructuredLog.jsm is
used to generate the JSON-based log stream. Finally OutputHandler in the python harness
reads structured output from stdout, and formats it into human readable form.

MozReview-Commit-ID: G3ZLkMRl6p7
2016-02-05 15:44:20 -05:00
Phil Ringnalda
c5159ef2e2 Back out d1779fe421c3 (bug 1034290) for UnicodeDecodeErrors in things run by the reftest harness
CLOSED TREE
2016-02-05 08:18:47 -08:00
Andrew Halberstadt
515a1ec282 Bug 1034290 - Use structured log output for test results in reftest, r=jmaher
Structured logs bring many benefits. We can stop parsing the logs for magic strings, we
can modify the format without breaking things, and we can stream results into systems like
ActiveData. The structured logs originate primarily in reftest.js. StructuredLog.jsm is
used to generate the JSON-based log stream. Finally OutputHandler in the python harness
reads structured output from stdout, and formats it into human readable form.
2015-10-29 15:01:44 -04:00
Bob Clary
6ff66c3513 Bug 1237465 - Work around Android 5.1+ permission restrictions by changing pushed directory permissions to rwx, r=gbrown. 2016-01-09 15:40:17 -08:00
Geoff Brown
7cac099d42 Bug 1087791 - Add |mach {reftest,crashtest,jstestbrowser}| for mobile/android. r=nalexander 2015-10-14 15:20:20 -06:00
Eugen Sawin
1dd4606ea5 Bug 1188240 - Enable media auto-play for tests to allow for script play() invocations. r=snorp 2015-10-01 18:15:40 +02:00
James Willcox
7a2b4bf5d1 Bug 1182665 - Turn off tile size adjustments on pandaboard debug reftests due to weirdness r=nical 2015-09-28 09:37:02 -05:00
Julian Seward
ad8e3b37e6 Bug 1185244 - Improve mach support for running mochitests on Valgrind. r=jgraham, njn. 2015-09-28 12:01:42 +02:00
Wes Kocher
ca09e9719a Backed out changeset feceb41f1c3c (bug 1185244) for breaking running tests locally CLOSED TREE a=backout 2015-09-22 17:08:37 -07:00
Julian Seward
a9dcbc18a5 Bug 1185244 - Improve mach support for running mochitests on Valgrind. r=jgraham, njn. 2015-09-22 12:00:57 +02:00
James Graham
ea97d39711 Bug 1181516 - Allow reftests to take paths to multiple directories containing tests on the command line, r=jmaher
This makes reftest command line arguments behave more like other test suites,
so we can use a simple unified syntax for e.g. |mach try|. The patch also
reworks the command line argument parsing to use argparse rather than optparse,
and causes mach to reuse the same parser as the suite.
2015-09-17 10:50:55 +01:00
Gian-Carlo Pascutto
882c9fd75f Bug 1107372 - Update preferences for new SafeBrowsing prefs structure. r=francois 2015-09-08 08:22:10 +02:00
Geoff Brown
eb2268da9a Bug 1196814 - Fail Android mochitest, robocop, reftests when Fennec is not installed; r=jmaher 2015-09-02 14:20:01 -06:00
Carsten "Tomcat" Book
f5a2ce7b81 Backed out changeset 2734a3110b4a (bug 1107372) for Talos Bustage on a CLOSED TREE 2015-08-31 16:19:39 +02:00
Gian-Carlo Pascutto
c98015f382 Bug 1107372 - Update preferences for new SafeBrowsing prefs structure. r=francois 2015-08-27 10:05:23 +02:00
Kartikaya Gupta
b938c9d021 Bug 1180267 - Switch Fennec over to using the MobileViewportManager for computing the CSS viewport. r=snorp 2015-08-24 13:45:45 -04:00
Michael Layzell
9eea5cce57 Bug 1165263 - Part 4: Update reftest runners to support new moz_hosts schema, r=dbaron 2015-07-16 14:49:57 -04:00
Geoff Brown
6bde032b2e Bug 1183717 - Increase default timeout for Android Debug reftests; r=jmaher 2015-07-16 06:20:08 -06:00
Wes Kocher
c06754ff70 Backed out 24 changesets (bug 1173523, bug 1172080, bug 817007, bug 1165263) for android reftest bustage CLOSED TREE
Backed out changeset 84fe04b2e7d1 (bug 1172080)
Backed out changeset 0ff004760a1f (bug 1172080)
Backed out changeset af147585ad55 (bug 1165263)
Backed out changeset c3af8ebb6db0 (bug 1165263)
Backed out changeset cd3f33a888fe (bug 1165263)
Backed out changeset e5db39044a1e (bug 1165263)
Backed out changeset c01c9ed77061 (bug 1165263)
Backed out changeset fb723aaa4267 (bug 1165263)
Backed out changeset f754e52e74dc (bug 1165263)
Backed out changeset c6bda3a0afd6 (bug 817007)
Backed out changeset bfa100253349 (bug 817007)
Backed out changeset b787b3f9aadc (bug 1173523)
Backed out changeset 4a0676b73f77 (bug 1173523)
Backed out changeset 82034a4560c5 (bug 1173523)
Backed out changeset 4bdb91114c7a (bug 1173523)
Backed out changeset 72406261eccc (bug 1173523)
Backed out changeset 541b6faf7196 (bug 1173523)
Backed out changeset 1caac4569616 (bug 1173523)
Backed out changeset 0d4f9f9e1b4e (bug 1173523)
Backed out changeset 2d5661eb966c (bug 1173523)
Backed out changeset 89833c0bb0cd (bug 1173523)
Backed out changeset ea64d70eacfe (bug 1173523)
Backed out changeset a8e4f1c0c445 (bug 1173523)
Backed out changeset cf498d466b85 (bug 1173523)
2015-07-14 14:00:32 -07:00
Michael Layzell
68b81f9ebf Bug 1165263 - Part 4: Update reftest runners to support new moz_hosts schema, r=dbaron 2015-07-14 15:06:36 -04:00
Geoff Brown
76cb837800 Bug 1162285 - Remove unused environment vars on Android; r=jmaher 2015-05-07 18:49:15 -06:00
Geoff Brown
5859050614 Bug 1134245 - Improve formatting of devicemanager getInfo() data; r=bc 2015-02-27 13:15:00 -07:00
Eugen Sawin
aeef55ac54 Bug 792992 - Make update URL configurable via pref. r=snorp 2015-02-03 17:18:13 +01:00
James Willcox
231ac7d192 Bug 1110271 - Enable GMPInstallManager on Android r=mfinkle 2015-01-05 11:03:27 -06:00
Bob Clary
264f305a3f Bug 1079931 - Update reftest remotereftest.py to support connecting to device by serial number, r=ahal. 2014-10-15 07:09:16 -07:00
Ted Mielczarek
b04fee7d27 bug 915865 - port reftest to mozbase. r=ahal 2014-07-29 11:47:50 -04:00
Andrew McCreight
11c6399dd7 Bug 1076969 - processLeakLog should come up with reasonable defaults itself. r=jmaher
Instead of grabbing attributes off options at every call site, pass
in the options object to processLeakLog, and attempt to get the attributes
there. If not present, use a restrictive default value.

This will prevent silent harness failures if one of the many ways to invoke
processLeakLog fails to set up these options, and makes it so they
don't have to set it up if they don't care.
2014-10-06 14:23:17 -07:00
Andrew McCreight
30014b26b9 Bug 1068276, part 1 - Allow configuring which type of processes we complain about when there's no leak log. r=jmaher
Then don't warn for missing logs from tab and geckomediaplugin processes, or default processes on B2G.
2014-09-30 14:17:27 -07:00
Andrew McCreight
4c9a0b67c6 Bug 1067664, part 1 - Allow different leak thresholds for different types of processes. r=jmaher 2014-09-30 09:54:25 -07:00
Geoff Brown
86d444e03c Bug 1042097 - Upload Android tombstones to blobber; r=dminor 2014-08-11 11:55:28 -06:00
William Lachance
3b31c2fadb Bug 1036530 - Instantiate / initialize device root only when needed in mozdevice. r=bc 2014-07-11 15:29:30 -04:00