Commit Graph

26 Commits

Author SHA1 Message Date
Andrew Halberstadt
ecb053eb1f Bug 1372981 - Limit reftest to 4 attempts at recovering after a crash, r=jmaher
MozReview-Commit-ID: IEfM1b6FTHD
2017-06-14 13:25:59 -04:00
Geoff Brown
5d3632889b Bug 1364228 - Increase marionette startup timeout for Linux mochitests; r=ato
Our linux32-debug build is very slow to startup when running mochitests on aws.
Sometimes we see similar behavior on other linux platforms. Intermittently,
in this environment, startup takes longer than the 120 seconds that marionette
waits, resulting in test failures in bug 1261598. Increasing the marionette
startup timeout to 180 seconds appears to effectively avoid these failures.
2017-05-17 10:30:32 -06:00
Geoff Brown
b72a74a2a6 Bug 1340584 - Remove devicemanagerSUT and references to sutagent; r=wlach
sutagent is no longer built or used; devicemanagerSUT is completely
unused. After this change, devicemanagerADB is the only implementation of
devicemanager, and test harness options like --dm_trans are eliminated.
2017-03-21 12:20:01 -06:00
Geoff Brown
41d4582c4d Bug 1340584 - Change reftest dm_trans default from sut to adb; r=bc 2017-03-16 20:29:57 -06:00
Wes Kocher
0fb51d45d6 Backed out changeset e73241bcb49a (bug 1340584) for Windows build failures a=backout CLOSED TREE
MozReview-Commit-ID: 22csfCgl7Wb
2017-03-16 10:25:15 -07:00
Geoff Brown
24947f9d75 Bug 1340584 - Remove devicemanagerSUT and references to sutagent; r=wlach
sutagent is no longer built or usedr; devicemanagerSUT is completely
unused. After this change, devicemanagerADB is the only implementation of
devicemanager, and the --dmTrans and similar options have been removed
from test harnesses and mach commands.
2017-03-16 10:44:44 -06:00
Deepa
bb63c1ff3d Bug 1280572 - Add layout/tools/reftest to flake8 linter r=ahal
MozReview-Commit-ID: Cqllz9BeV7X
2017-02-15 01:20:56 +05:30
Andrew Halberstadt
b6864170d2 Bug 1330772 - Remove all b2g related code from reftests, r=jmaher
MozReview-Commit-ID: HY1XbcliTNA
2017-01-12 16:37:37 -05:00
Ryan VanderMeulen
69c29674a5 Bug 1263230 - Remove in-tree references to IPC/OOP reftest modes. r=ahal 2016-11-07 08:59:49 -05:00
Andrew Halberstadt
431727cd2d Bug 1301431 - Pass in adb_path to devicemanager if specified in Android reftests, r=gbrown
When using an interactive loaner, we compute an explicit path to the adb binary. Passing it in
directly to mozdevice seems a bit cleaner than modifying the $PATH. This also does a minor
refactor around how the DM instances are instantiated.

MozReview-Commit-ID: 5HMfm64wmK2
2016-09-13 09:07:05 -04:00
Andrew Halberstadt
a5e68e668c Bug 1278890 - Add reftest support to test package mach environment, r=armenzg
This adds reftest support to the test package mach environment. It will allow
developers to easily run reftests after checking out an interactive worker.

MozReview-Commit-ID: fBAbfuG5XQ
2016-07-13 10:57:22 -04:00
Geoff Brown
d905d04224 Bug 1274395 - Delete pending crash reports before running tests; r=jmaher 2016-05-25 14:48:42 -06:00
Andrew Halberstadt
5ee1903599 Bug 1265124 - [reftest] Make sure marionette waits long enough when attaching a debugger, r=chmanchester
As of bug 1245092, reftest depends on marionette. Normally marionette client has an internal timeout of around
60 seconds where it waits for the server to become available. But when using debuggers (and especially valgrind),
it can take much much longer than a minute for Firefox to start. This patch adds a couple hidden command line
args to reftest to tweak the marionette timeouts.

MozReview-Commit-ID: 3xF0InBJNEf
2016-04-29 15:41:23 -04:00
Andrew Halberstadt
1deb0ab7a1 Bug 1243083 - Enable e10s by default when running reftests, r=jmaher
MozReview-Commit-ID: NlTGwdQ2nw
2016-04-01 11:00:37 -04:00
Xidorn Quan
a36662db03 Bug 1257099 - Normalize the path of extensions for reftest. r=jmaher
MozReview-Commit-ID: 7nTx3uniJik
2016-03-16 14:26:27 +08:00
Andrew Halberstadt
d126feb632 Bug 1245092 - Install reftest and specialpowers extensions at runtime via AddonManager.installTemporaryAddon, r=jgriffin
MozReview-Commit-ID: 5HSa3nFVTeF
2016-03-09 14:38:13 -05:00
Stanley Mwangi
db8c66f2c1 Bug 1243083 - Added --disable-e10s to mochitest_options.py and reftestcommandline.py. r=ahal
MozReview-Commit-ID: I3UIS8eEZ8D
2016-03-02 16:33:13 -05:00
Andrew Halberstadt
94aeaa27a9 Bug 1034290 - Use structured log output for test results in reftest, r=jmaher
Structured logs bring many benefits. We can stop parsing the logs for magic strings, we
can modify the format without breaking things, and we can stream results into systems like
ActiveData. The structured logs originate primarily in reftest.js. StructuredLog.jsm is
used to generate the JSON-based log stream. Finally OutputHandler in the python harness
reads structured output from stdout, and formats it into human readable form.

MozReview-Commit-ID: G3ZLkMRl6p7
2016-02-05 15:44:20 -05:00
Phil Ringnalda
c5159ef2e2 Back out d1779fe421c3 (bug 1034290) for UnicodeDecodeErrors in things run by the reftest harness
CLOSED TREE
2016-02-05 08:18:47 -08:00
Andrew Halberstadt
515a1ec282 Bug 1034290 - Use structured log output for test results in reftest, r=jmaher
Structured logs bring many benefits. We can stop parsing the logs for magic strings, we
can modify the format without breaking things, and we can stream results into systems like
ActiveData. The structured logs originate primarily in reftest.js. StructuredLog.jsm is
used to generate the JSON-based log stream. Finally OutputHandler in the python harness
reads structured output from stdout, and formats it into human readable form.
2015-10-29 15:01:44 -04:00
Benoit Girard
113d42ce34 Bug 1196831 - Add 'run-until-failure' and 'repeat' flags to reftest. r=jmaher 2016-01-15 18:30:23 -05:00
Andrew Halberstadt
29793413d8 Bug 1226017 - Drop support for b2g desktop in reftests, r=jgriffin 2015-11-27 13:56:43 -05:00
Geoff Brown
d168d63a53 Bug 1087791 - Follow-up on 340c1df41b69 (pushed wrong version of patch); r=nalexander 2015-10-14 16:31:19 -06:00
Geoff Brown
7cac099d42 Bug 1087791 - Add |mach {reftest,crashtest,jstestbrowser}| for mobile/android. r=nalexander 2015-10-14 15:20:20 -06:00
Daniel Holbert
00bbf911fa Bug 1206230: Make ReftestArgumentsParser defer to self.build_obj for 'bindir' (fixing local mach reftest|crashtest runs). r=jgraham 2015-09-20 00:03:13 -07:00
James Graham
ea97d39711 Bug 1181516 - Allow reftests to take paths to multiple directories containing tests on the command line, r=jmaher
This makes reftest command line arguments behave more like other test suites,
so we can use a simple unified syntax for e.g. |mach try|. The patch also
reworks the command line argument parsing to use argparse rather than optparse,
and causes mach to reuse the same parser as the suite.
2015-09-17 10:50:55 +01:00