Commit Graph

90 Commits

Author SHA1 Message Date
Geoff Brown
b72a74a2a6 Bug 1340584 - Remove devicemanagerSUT and references to sutagent; r=wlach
sutagent is no longer built or used; devicemanagerSUT is completely
unused. After this change, devicemanagerADB is the only implementation of
devicemanager, and test harness options like --dm_trans are eliminated.
2017-03-21 12:20:01 -06:00
Geoff Brown
143a806612 Bug 1319196 - Call dumpsys less during Android tests; r=jmaher
Android tests use dumpsys to determine the current "top activity";
if Firefox is not in the foreground, tests are considered complete.
But dumpsys is heavy-weight and can fail, for reasons unknown. With
this patch, test harnesses continue to use dumpsys to determine the
top activity, but call it much less often: If the harness has just
received new test output, the harness assumes that tests are in
progress and does not check the top activity.
2017-01-06 16:35:29 -07:00
Geoff Brown
4552ce0576 Bug 1319196 - Take screenshot when dumpsys fails; r=jmaher 2016-12-13 11:28:06 -07:00
Geoff Brown
0da8b162b3 Bug 1309436 - Add test name to java-exception failure messages; r=ted 2016-10-26 11:31:41 -06:00
Geoff Brown
49f833fd0d Bug 1290114 - Make Android test logging more responsive; r=ahal 2016-07-29 08:29:53 -06:00
Michael Comella
4bbd70b22a Bug 1277214 - Move MOZ_DISABLE_* to single MOZ_IN_AUTOMATION env var. r=grisha
We hit an issue where adding a new env var, MOZ_DISABLE_TELEMETRY, added env10
and caused crashes. I suspect the issue is that there are is now a double-digit
number of env vars (bug 1277390). Here, we do the quick fix by removing
MOZ_DISABLE_TELEMETRY & repurposing MOZ_DISABLE_SWITCHBOARD to be generic.

While we're at it, we simplify the code by making the setDisabled methods a
strict getter without checking for how many times they're called.

MozReview-Commit-ID: 19DDbVYRZ2
2016-06-01 16:46:44 -07:00
Michael Comella
b9e03216b1 Bug 1270191 - Disable telemetry upload during tests. r=grisha
MozReview-Commit-ID: GoQQRfGRvd4
2016-05-31 17:04:40 -07:00
Andrew Halberstadt
d126feb632 Bug 1245092 - Install reftest and specialpowers extensions at runtime via AddonManager.installTemporaryAddon, r=jgriffin
MozReview-Commit-ID: 5HSa3nFVTeF
2016-03-09 14:38:13 -05:00
Margaret Leibovic
75840ddf0a Bug 1247324 - Disable Switchboard in automation. r=gbrown,mfinkle
MozReview-Commit-ID: ItqHBIEdD0Q
2016-02-18 12:03:51 -05:00
Andrew Halberstadt
9dcfc81d19 Bug 1231784 - Install specialpowers and mochikit extensions at runtime via AddonManager.loadTemporaryAddon(), r=jgriffin
MozReview-Commit-ID: 9I56x6Vnbf7
2016-01-25 09:55:57 -05:00
Andrew Halberstadt
a8bca414a2 Bug 1247054 - Fix |mach reftest| on Android, r=gbrown
There is an ImportError on Android, as well as a log related
regression from the structured log patch once that is fixed.

MozReview-Commit-ID: KxSEotr38qO
2016-02-09 16:19:44 -05:00
Andrew Halberstadt
94aeaa27a9 Bug 1034290 - Use structured log output for test results in reftest, r=jmaher
Structured logs bring many benefits. We can stop parsing the logs for magic strings, we
can modify the format without breaking things, and we can stream results into systems like
ActiveData. The structured logs originate primarily in reftest.js. StructuredLog.jsm is
used to generate the JSON-based log stream. Finally OutputHandler in the python harness
reads structured output from stdout, and formats it into human readable form.

MozReview-Commit-ID: G3ZLkMRl6p7
2016-02-05 15:44:20 -05:00
Phil Ringnalda
c5159ef2e2 Back out d1779fe421c3 (bug 1034290) for UnicodeDecodeErrors in things run by the reftest harness
CLOSED TREE
2016-02-05 08:18:47 -08:00
Andrew Halberstadt
515a1ec282 Bug 1034290 - Use structured log output for test results in reftest, r=jmaher
Structured logs bring many benefits. We can stop parsing the logs for magic strings, we
can modify the format without breaking things, and we can stream results into systems like
ActiveData. The structured logs originate primarily in reftest.js. StructuredLog.jsm is
used to generate the JSON-based log stream. Finally OutputHandler in the python harness
reads structured output from stdout, and formats it into human readable form.
2015-10-29 15:01:44 -04:00
Wes Kocher
c4797ad496 Backed out 3 changesets (bug 1231784) for breaking 10.10 opt jetpack tests
Backed out changeset 653df21ca861 (bug 1231784)
Backed out changeset 0aac20bc3619 (bug 1231784)
Backed out changeset edcbd7c0aa36 (bug 1231784)
2016-02-03 17:38:12 -08:00
Andrew Halberstadt
f84ba669d4 Bug 1231784 - Install specialpowers and mochikit extensions at runtime via AddonManager.loadTemporaryAddon(), r=jgriffin 2016-01-25 09:55:57 -05:00
Geoff Brown
98986110cb Bug 1156425 - Allow Android test jobs to run for up to 90 minutes; r=RyanVM 2015-08-27 11:29:00 -06:00
Andrew Halberstadt
5c1241cd79 Bug 1014760 - Move mozlog.structured to mozlog; Move mozlog to mozlog.unstructured, r=jgraham
Mozlog currently has two implementations. The top level package is based on the logging module and is
deprecated. The newer structured logging implementation lives in mozlog.structured. This patch swaps the
two, so the top level mozlog module contains the recommended implementation, while mozlog.unstructured
contains the old one.
2015-07-16 10:38:40 -04:00
Geoff Brown
149d025aa3 Bug 1179981 - A new test harness for robocop; r=jmaher 2015-07-09 12:30:01 -06:00
Geoff Brown
a43365762e Bug 1175540 - Reduce timeouts for many adb devicemanager calls; r=mcote 2015-06-21 13:58:34 -06:00
Nick Alexander
f72af9b890 Bug 1169476 -- Implement |mach robocop --serve|. r=gbrown
This adds a flag to |mach robocop| that does everything to run a
Robocop test except launch the actual test.  Instead of launching the
test, it starts the mochi.test server and launches Fennec with a test
profile; then it sits and waits forever.

This allows regular Java IDEs (IntelliJ, but previously Eclipse) to
run Robocop tests like regular instrumentation tests, "injecting" them
into the prepared testing environment.  It's quite nice!
2015-05-29 17:18:07 -07:00
Carsten "Tomcat" Book
5fdf49ec4a Backed out changeset e91ac9a35f86 (bug 1169476) for android rc2 crashes 2015-06-01 09:38:42 +02:00
Nick Alexander
888eeac8d5 Bug 1169476 -- Implement |mach robocop --serve|. r=gbrown
This adds a flag to |mach robocop| that does everything to run a
Robocop test except launch the actual test.  Instead of launching the
test, it starts the mochi.test server and launches Fennec with a test
profile; then it sits and waits forever.

This allows regular Java IDEs (IntelliJ, but previously Eclipse) to
run Robocop tests like regular instrumentation tests, "injecting" them
into the prepared testing environment.  It's quite nice!
2015-05-25 14:27:21 -07:00
Geoff Brown
36416997c0 Bug 1156425 - Allow Android test jobs to run for up to 75 minutes; r=ryanvm 2015-05-04 10:32:46 -06:00
Geoff Brown
1ca67d459a Bug 1160393 - Enable webrtc logging for android; r=bwc 2015-05-01 16:34:36 -06:00
Geoff Brown
4f9e0519a5 Bug 1156422 - Improve robustness of logcat collection in checkForCrashes; r=bc 2015-04-21 16:44:42 -06:00
Nicholas Nethercote
84279946f2 Bug 1100851 - Tweak DMD to account for the fact that $DMD can now be undefined. r=glandium.
Now that defining $DMD is no longer necessary to run DMD, this patch does the
following.
- Removes all the places where we set DMD=1 (test harnesses, etc.)
- Still handles DMD=1, for backwards compatibility.
- Prints "$DMD is undefined" at DMD start-up if appropriate.
- Writes a |null| value for |dmdEnvVar| in the JSON if $DMD is undefined. Bumps
  the DMD output version number accordingly.
- Changes a bunch of the test files accordingly, including changing the mode of
  script-ignore-alloc-fns.json in order to test a case where $DMD is undefined.
2014-11-27 21:04:46 -08:00
Chris Manchester
f2a98648a5 Bug 1068429 - Log crashes with structured logging for those using structured logging.;r=ahal 2014-09-23 20:33:31 -04:00
Nils Ohlmeier [:drno]
d2c97725cc Bug 1049688 - Allow override of MOZ_DISABLE_NONLOCAL_CONNECTIONS. r=froydnj 2014-09-22 09:48:00 -04:00
Nick Alexander
f683cda2af Bug 874729 - Part 1: Swallow IOErrors when pulling ANR traces. r=jmaher
On my local testing devices, |adb pull| complains about not being able
to read /data/anr/traces.txt but the command succeeds.  The subsequent
local file read produces an IOError.  This ignores that exception.
2014-09-08 16:23:10 -07:00
Geoff Brown
86d444e03c Bug 1042097 - Upload Android tombstones to blobber; r=dminor 2014-08-11 11:55:28 -06:00
Ahmed Kachkach
a83ca4356f Bug 1034267 - Structured Logging for robocop. r=gbrown 2014-07-29 14:11:00 +02:00
Ahmed Kachkach
e420cd4b58 Bug 886570 - Initial integration of structured logs in mochitest; r=ahal,Ms2ger 2014-07-17 09:02:00 +02:00
Carsten "Tomcat" Book
1358119f32 Backed out changeset cf85693280c7 (bug 886570) frequent mochitest-3 errors on windows 2014-07-11 14:15:29 +02:00
Ahmed Kachkach
64d66ddf12 Bug 886570 - Initial integration of structured logs in mochitest. r=ahal,Ms2ger 2014-07-10 13:33:00 +02:00
Geoff Brown
34ff3a9571 Bug 1027802 - Try to get ANR report and stack trace when Fennec hangs; r=jmaher 2014-07-03 22:11:41 -06:00
Andrew McCreight
ffde7e6c7d Bug 988041 - Enable LeakSanitizer for Mochitests. r=jmaher 2014-06-20 09:08:30 -07:00
Nathan Froyd
5cf290b70f Bug 995417 - part 2 - testing infrastructure changes to set MOZ_DISABLE_NONLOCAL_CONNECTIONS; r=jmaher 2014-06-17 10:49:57 -04:00
Jim Chen
333d69e90f Bug 999071 - Empty ANR file during testing instead of deleting it; r=gbrown 2014-04-28 22:20:52 -04:00
Wes Kocher
e8f9fa43ad Backed out 3 changesets (bug 999071) for Android rc1 failures
Backed out changeset ddf970be0abd (bug 999071)
Backed out changeset 8d2738b22275 (bug 999071)
Backed out changeset b82a8c50aa90 (bug 999071)
2014-04-24 18:12:46 -07:00
Jim Chen
48b712c636 Bug 999071 - Empty ANR file during testing instead of deleting it; r=gbrown 2014-04-24 17:49:02 -04:00
William Lachance
2ea7db939a Bug 996862 - Remove use of mozdevice's networktools. r=ahal 2014-04-21 11:03:51 -04:00
Geoff Brown
e59f6a73c4 Bug 960265 - Add no-output timeouts for Android tests; r=jmaher 2014-02-02 08:11:23 -07:00
Geoff Brown
bc0f6103e9 Bug 963838 - Pass correct app name to automation in Android tests; r=jmaher 2014-02-02 08:11:22 -07:00
Nathan Froyd
cd8bc82e95 Bug 938289 - part 1 - add automation support for adding DMD environment variables; r=jmaher 2013-11-13 14:47:41 -05:00
Ted Mielczarek
b30cc952e2 bug 914925 - fix --debugger for mochitest on OS X. r=jmaher 2013-09-16 14:44:25 -04:00
Geoff Brown
84aa5bc3d5 Bug 892118 - Suppress annoying Android x86 emu logcat message; r=jmaher 2013-11-17 10:23:15 -07:00
Ed Morley
bdfb8bbbc9 Bug 923513 - Make remoteautomation.py use the new mozcrash check_for_java_exception(); r=jmaher 2013-10-16 16:18:29 +01:00
18b2d0a5f8 Bug 881897: Reduce frequency of polling in remoteautomation.py; r=jmaher 2013-06-28 07:49:53 -04:00
Ed Morley
7ad93ba7fa Bug 872507 - Tweak logcat java-exception regex to strip more whitespace; r=jmaher 2013-05-17 12:42:02 +01:00