Commit Graph

172 Commits

Author SHA1 Message Date
Joel Maher
4f34bab8ba Bug 826769 - make mochitest-robotium may fail with: OSError: [Errno 2] No such file or directory: '/tmp/xxx/tests.jar'. r=gbrown 2013-01-04 13:42:32 -05:00
Joel Maher
dddfedf32a Bug 826308 - Robocop tests log output should contain begin/end block markers for the full test run. r=bc 2013-01-04 13:42:22 -05:00
Joel Maher
0a4091f7eb Bug 736105 - robocop does a lot of redundant copying of profile and sleeps, we can cut runtime almost in half. r=gbrown 2012-12-28 07:18:22 -05:00
Geoff Brown
b4ec1eb3bb Bug 810347 - Provide option for setting remote test root; r=jmaher 2012-12-20 09:11:11 -07:00
Geoff Brown
0c83ca6919 Bug 819093 - Use strings for env values in remote mochitest; r=jmaher DONTBUILD 2012-12-07 09:04:01 -07:00
Ed Morley
48028c7ee3 Bug 816532 - Print logcat for failed robocop tests; r=gbrown 2012-12-04 15:54:37 +00:00
Joel Maher
56edda1c29 Bug 811444 - panda boards magically reboot in the middle of the test. r=ted 2012-11-28 10:23:11 -05:00
Ed Morley
85d5967f66 Bug 814011 - Robocop should output the runTests() return code for that batch of tests, if non-zero; r=gbrown 2012-11-21 18:57:11 +00:00
Ed Morley
b0abd8f8cc Bug 814013 - Always print the final robocop pass/fail summary, even if we received a non-zero return value; r=gbrown 2012-11-21 18:53:48 +00:00
Ed Morley
d7ff8a55c6 Bug 808410 - Ensure non-zero return values for robocop tests aren't overwritten by later success; r=gbrown 2012-11-20 15:24:28 +00:00
William Lachance
bf48c7a9e9 Bug 805116 - Print more of the logcat in mobile tests;r=gbrown 2012-11-12 13:57:13 -08:00
Ed Morley
d2aa28c276 Bug 808417 - Make runTests() exception reporting consistent across test harnesses; r=jmaher 2012-11-05 13:03:55 +00:00
William Lachance
2964fe96a9 Bug 801652 - Make sure we print logcat, device info on remote mochitest/reftest failure;r=jmaher 2012-10-24 13:34:33 -04:00
Joel Maher
f9fea48a70 Bug 799107 - minidumps not being generated from robocop test crashes (breakpad environment variables not being set properly). r=kats 2012-10-16 13:25:23 -04:00
Joel Maher
bcfa9d8a11 Backout e814e12508af (bug 799107), 45863b00372b (bug 801633), 2012-10-15 13:33:37 -04:00
Joel Maher
73c02aef4b Bug 799107 - minidumps not being generated from robocop test crashes (breakpad environment variables not being set properly). r=kats 2012-10-15 11:13:44 -04:00
William Lachance
f6eb10dd3b Bug 756440 - Only warn when we fail cleanup steps with mobile mochitest/reftest;r=jmaher
Before we were outright failing if the test logfile was missing when cleaning
up these tests. But that's generally a sign that the app failed to start
up properly, which is the true issue we should be trying to catch / diagnose.
Let's just print a warning here and move on.
2012-10-15 10:15:19 -04:00
Joel Maher
9666d12624 Backout f271acb304c2 (bug 799107), 2012-10-15 09:08:41 -04:00
Joel Maher
859c2f666d Bug 799107 - minidumps not being generated from robocop test crashes (breakpad environment variables not being set properly). r=kats 2012-10-15 07:10:49 -04:00
Brian Nicholson
9089a9b77f Bug 769145 - Part 6: Update test cases for layout changes. r=mfinkle 2012-10-05 17:27:12 -07:00
William Lachance
bd5cbf8b30 Bug 795496 - Make mozdevice raise exceptions on error;r=ahal,jmaher
It turns out that relying on the user to check return codes for every
command was non-intuitive and resulted in many hard to trace bugs.
Now most functinos just return "None", and raise a DMError when there's an
exception. The exception to this are functions like dirExists, which now return
booleans, and throw exceptions on error. This is a fairly major refactor,
and also involved the following internal changes:

* Removed FileError and AgentError exceptions, replaced with DMError
  (having to manage three different types of exceptions was confusing,
  all the more so when we're raising them)
* Docstrings updated to remove references to return values where no
  longer relevant
* pushFile no longer will create a directory to accomodate the file
  if it doesn't exist (this makes it consistent with devicemanagerADB)
* dmSUT we validate the file, but assume that we get something back
  from the agent, instead of falling back to manual validation in the
  case that we didn't
* isDir and dirExists had the same intention, but different
  implementations for dmSUT. Replaced the dmSUT impl of getDirectory
  with that of isDir's (which was much simpler). Removed
  isDir from devicemanager.py, since it wasn't used externally
* killProcess modified to check for process existence before running
  (since the actual internal kill command will throw an exception
  if the process doesn't exist)

In addition to all this, more unit tests have been added to test these
changes for devicemanagerSUT.
2012-10-04 11:28:07 -04:00
Joel Maher
548aa53dce Bug 797112 - we have a call to dm.checkCmd and that api doesn't exist anymore. r=wlach 2012-10-03 11:07:31 -04:00
Bob Clary
b62a9460d6 Bug 789086 - use unique temporary filename for robotium.config file in mochitest/runtestsremote.py, r=jmaher. 2012-09-28 12:25:46 -07:00
Kartikaya Gupta
fd74b8eb0b Bug 767449 - Allow robotium tests to put files in places other than /mnt/sdcard. r=jmaher 2012-09-12 07:56:31 -04:00
William Lachance
a7a90d2d19 Bug 777500 - Log information about device before and after test for remote mochitest and reftests;r=jmaher 2012-07-25 20:45:36 -04:00
Joel Maher
acb7bb3b33 Bug 754873 - fennec automated tests should capture logcat output while test is running. r=wlach 2012-06-13 14:20:43 -04:00
Brian Nicholson
3c2d3be223 Bug 586885 - Add raw host to robotium.config. r=jmaher 2012-06-05 14:07:14 -07:00
Gervase Markham
cb6a072c2a Bug 716478 - update licence to MPL 2. 2012-05-21 12:12:37 +01:00
Joel Maher
15030a7281 Bug 736920 - mochitest-robocop log parser shouldn't repeat the whole test log, particularly not with spurious blank lines. r=gbrown 2012-03-22 10:45:20 -04:00
William Lachance
da7119c2e3 Bug 736246 - DeviceManagerADB should throw an exception if we know it's not going to work. r=jmaher 2012-03-16 18:36:28 -04:00
Joel Maher
7fffc8cd19 Bug 717018 - merge robotium logs into a single logfile. r=gbrown,jhammel 2012-02-09 08:49:00 -05:00
Joel Maher
c654beca6b Bug 717057 - allow robotium testPan to run in talos. r=kats,gbrown 2012-02-02 10:09:26 -05:00
Kartikaya Gupta
fa5ba12875 Bug 722367 - Update path to robocop.apk and fennec_ids.txt in mochitest-robotium target. r=jmaher 2012-01-30 13:14:47 -05:00
Ms2ger
1a5985cf18 Merge m-c to m-i. 2012-01-25 11:06:40 +01:00
Ms2ger
4f71d26fe3 Bug 718271 - Use TEST-UNEXPECTED-FAIL instead of TEST-UNEXPECTED-ERROR; r=jmaher 2012-01-25 08:50:04 +01:00
Joel Maher
afeabdada5 Bug 716732 - Robocop: fennec_ids.txt not always generated. r=kats 2012-01-11 08:50:10 -05:00
Joel Maher
11fb92f902 Bug 710445 - Add support for packaging tests in a specific directory. r=gbrown 2012-01-07 18:41:08 -05:00
Joel Maher
2d9d77184d Bug 715309 - robocop needs to have a more uniform log format. r=gbrown 2012-01-07 18:41:08 -05:00
Ed Morley
9ae1414fdd Backout 8ec01f6f316f (bug 705175), a1dc0efef542 (bug 716077), b5686f25b258 (bug 710445), 32f8d3be2ad1 (bug 715309) for mochitest/reftest failures on Android & Windows 2012-01-07 14:57:58 +00:00
Joel Maher
537616a77d Bug 710445 - Add support for packaging tests in a specific directory. r=gbrown 2012-01-07 08:25:05 -05:00
Joel Maher
488ee9adbf Bug 715309 - robocop needs to have a more uniform log format. r=gbrown 2012-01-07 08:25:05 -05:00
Geoff Brown
c7c8429a57 Bug 715408 - Delete any existing remote profile before running mochitest-remote; r=jmaher 2012-01-06 08:37:54 -05:00
Geoff Brown
461d7dc46e Bug 717684 - Robocop: better diagnostics when TEST_PATH incorrect; r=jmaher 2012-01-24 09:46:34 -05:00
Joel Maher
2efa6f7d94 Bug 701076 - [hoooking up make] Robotium integration into birch tree. r=blassey,bear 2011-12-31 10:03:36 -05:00
Phil Ringnalda
7ff6f1e370 Back out 04ef7f564450 (bug 701076) and 632f07583bd8 (bug 711591) for mochitest-oth bustage 2011-12-30 14:19:30 -08:00
Joel Maher
f0a5707cab Bug 701076 - [hookup to make] Robotium integration into birch tree. r=blassey,bear 2011-12-30 15:57:34 -05:00
Joel Maher
bca2661b7c Bug 691425 - allow for reftest/mochitest android crashes to be dumped in the logs just like desktop crashes. r=ctalbert 2011-10-06 10:51:03 -04:00
Joel Maher
1de0049b46 Bug 688762 - add try/except blocks around all harnesses so we always return an error code. r=bear 2011-09-26 07:41:19 -04:00
Cameron McCormack
4c6f5c729c Bug 479352 - Hide mochitest results table if MOZ_HIDE_RESULTS_TABLE=1 is set. (v4) r=jmaher, a=testonly 2011-07-26 16:13:20 -07:00
Geoff Brown
80a9649c1b Bug 672538 - remotereftest.py and runtestsremote.py reference dm_auto before initialized; r=jmaher 2011-07-20 13:02:48 -04:00