Commit Graph

371 Commits

Author SHA1 Message Date
Andrew Halberstadt
5f240d3ef3 Bug 1451159 - [testing/profiles] Store profile data in actual profile look alike folders r=gbrown
This moves testing/profiles/prefs_general.js to
testing/profiles/common/user.js. It also adds an 'extensions' folder to the
common profile. Dropping extension files here will get them installed in all
test harnesses (useful for testing on try).

The idea is that all test harnesses will eventually use this 'common' profile.
We'll also create some new per harness profiles, e.g testing/profiles/mochitest
and testing/profiles/reftest. This way there will be a single location
developers can go to set preferences, both for a specific harness, and across
all harnesses.

MozReview-Commit-ID: 8sqBqLiypgU
2018-04-19 16:12:26 -04:00
Bogdan Tara
368d2cab0c Backed out 4 changesets (bug 1451159) for linux build bustages CLOSED TREE
Backed out changeset 72926ae685af (bug 1451159)
Backed out changeset f90a99682382 (bug 1451159)
Backed out changeset 3914937893de (bug 1451159)
Backed out changeset 79931e4a2bfb (bug 1451159)
2018-05-04 00:25:56 +03:00
Andrew Halberstadt
9abecc2372 Bug 1451159 - [testing/profiles] Store profile data in actual profile look alike folders r=gbrown
This moves testing/profiles/prefs_general.js to
testing/profiles/common/user.js. It also adds an 'extensions' folder to the
common profile. Dropping extension files here will get them installed in all
test harnesses (useful for testing on try).

The idea is that all test harnesses will eventually use this 'common' profile.
We'll also create some new per harness profiles, e.g testing/profiles/mochitest
and testing/profiles/reftest. This way there will be a single location
developers can go to set preferences, both for a specific harness, and across
all harnesses.

MozReview-Commit-ID: 8sqBqLiypgU
2018-04-19 16:12:26 -04:00
Chris Manchester
ad97d12af8 Bug 1372381 - Generate automation.py with GENERATED_FILES rather than Makefile.in r=mshal
This commit also removes "DEFAULT_APP", which is unused.

MozReview-Commit-ID: 5YYaC5LJqUn
2018-04-30 11:08:59 -07:00
arthur.iakab
370562b7bf Backed out 4 changesets (bug 1372381) for artifact build bustages
Backed out changeset 56c7ffeaa9fd (bug 1372381)
Backed out changeset 4e0f7fe818d0 (bug 1372381)
Backed out changeset 92a96d6b599b (bug 1372381)
Backed out changeset 620bdfafd42f (bug 1372381)
2018-05-01 01:39:08 +03:00
Chris Manchester
0ddbf2a48c Bug 1372381 - Generate automation.py with GENERATED_FILES rather than Makefile.in r=mshal
This commit also removes "DEFAULT_APP", which is unused.

MozReview-Commit-ID: 5YYaC5LJqUn
2018-04-30 11:08:59 -07:00
Mike Hommey
6841c321d6 Bug 1420355 - Statically link DMD. r=njn 2017-11-28 08:10:48 +09:00
Csoregi Natalia
e4966430b1 Backed out 7 changesets (bug 1420355) for mass failures on OS X and Android. r=backout on a CLOSED TREE
Backed out changeset a7ed89e13a4c (bug 1420355)
Backed out changeset fd6702e6e0a0 (bug 1420355)
Backed out changeset 0479dda078a2 (bug 1420355)
Backed out changeset e69357ccca9e (bug 1420355)
Backed out changeset 3742a4b69ba2 (bug 1420355)
Backed out changeset 451cd087922f (bug 1420355)
Backed out changeset d80b5c4e1dd0 (bug 1420355)
2017-11-29 03:08:46 +02:00
Mike Hommey
0a7b28a47e Bug 1420355 - Statically link DMD. r=njn 2017-11-28 08:10:48 +09:00
Mike Hommey
c4bb3bcd21 Bug 1403366 - Don't set MOZILLA_FIVE_HOME from multiple scripts. r=froydnj
It was seldom used before previous commit and now does nothing.
2017-09-28 11:00:09 +09:00
Sebastian Hengst
7f8825b233 Backed out changeset ff0705eda4bd (bug 1403366) 2017-10-04 01:26:56 +02:00
Mike Hommey
391f9bfd6f Bug 1403366 - Don't set MOZILLA_FIVE_HOME from multiple scripts. r=froydnj
It was seldom used before previous commit and now does nothing.
2017-09-28 11:00:09 +09:00
Sebastian Hengst
303d16ba32 Backed out changeset 28b00bdf83a3 (bug 1403366) 2017-09-29 17:19:35 +02:00
Mike Hommey
c5fd2bd415 Bug 1403366 - Don't set MOZILLA_FIVE_HOME from multiple scripts. r=froydnj
It was seldom used before previous commit and now does nothing.
2017-09-28 11:00:09 +09:00
Christian Holler
6e55b72a52 Bug 1373256 - Changes to support -fsanitize=integer in the codebase. r=froydnj
The -fsanitize=integer analysis from UBSan can be helpful to detect signed and unsigned integer overflows in the codebase. Unfortunately, those occur very frequently, making it impossible to test anything with it without the use of a huge blacklist. This patch includes a blacklist that is broad enough to silence everything that would drain performance too much. But even with this blacklist, neither tests nor fuzzing is "clean". We can however in the future combine this with static analysis to limit ourselves to interesting places to look at, or improve the dynamic analysis to omit typical benign overflows.

It also adds another attribute that can be used on functions. It is not used right now because it was initially easier to add things to the compile-time blacklist to get started.

Finally, it includes a runtime suppression list and patches various parts in the test harnesses to support that. It is currently empty and it should not be used on frequent overflows because it is expensive. However, it has the advantage that it can be used to differentiate between signed and unsigned overflows while the compile-time blacklist cannot do that. So it can be used to e.g. silence unsigned integer overflows on a file or function while still reporting signed issues. We can also use this suppression list for any other UBSan related suppressions, should we ever want to use other features from that sanitizer.

MozReview-Commit-ID: C5ofhfJdpCS
2017-04-09 12:59:26 +02:00
Shing Lyu
31f3c06eb7 Bug 1359288 - Enable Android reftest to resume from crashes. r=jmaher
MozReview-Commit-ID: EqTOdEwfTWi
2017-05-10 10:38:48 +08:00
Sebastian Hengst
cf0d647a5a Bug 1334900 - drop reftest process kill code for Windows 2000. r=jmaher
MozReview-Commit-ID: JRdbFSv0uJp
2017-01-30 21:00:36 +01:00
Ehsan Akhgari
6e1c5bc124 Bug 1318881 - Remove some unused variables from automation.py.in; r=gps 2016-11-21 18:56:15 -05:00
Ehsan Akhgari
9916b175a4 Bug 1318879 - Remove the app related code from mozprofile; r=ahal 2016-11-21 18:56:08 -05:00
Wes Kocher
f34c85c8a8 Backed out changeset 0cafbf944d89 (bug 1318879) for robocop failures a=backout 2016-11-21 13:01:21 -08:00
Ehsan Akhgari
b138925a19 Bug 1318879 - Remove the app related code from mozprofile; r=ahal 2016-11-21 14:59:05 -05:00
Randell Jesup
f76f9db4ad Bug 1311397: fix DataChannel logging for mochitests/etc r=erahm 2016-10-28 03:25:10 -04:00
Eric Rahm
6876e159e5 Bug 1278399 - Use MOZ_LOG in automation. r=ted
NSPR_LOG_MODULES is deprecated in favor of MOZ_LOG, this cleans up warning
spam during testing.
2016-06-10 10:05:57 -07:00
Gijs Kruitbosch
310d327ef8 Bug 1270144 - use error() rather than warning() in order to ensure this shows up on the treeherder summary, rs=emorley-over-irc
MozReview-Commit-ID: COtfpoU14vg
2016-05-25 15:14:56 +01:00
Gijs Kruitbosch
48db4ef098 Bug 1270144 - fix message from timed out tests to indicate the following crash is caused by us terminating the browser process, r=ahal,RyanVM
MozReview-Commit-ID: Hyr7xkZdbqc
2016-05-10 22:53:17 +01:00
Andrew Halberstadt
94aeaa27a9 Bug 1034290 - Use structured log output for test results in reftest, r=jmaher
Structured logs bring many benefits. We can stop parsing the logs for magic strings, we
can modify the format without breaking things, and we can stream results into systems like
ActiveData. The structured logs originate primarily in reftest.js. StructuredLog.jsm is
used to generate the JSON-based log stream. Finally OutputHandler in the python harness
reads structured output from stdout, and formats it into human readable form.

MozReview-Commit-ID: G3ZLkMRl6p7
2016-02-05 15:44:20 -05:00
Phil Ringnalda
c5159ef2e2 Back out d1779fe421c3 (bug 1034290) for UnicodeDecodeErrors in things run by the reftest harness
CLOSED TREE
2016-02-05 08:18:47 -08:00
Andrew Halberstadt
515a1ec282 Bug 1034290 - Use structured log output for test results in reftest, r=jmaher
Structured logs bring many benefits. We can stop parsing the logs for magic strings, we
can modify the format without breaking things, and we can stream results into systems like
ActiveData. The structured logs originate primarily in reftest.js. StructuredLog.jsm is
used to generate the JSON-based log stream. Finally OutputHandler in the python harness
reads structured output from stdout, and formats it into human readable form.
2015-10-29 15:01:44 -04:00
Julian Seward
ad8e3b37e6 Bug 1185244 - Improve mach support for running mochitests on Valgrind. r=jgraham, njn. 2015-09-28 12:01:42 +02:00
Wes Kocher
ca09e9719a Backed out changeset feceb41f1c3c (bug 1185244) for breaking running tests locally CLOSED TREE a=backout 2015-09-22 17:08:37 -07:00
Julian Seward
a9dcbc18a5 Bug 1185244 - Improve mach support for running mochitests on Valgrind. r=jgraham, njn. 2015-09-22 12:00:57 +02:00
Julien Pagès
6e0fa8b546 Bug 1091285 - move dumpScreen in a new mozscreenshot package. r=jgriffin
This also completely remove build/automationutils.py.
2015-07-29 17:50:16 +02:00
Julien Pagès
9bd7c862a6 Bug 1177780 - remove useless stuff in automation.py. r=jgriffin 2015-06-26 22:45:18 +02:00
Eric Rahm
03651633c8 Bug 1165515 - Part 15: Reduce log level of WebRTC during testing. r=jesup 2015-06-03 15:26:07 -07:00
Kartikaya Gupta
ebe4a3e37e Bug 1039866 - Rip out a bunch of metro-only code. r=jimm,gavin,rstrong 2015-04-23 15:10:30 -04:00
Nicholas Nethercote
dceb4f2bc9 Bug 1014341 (part 1) - Remove trace-malloc. r=dbaron,glandium. 2015-01-07 16:13:03 -08:00
Prashant Baisla
e2e53307e4 Bug 1091269 - Removed ZipFileReader class from automationutils.py and changed automation.py.in to use zipfile.extractall. r=jgriffin 2014-12-20 14:45:48 +01:00
Nicholas Nethercote
84279946f2 Bug 1100851 - Tweak DMD to account for the fact that $DMD can now be undefined. r=glandium.
Now that defining $DMD is no longer necessary to run DMD, this patch does the
following.
- Removes all the places where we set DMD=1 (test harnesses, etc.)
- Still handles DMD=1, for backwards compatibility.
- Prints "$DMD is undefined" at DMD start-up if appropriate.
- Writes a |null| value for |dmdEnvVar| in the JSON if $DMD is undefined. Bumps
  the DMD output version number accordingly.
- Changes a bunch of the test files accordingly, including changing the mode of
  script-ignore-alloc-fns.json in order to test a case where $DMD is undefined.
2014-11-27 21:04:46 -08:00
Byron Campen [:bwc]
c38d863bab Bug 1091242 - Part 6: Wiring the new JSEP handler code in. See https://github.com/unicorn-wg/gecko-dev/tree/multistream_rebase for more history. r=jesup, r=smaug 2014-11-19 16:16:29 -08:00
Phil Ringnalda
7df5cae6d0 Backed out 10 changesets (bug 1091242) for Android/b2g non-unified build bustage
CLOSED TREE

Backed out changeset 7f72b55c5de7 (bug 1091242)
Backed out changeset f1501aa24397 (bug 1091242)
Backed out changeset 7fde5994aee5 (bug 1091242)
Backed out changeset 59b415714087 (bug 1091242)
Backed out changeset dadb65fedc08 (bug 1091242)
Backed out changeset 21be81424e4e (bug 1091242)
Backed out changeset 498fb1dafba5 (bug 1091242)
Backed out changeset 8d0653eb85ab (bug 1091242)
Backed out changeset c82d484e135a (bug 1091242)
Backed out changeset 3e0c8932f1b1 (bug 1091242)
2014-12-08 20:53:07 -08:00
Byron Campen [:bwc]
d12f2ec301 Bug 1091242 - Part 6: Wiring the new JSEP handler code in. See https://github.com/unicorn-wg/gecko-dev/tree/multistream_rebase for more history. r=jesup, r=smaug 2014-11-19 16:16:29 -08:00
Nazma Panjwani
d73089f15c Bug 1091280 - moved options from AutomationUtils.addCommonOptions to runreftest.py, mochitest_options.py, runxpcshelltests.py and removed the addCommonOptions from automationUtils and automation.py.in, r=ahal 2014-11-19 12:31:45 -08:00
Sebastian Hengst
98ff2e7d7c Bug 1078033 - Remove remaining Camino code. r=ted 2014-10-10 17:00:29 +02:00
Nils Ohlmeier [:drno]
d2c97725cc Bug 1049688 - Allow override of MOZ_DISABLE_NONLOCAL_CONNECTIONS. r=froydnj 2014-09-22 09:48:00 -04:00
Aaron Klotz
631c0301b0 Bug 1070042: Fix --debugger parameter in reftest/crashtest; r=ted 2014-09-19 14:49:34 -06:00
Mark Hammond
2107af2477 Bug 1058433 - nsPermissionManager now records the mod-time of a permission and allows removal of ones modified since a specified time. r=ehsan 2014-09-15 11:33:12 +10:00
Nicholas Nethercote
13091a5eb7 Bug 1062689 - Run local mochitest and reftest output through fix_macosx_stack.py on Mac. r=ted. 2014-09-04 22:19:42 -07:00
Nicholas Nethercote
f30e108c5e Bug 1050601 - Remove fix-linux-stack.pl. r=ted. 2014-09-03 09:24:38 -07:00
Ralph Giles
d9aa639a38 Bug 1054043 - Remove wrapcommand. r=ted
This code was only needed on osx 10.5, and the version string compare
fails on osx 10.10.
2014-08-14 15:35:00 -07:00
Tim Taubert
dac8e3bdf1 Bug 1052371 - Fix m-bc shutdown leak detector r=akachkach 2014-08-12 21:23:29 +02:00