Commit Graph

164 Commits

Author SHA1 Message Date
Aki Sasaki
a5c82777cd bug 1442793 - tests artifact_prefix. r=bhearsum
MozReview-Commit-ID: 1KFGftPjG9Z
2018-03-07 13:05:10 -08:00
Tom Prince
82a8e960cb Bug 1410255: Use is_try in more places; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D411
2018-04-13 10:52:06 -06:00
Joel Maher
52c8f16314 Bug 1449587 - change the chunks that reftests run in to complete in more realistic runtimes and balance overhead + test time. r=ahal 2018-03-30 06:06:42 -04:00
Joel Maher
5b4622fbe4 Bug 1431161 - run windows 32 and 64 bit builds on windows10-64 hardware for talos performance tests. r=rwood 2018-03-30 06:06:41 -04:00
Emilio Cobos Álvarez
acc26d5d14 Bug 1446954: Remove support for running tests on automation without stylo configurations. r=froydnj
You can still run them on a --disable-stylo build, as long as that works
(presumably not for long).

I think I haven't missed anything, but please double-check.

MozReview-Commit-ID: 3BIAEjgTLo5
2018-03-20 11:29:08 +01:00
Joel Maher
495ac13f33 backout Bug 1431161 for win10 hardware failures. r=me a=backout CLOSED TREE 2018-02-28 11:14:57 -05:00
Marco Castelluccio
03e43a5a48 Bug 1434729 - Never optimize test suites for coverage builds. r=jmaher 2018-02-20 12:20:19 +01:00
Marco Castelluccio
77d2690173 Bug 1434729 - Make it possible to overwrite 'optimization' in tests transforms. r=dustin 2018-02-20 19:26:32 +01:00
Geoff Brown
0530d485a5 Bug 1412349 - Avoid SETA optimization of SCHEDULES.inclusive suites, like test-verify; r=dustin 2018-02-26 13:58:08 -07:00
Rob Wood
de12a9dc0c Bug 1431161 - run windows 32 and 64 bit builds on windows10-64 hardware for talos performance tests; r=jmaher
MozReview-Commit-ID: EVIHh42fpHU
2018-02-06 13:18:09 -05:00
Csoregi Natalia
e84a13a750 Backed out changeset a1711e96c622 (bug 1431161) for talos performance test failures- task payload invalid. CLOSED TREE 2018-02-21 21:59:49 +02:00
Rob Wood
7f4eaca5c4 Bug 1431161 - run windows 32 and 64 bit builds on windows10-64 hardware for talos performance tests; r=jmaher
MozReview-Commit-ID: EVIHh42fpHU
2018-02-06 13:18:09 -05:00
Narcis Beleuzu
6c4e128399 Backed out changeset 2de04e1a46bd (bug 1431872) on request from marco for running ccov builds also on autoland and inbound. a=backout 2018-02-16 14:29:18 +02:00
Marco Castelluccio
ee2ba99840 Bug 1431872 - Set run-on-project for Linux and Windows coverage builds. r=jmaher 2018-02-15 17:30:54 +01:00
Tom Prince
7148d9e6b9 Bug 1426445: Purge task caches, when an incompatible cache is found; r=gps
Differential Revision: https://phabricator.services.mozilla.com/D395
2018-01-15 22:00:50 -07:00
Geoff Brown
1dd2326fc4 Bug 1434411 - Allow task configuration of target name; r=dustin 2018-02-01 14:26:54 -07:00
Joel Maher
2fbfca6267 Bug 1433702 - run linux64 talos on new moonshot hardware via taskcluster instead of buildbot and IX hardware. r=rwood 2018-01-29 10:56:58 -05:00
Dustin J. Mitchell
964b2fbc99 Bug 1429236: put jsreftests in their own scheduling component; r=jmaher
This adds an 'override' for the default scheduling component for tests, which
is based on their suite.

MozReview-Commit-ID: 6vd8sb2zeuU
2018-01-12 14:17:34 +00:00
Andrew Halberstadt
6023d4c291 Bug 1386857 - [taskgraph] Add path of offending config file to the UNKNOWN_GROUP_NAME error message, r=dustin
When trying to remove an ubiquitous group like tc(), it's hard to tell where the
error was located without grepping my filesystem. This makes it a bit easier to
find and fix these errors.

MozReview-Commit-ID: 8NjvB5zOoqb
2018-01-12 15:49:27 -05:00
Tom Prince
ce4613465b Backout removal of when.files-changed support for tests from Bug 1403322; r=dustin
MozReview-Commit-ID: 1ZT1VWJx7Y
2018-01-09 11:51:08 -07:00
Dustin J. Mitchell
5aac8cbe3f Bug 1403322: Switch jsreftests, jittests, test-verify to SCHEDULES; r=ahal
..and remove support for when.files-changed in the test kind.  It is still used
for other kinds, and that will be addressed in other bugs.

This is re-landing of this bug, now without running test-verify excessively.

MozReview-Commit-ID: GBilXAktICZ
2017-12-20 00:39:21 +00:00
Chris AtLee
1f47f275a3 Bug 1420449: Skip schema validation with --fast r=dustin,ahal
MozReview-Commit-ID: 6wWYrNOG677
2017-12-07 22:23:57 -05:00
Coroiu Cristina
1d235fed44 Backed out changeset 7a47accb11c5 (bug 1420449) for build bustage r=backout on a CLOSED TREE 2018-01-03 19:04:32 +02:00
Chris AtLee
d1b5d6b8cf Bug 1420449: Skip schema validation with --fast r=dustin,ahal 2018-01-03 10:27:16 -05:00
Dustin J. Mitchell
bddec868bd Bug 1426254: only list a single component for "inclusive" test suites; r=ahal
For example, jittests will be an inclusive test suite; all files which might
affect the suite are tagged with
  SCHEDULES.inclusive += ['jittest']
but those files usually also schedule all of the exclusive components (including
the platform families android, linux, macosx, and windows).  This makes sense:
those files could potentially affect any other test suite on any platform too.

But the jittest job on Android, for example, needs to run only if the jittest
component is scheduled -- it does not need to just because something
Android-related changed.  So its optimization should be {skip-unless-schedules:
['jittest']}, not {skip-unless-schedules: ['jittest', 'android']}.

This fix "figures out" the distinction by looking at what kind of component the
test suite is.  Maybe that is too magic, and we should also have to write
"component: implicit" in the tests/*.yml file.

MozReview-Commit-ID: EIsVvi1vziE
2017-12-20 00:18:20 +00:00
Kartikaya Gupta
9c87cdf61c Bug 1426191 - Turn on gpu mochitests for windows10-64 QuantumRender builds. r=dustin
This also renames the existing test sets for qr to be linux-specific, so
we can have a different test set for windows QR builds. The windows10-64-qr
gpu mochitests will run on all nightly branches (so inbound, autoland, m-c,
try) by default.

MozReview-Commit-ID: F2NjCTHYg13
2017-12-21 09:25:13 -05:00
Kartikaya Gupta
8fc1b551cb Bug 1426191 - Adjust regexes to match QuantumRender builds. r=dustin
Previously we had linux64-qr as the only QuantumRender test platform.
Soon we will have windows10-64-qr as well and (eventually) we will have
some macOS -qr tests as well. So this patch generifies the existing
regexes to match these platforms.

In a couple of places redundant platform matching lines were removed, to
avoid the case where a given platform (e.g. windows10-64-qr) matches
multiple regexes (e.g. .*-qr/.* and windows.*) which produces an error.

MozReview-Commit-ID: 8YO9lQETVYM
2017-12-21 09:25:10 -05:00
Marco Castelluccio
bbd362e805 Bug 1422698 - Make Windows coverage build and tests tier 2. r=jmaher 2017-12-04 10:30:01 +01:00
Joel Maher
7b157264cf Bug 1422451 - move talos xperf from win7 hardware to VM. r=rwood 2017-12-04 10:11:03 -05:00
Marco Castelluccio
b41c007284 Bug 1418479 - Make Windows coverage build and tests tier 3. r=jmaher 2017-11-20 19:01:28 +01:00
Marco Castelluccio
ea73223c51 Bug 1418252 - Allow 'virtualization' key to be keyed by test platform. r=jmaher 2017-11-17 15:22:30 +01:00
Marco Castelluccio
9b7ca589dd Bug 1418252 - Make talos tests run in Windows coverage build. r=jmaher 2017-11-18 00:05:51 +01:00
Sebastian Hengst
d7b7458de4 Bug 1417436 - Add Windows code coverage build and test definitions: Add linebreak in long comment to fix flake8 error. r=linting-fix 2017-11-15 19:17:56 +01:00
Marco Castelluccio
9166d33946 Bug 1417436 - Add Windows code coverage build and test definitions. r=jmaher 2017-11-14 23:39:15 +01:00
Dustin J. Mitchell
256f5ffad0 Bug 1410911 - back out bug 1403322; r=gbrown
Backed out changesets 37db725b2308 ccc4f12edef0 e3a310b6b896 547109f6eb1d 5c50f100460d

MozReview-Commit-ID: 5M6Mevz6LZV
2017-11-10 18:19:47 +00:00
Joel Maher
98f72bd9d0 Bug 1408403 - fix linting problem. r=me CLOSED TREE 2017-11-10 13:06:10 -05:00
Joel Maher
9c10d83d75 Bug 1408403 - disable talos-g2-e10s on ccov builds. r=dustin 2017-11-10 10:32:55 -05:00
Wander Lairson Costa
a8e375e69a Bug 1413502: Use --taskcluster-worker on Windows talos. r=grenade
With migration of talos machines from buildbot to Taskcluster, we need a
way to run jobs in Taskcluster without affecting production.

We accomplish this task by using the same approach we use for Linux:
when we give the --taskcluster-worker flag, decision task switches from
buildbot-bridge to Taskcluster Windows work-type.

MozReview-Commit-ID: LU5oaGCZ8uz
2017-11-03 14:45:12 -02:00
Sebastian Hengst
ef55bd51d9 merge mozilla-inbound to mozilla-central. r=merge a=merge
MozReview-Commit-ID: GSDYk9wLOAM
2017-11-01 22:55:12 +01:00
alex
4a6969bd35 Bug 1393788 - Compress all JSDcov artifacts (.json files) into zip files after all tests are completed. r=gmierz,jmaher.
Building with "Linux x64 JSDCov", each suite of tests will produce a list of JSDCov artifacts (.json). This patch compresses all JSDCov artifacts into 1 zip file for each suite upon tests completion.
MozReview-Commit-ID: DaNLOQuW2lc
2017-10-26 17:01:12 -04:00
Phil Ringnalda
418f54c679 Bug 1400280 - Mark OS X tests on nightlies and devedition builds as tier-1, r=kmoir
MozReview-Commit-ID: 9pgbbBCZxFq
2017-10-31 22:44:44 -07:00
Wander Lairson Costa
c070549c68 Bug 1357753: Fix try branch name. r=jlund
"Try" with capital T is causing bustage with Taskcluster test jobs.

MozReview-Commit-ID: BNNW4nFf0Ro
2017-10-29 13:57:41 -07:00
Joel Maher
e848f09b5e Bug 1411344 - remove legacy instance type an as option in taskcluster now that linux doesn't use it. r=dustin 2017-10-25 05:01:27 -04:00
Geoff Brown
ce476590fa Bug 1410911 - Only run test-verify when certain file types are changed; r=dustin
When first introduced, test-verify was only run when .js/.html/.xul/.xhtml files
were changed. Recently, it seems to run on every push. This is a speculative fix:
There may be confusion between "test-verify" and "test-verification" so I am
using "test-verify" consistently.
2017-10-24 15:17:27 -06:00
Andrew Halberstadt
9516b741e8 Bug 1410250 - Stop keying entire 'mozharness' section by-test-platform, r=dustin
Many of the 'test' tasks key the entire 'mozharness' section by-test-platform.
This is bad because:

A) Configuration under 'mozharness' can't be shared across platforms
B) We can't use the 'job-defaults' simplification since merging is naive

Instead of keying the entire 'mozharness' section, this change keys only the
specific configuration that needs it.

MozReview-Commit-ID: EaPlOzsESQ3
2017-10-19 14:35:04 -04:00
Andrew Halberstadt
4e92631d3c Bug 1410250 - Use transform for appending --mochitest-suite=<suite> et al, r=dustin
Every task that uses the desktop_unittest.py or android_emulator_unittest.py
mozharness scripts needs to pass in either --<suite>-suite=<flavor>, or
--test-suite=<flavor> respectively.

In almost all cases, <suite> and <flavor> are identical to the value that is
already specified under the test['suite'] key. This means we can use a
transform to append these command line arguments and reduce the complexity of
the yaml files.

MozReview-Commit-ID: EaPlOzsESQ3
2017-10-19 14:34:59 -04:00
Andrew Halberstadt
f8fe04053e Bug 1388478 - Load tests.yml tasks with the transform loader, r=dustin
This will allow us to use 'jobs', 'jobs-from' and 'job-defaults' with the test
kind.

MozReview-Commit-ID: 7q66kjSI4b3
2017-10-17 15:57:14 -04:00
Sebastian Hengst
dfce02d562 Bug 1396260 - run reftest in smaller browser sessions on windows 7 to reduce font loading/rendering issues: fix indentation. r=linting-fix 2017-10-14 16:37:14 +02:00
Joel Maher
7016bc8b86 Bug 1396260 - run reftest in smaller browser sessions on windows 7 to reduce font loading/rendering issues. r=jfkthame 2017-10-14 08:09:48 -04:00
Dustin J. Mitchell
1d340ded1c Bug 1403322 - remove support for when.files-changed in tests; r=ahal
MozReview-Commit-ID: 9Tx76V5VcqW
2017-10-11 17:40:10 +00:00