Commit Graph

92 Commits

Author SHA1 Message Date
Joel Maher
c77ba94113 Bug 1386717 - make taskcluster default to 16.04 for linux docker image and remove references to 16.04 from .yml file. r=gbrown
MozReview-Commit-ID: 224etabSwOp
2017-08-02 19:07:08 -04:00
Joel Maher
6ba7eaeddd Bug 1386689 - disable non-e10s tests which are duplicated with e10s jobs. r=gbrown
MozReview-Commit-ID: HObZQknHojc
2017-08-02 16:50:37 -04:00
J. Ryan Stinnett
154ba216b1 Bug 1380053 - Add Stylo tests for other desktop platforms. r=catlee
Enable Stylo tests for win32, win64, and macosx64.  Talos will be considered
separately.

MozReview-Commit-ID: BvTkddDX2Kk
2017-07-18 14:32:06 -05:00
J. Ryan Stinnett
7c6ad217ec Bug 1380053 - Default to parallel Stylo traversal in tests. r=catlee
Flip around the logic of bug 1356122, so that the default from Stylo runs is the
parallel traversal, but we can opt in to single traversal as desired.

This ensures that for testing on other desktop platforms, we use parallel
traversal as the default.

MozReview-Commit-ID: KoBe1ltHP52
2017-07-25 16:06:38 -05:00
Carsten "Tomcat" Book
d38de93268 Merge mozilla-central to autoland 2017-07-26 17:10:11 +02:00
Justin Wood
10b26fa1e2 Bug 1383257 - Do not attempt to schedule win10 hardware testing, unless we're on try. r=grenade
for: Land changes to flip windows nightlies on, and to tier 1 on central

MozReview-Commit-ID: EB0UVV3zQYX
2017-07-25 15:56:32 -04:00
Justin Wood
e3ecd3373c Bug 1383257 - Flip windows testing to be tier 1 by default. r=kmoir
for: Land changes to flip windows nightlies on, and to tier 1 on central

MozReview-Commit-ID: Ecqd48ef01i
2017-07-25 15:31:48 -04:00
Justin Wood
4690b315fc Bug 1383257 - Schedule devedition testing too. r=catlee
for: Land changes to flip windows nightlies on, and to tier 1 on central

Also sets awsy and marionette headless to just use built-projects for what to run on, and then sets
browser-screenshots to not run on deved.

MozReview-Commit-ID: C6KbHI7Hs81
2017-07-25 15:23:33 -04:00
Johan Lorenzo
e7c57ff3e1 Bug 1382725 - Try: Make Talos run on linux64-pgo r=catlee
MozReview-Commit-ID: 4fUG1gKgKjz
2017-07-24 11:37:40 +02:00
Justin Wood
744f7b7f75 Bug 1381577 - Part AK; Add support for win8 testing, will be via BBB, leave disabled until flag day. r=kmoir
Land date changes to support windows nightlies onto central

MozReview-Commit-ID: 4aM7JrfdGD3
2017-07-20 10:44:50 -04:00
Justin Wood
0356060e44 Bug 1381577 - Part AJ; Allow to override worker type in test definitions, supports explicitly buildbot-bridge tests. r=dustin
Land date changes to support windows nightlies onto central

MozReview-Commit-ID: 8AfCK50vRJc
2017-07-20 10:29:26 -04:00
Justin Wood
36e9acb1a8 Bug 1381577 - Part AF; Add tests for windows PGO and windows nightly. r=kmoir
Land date changes to support windows nightlies onto central

MozReview-Commit-ID: ANjwaLPNdqB
2017-07-19 21:36:46 -04:00
J. Ryan Stinnett
edd8cf908f Bug 1374748 - Use regular builds for Stylo via env var. r=catlee
MozReview-Commit-ID: BCMAuSRH1sQ
2017-07-11 13:39:22 -05:00
Carsten "Tomcat" Book
acef55d2e9 merge mozilla-inbound to mozilla-central a=merge 2017-07-12 11:07:09 +02:00
Rob Thijssen
85335f55a1 Bug 1379603 - enable windows hardware tests on try; r=dustin
MozReview-Commit-ID: 2yXsMEFOa00
2017-07-10 13:15:33 +03:00
Ryan VanderMeulen
cbf032f314 Bug 1379929 - Fix OSX TC test platform naming. r=catlee 2017-07-11 10:10:51 -04:00
Johan Lorenzo
411fcdb606 Bug 1374589 - Port windows tests which require signed builds to in-tree tasks r=Callek
MozReview-Commit-ID: JI0T2qW6P00
2017-06-29 13:50:13 -07:00
Greg Mierzwinski
20b6be5ebf Bug 1377915 - Increase page load timeout for talos tests running on linux64-ccov. r=dustin
This patch increases the amount of time that a page load is allowed to take from 5 seconds to 15 seconds (specified as milliseconds in the argument) when the Talos test suite is running on the linux64-ccov build.

MozReview-Commit-ID: BuoQP5wmxlb
2017-07-03 14:00:51 -04:00
Chris AtLee
cc0e5f0b94 Bug 1374351: Update platform names for cross-compiled OSX builds r=Callek
MozReview-Commit-ID: 4a2mhRVFhQP
2017-06-30 16:54:03 -07:00
Greg Mierzwinski
bd3b7c2204 Bug 1377982 - Use the Ubuntu 16.04 OS in Talos test suites that run on linux64-ccov. r=marco
This patch updates the OS that the Talos test suites use when they run on linux64-ccov to Ubuntu 16.04.

MozReview-Commit-ID: 4hx0jhTXv1C
2017-07-04 14:31:47 -04:00
Greg Mierzwinski
e60f6db28c Bug 1372324 - Enable talos tests on linux64-ccov. r=jmaher
This patch enables talos test suites to run on VM (taskcluster) and also enables these test suites to run with GCOV code coverage instrumentation on the linux64-ccov build.

MozReview-Commit-ID: 7p59zvra1ge
2017-06-09 14:51:20 -04:00
Dustin J. Mitchell
e65ef81096 Bug 1375044: remove temporary load-balancing check; r=wcosta
MozReview-Commit-ID: 7oy5C9KSpvR
2017-06-21 16:07:14 +00:00
Chris AtLee
c8cb2e7610 Bug 1374422 - Enable OSX cross-compile builds as tier1 on mozilla-central. r=dustin
This patch enables OSX cross compiled jobs as tier 1, and additionally adds testing for OSX Nightlies via Taskcluster. Initially tested on the 'date' project branch primarily with Bug 1373384

MozReview-Commit-ID: 7nWfiSEDbJd
2017-06-19 16:47:11 -04:00
Chris AtLee
90d74ace42 Bug 1370298: Move TC Win7 tests to Tier1 r=aselagea,jmaher
MozReview-Commit-ID: 5kIykFamr8g
2017-06-14 20:24:36 -04:00
Greg Mierzwinski
e654e0f854 Bug 1369908 - Schedule linux64-ccov, and linux64-jsdcov on all mozilla-central pushes. r=jmaher
This patch removes the nightly code coverage run in favor of simply running the two code coverage builds on every single push to mozilla-central for a more granular view of code coverage over time.

MozReview-Commit-ID: E4Xp5bB19m9
2017-06-13 13:04:08 -04:00
Wander Lairson Costa
4397f4f980 Bug 1372575: set osx test tasks to tier 1. r=garndt
MozReview-Commit-ID: 665BesH9Eex
2017-06-13 10:35:39 -03:00
Wander Lairson Costa
23064a9967 Bug 1368718: rename worker type. r=dustin
Rename worker-type to releng-hardware/gecko-t-osx-1010.

MozReview-Commit-ID: 2WAj9nqhP47
2017-06-02 03:49:15 -03:00
Dustin J. Mitchell
f3f59ca1c7 Bug 1359976: base worker payload generation on worker-type; r=wcosta r=aki
To date we have variously specified both worker-type and worker-implementation,
often manually coordinated. We also embedded a few awkward assumptions such as
that the native engine only runs on OS X.

But a worker type has one and only one implementation, and that implementation
is stable over time (as changing it would require simultaneous landings on all
trees).

Instead, this change makes worker-type the primary configuration, and derives
both a worker implementation (defining the payload format) and worker OS
(determining what to include in the payload) from that value. The derivation
occurs when deciding how to implement a particular job, where the run_using
functions are distinguished by worker implementation.

The two-part logic to determine how and where to run a test task based on its
platform is combined into a single transform, `set_worker_type`.

This contains some other related changes:
 - MOZ_AUTOMATION is set in specific jobs, rather than everywhere docker-worker
   is used
 - the URL to test packages is factored out into a shared function
 - docker-worker test defaults are applied in `mozharness_test.py`
 - the WORKER_TYPE array in `task.py`, formerly mixing two types of keys, is
   split
 - the 'invalid' workerType is assigned an 'invalid' implementation
 - all tasks that do not use job descriptions but use docker-worker, etc. have
   `worker.os` added

Tested to not produce a substantially different taskgraph for a regular push, a
try push, or a nightly cron.

MozReview-Commit-ID: LDHrmrpBo7I
2017-05-08 22:53:50 +00:00
Dustin J. Mitchell
7d5dbaacd3 Bug 1359976: remove references to now-unused test-platform-phylum; r=wcosta
MozReview-Commit-ID: A86tEB4nbIx
2017-05-05 19:44:05 +00:00
Dustin J. Mitchell
af4ef3ee08 Bug 1357753: optionally run linux Talos on native-engine; r=wcosta
This makes talos obey the `-w` try syntax flag.

MozReview-Commit-ID: 2v6X3ko2t9K
2017-05-10 21:12:02 +00:00
Phil Ringnalda
0485a7397d Bug 1362387 followup, mark the Linux DevEdition tests as tier-1 rather than letting them get the default tier-2 2017-05-27 12:07:34 -07:00
Greg Mierzwinski
48644f5470 Bug 1362010 - Allow all test suites to run regardless of 'files-changed' on linux64-ccov. r=jmaher
This patch will allow jittest, jsreftest, and any other test suite to run on linux64-ccov regardless of whether or not the files in 'files-changed' have been matched with changes in a patch.

MozReview-Commit-ID: 78CWUTWBhV
2017-05-26 10:33:59 -04:00
Dustin J. Mitchell
2dad4f5981 Bug 1364887: don't run SETA on try pushes; r=jmaher
MozReview-Commit-ID: 7L2I3WWziSE
2017-05-15 13:32:15 +00:00
Greg Mierzwinski
bcc9f04fa0 Bug 1365293 - Enable e10s tests on linux64-ccov. r=jmaher
MozReview-Commit-ID: 74yq4yzqXJ7
2017-05-22 07:37:30 -04:00
Dustin J. Mitchell
99a5002792 Bug 1363409: ensure e10s talos have -e10s in their try name r=garndt
This unifies the `try-name` property in test descriptions, and ensures that
e10s try jobs have `-e10s` at the end so that try syntax like "-t chromez-e10s"
will work.

MozReview-Commit-ID: 2AEFfAFF5Jl
2017-05-13 18:45:44 +00:00
Kartikaya Gupta
7dd6a3c3ea Bug 1342488 - Add a flag in the task to run with webrender, and enable it by default on linux64-qr test platforms. r=dustin
MozReview-Commit-ID: 2gXeniJT1Cf
2017-05-13 07:47:54 -04:00
Wander Lairson Costa
06a791ba72 Bug 1363714: Split tests tasks between TC and BB. r=dustin
In order to migrate from buildbot to taskcluster gradually, we read an
external json file to tells the percentage of jobs that must run in
Taskcluster.

MozReview-Commit-ID: JQhvsXKpcLz
2017-05-10 16:54:27 -03:00
Wes Kocher
a5fd1458b4 Backed out changeset 375bf84f1825 (bug 1363714) for flake8 failures a=backout
MozReview-Commit-ID: 5NGFjeBeyrM
2017-05-10 12:27:45 -07:00
Wander Lairson Costa
f5ecb2a316 Bug 1363714: Split tests tasks between TC and BB. r=dustin
In order to migrate from buildbot to taskcluster gradually, we read an
external json file to tells the percentage of jobs that must run in
Taskcluster.

MozReview-Commit-ID: K9KZMhe36Cu
2017-05-10 15:15:29 -03:00
Kim Moir
22a76ad5d0 Bug 1356122 - Run Stylo tests in sequential mode r=aki 2017-05-06 14:10:54 -04:00
Justin Wood
c76cfa985a Bug 1265537 - Adjust Windows TC Builds to generate simple package names, adjust tests to use them. r=grenade
MozReview-Commit-ID: AgCTrIMXEdd
2017-05-02 22:16:21 -04:00
Wander Lairson Costa
be231bf37e Bug 1350413 part 2: Fix generic-worker configuration. r=dustin
* Add macosx64 talos tests configuration.
* Fix logs artifacts.
* jittest doesn't have blob_upload_dir.
* e10s config on talos goes on suite name.

MozReview-Commit-ID: E9rSv2zQqvL
2017-05-02 16:12:52 -03:00
Wander Lairson Costa
bc9936ac3f Bug 1350413 part 1: move macosx64/opt build to buildbot-bridge. r=dustin
Because of bug 1338651, we need to stick to BBB macosx64 builds for now.

MozReview-Commit-ID: AwQc5r6ikUN
2017-05-02 16:12:51 -03:00
Shriram Kunchanapalli
35da39251d Bug 1360582 - Move mochitest-media tests to run on 16.04. r=jmaher
MozReview-Commit-ID: 9Kx72HIv3i9
2017-04-28 12:19:13 -04:00
Dustin J. Mitchell
4c08063fa3 Bug 1355180: introduce run-on-projects: built-projects, and use it; r=jmaher
This test-only "run-on-projects" option indicates that the test should run on
exactly the projects where its parent build runs.  This avoids the situation
where a build is configured to *not* run on a project, but some wayward test
didn't get the memo and "pulls in" the build anyway.  This has been
particularly problematic with win64-asan/opt.

MozReview-Commit-ID: 8UP6FsXBohy
2017-04-18 15:54:15 +00:00
Dustin J. Mitchell
a9ae152390 Bug 1357465: include the full test platform like it says in the docs; r=jmaher
MozReview-Commit-ID: CkAsBNEznuw
2017-04-14 20:49:44 +00:00
Sebastian Hengst
a5210d8c66 Backed out changeset ccf614bcd296 (bug 1357465) for breaking gecko decision tasks for nightly-code-coverage and nightly-mochitest-valgrind. r=backout a=backout
MozReview-Commit-ID: LpexSmhHEFh
2017-04-22 11:21:21 +02:00
Dustin J. Mitchell
44aed2b792 Bug 1357465: include the full test platform like it says in the docs; r=jmaher
MozReview-Commit-ID: CkAsBNEznuw
2017-04-14 20:49:44 +00:00
Nathan Froyd
c9b2231766 Bug 1318187 - turn on parallel Stylo traversal for e10s tests; r=dustin,chmanchester
We'd like to ensure that both parallel and serial traversal in Stylo are
tested on automation.  Since e10s is the future, we've chosen to force
parallel traversal on during e10s tests, and force serial traversal on
during non-e10s tests.
2017-04-14 09:52:22 +08:00
Mike Conley
db04b9c3ad Bug 1355579 - Remove last references to spsProfile in the tree. r=dustin
MozReview-Commit-ID: 9kZeiaFWZCp
2017-04-11 15:08:12 -04:00