Commit Graph

117 Commits

Author SHA1 Message Date
Sebastian Hengst
dfce02d562 Bug 1396260 - run reftest in smaller browser sessions on windows 7 to reduce font loading/rendering issues: fix indentation. r=linting-fix 2017-10-14 16:37:14 +02:00
Joel Maher
7016bc8b86 Bug 1396260 - run reftest in smaller browser sessions on windows 7 to reduce font loading/rendering issues. r=jfkthame 2017-10-14 08:09:48 -04:00
Dustin J. Mitchell
1d340ded1c Bug 1403322 - remove support for when.files-changed in tests; r=ahal
MozReview-Commit-ID: 9Tx76V5VcqW
2017-10-11 17:40:10 +00:00
Dustin J. Mitchell
839ffa1740 Bug 1403322 - schedule jsreftests inclusively; r=ahal
This is just one flavor of the "reftets" suite, so we need to add a distinct
scheduling component for it.

MozReview-Commit-ID: AtKuvuUCk1l
2017-10-11 17:31:20 +00:00
Andrew Halberstadt
9d85bdcbc9 Bug 1403222 - Add test suite families to SCHEDULES.exclusive r=dustin
MozReview-Commit-ID: JWKB7eOgfWc
2017-09-26 10:47:22 -04:00
Sebastian Hengst
95c011a9f0 Backed out changeset ddfc127526b2 (bug 1403222) for failing python/mozbuild/mozbuild/test/frontend/test_reader.py::TestBuildReader::test_schedules, at least for Linux asan opt builds. r=backout on a CLOSED TREE 2017-10-02 16:03:12 +02:00
Andrew Halberstadt
5c9a4c3849 Bug 1403222 - Add test suite families to SCHEDULES.exclusive r=dustin
MozReview-Commit-ID: JWKB7eOgfWc
2017-09-26 10:47:22 -04:00
Dustin J. Mitchell
97b812cb0a Bug 1383880: Annotate builds and tests with SCHEDULES-related optimizations; r=ahal
This means that a push to try affecting only Android will only run android builds
and tests, for example.

MozReview-Commit-ID: HVUvIg0EUZn
2017-08-25 19:15:12 +00:00
Dustin J. Mitchell
d08f492fb6 Bug 1383880: parse try config during the decision task; r=ahal
This sets the try_mode property, and parses the try message (if given), early
in the decision task and puts the results into the parameters.

The proximate need is to set optimze_target_tasks for some try modes and not
others. This also replaces the existing logic for parsing messages for certain
kinds, and makes the distinction between the different try modes a little
clearer.

MozReview-Commit-ID: AXJEGLh6pEV
2017-08-21 23:14:14 +00:00
Dustin J. Mitchell
19cecfbbba Bug 1383880: allow only one optimization per task; r=ahal,glandium
It is not at *all* clear how multiple optimizations for a single task should
interact. No simple logical operation is right in all cases, and in fact in
most imaginable cases the desired behavior turns out to be independent of all
but one of the optimizations. For example, given both `seta` and
`skip-unless-files-changed` optimizations, if SETA says to skip a test, it is
low value and should be skipped regardless of what files have changed. But if
SETA says to run a test, then it has likely been skipped in previous pushes, so
it should be run regardless of what has changed in this push.

This also adds a bit more output about optimization, that may be useful for
anyone wondering why a particular job didn't run.

MozReview-Commit-ID: 3OsvRnWjai4
2017-08-01 20:02:59 +00:00
Phil Ringnalda
b76b48b887 Backed out 12 changesets (bug 1383880) for decision task bustage
CLOSED TREE

Backed out changeset fd3615e7e0a3 (bug 1383880)
Backed out changeset 8cceb6a82bfb (bug 1383880)
Backed out changeset 571a6c9054a5 (bug 1383880)
Backed out changeset ec2b8ba5a949 (bug 1383880)
Backed out changeset 8e5847d9acda (bug 1383880)
Backed out changeset b354fdf6e233 (bug 1383880)
Backed out changeset ebdd6ccbcfca (bug 1383880)
Backed out changeset ebcc9d20981a (bug 1383880)
Backed out changeset 97eedc84d6e8 (bug 1383880)
Backed out changeset a3116da52b4e (bug 1383880)
Backed out changeset b3eb0c939720 (bug 1383880)
Backed out changeset 7c07cb798530 (bug 1383880)

MozReview-Commit-ID: EPDuQHr7w2y
2017-09-20 19:57:39 -07:00
Dustin J. Mitchell
7b8c1e56e7 Bug 1383880: Annotate builds and tests with SCHEDULES-related optimizations; r=ahal
This means that a push to try affecting only Android will only run android builds
and tests, for example.

MozReview-Commit-ID: HVUvIg0EUZn
2017-08-25 19:15:12 +00:00
Dustin J. Mitchell
a7457a95f7 Bug 1383880: parse try config during the decision task; r=ahal
This sets the try_mode property, and parses the try message (if given), early
in the decision task and puts the results into the parameters.

The proximate need is to set optimze_target_tasks for some try modes and not
others. This also replaces the existing logic for parsing messages for certain
kinds, and makes the distinction between the different try modes a little
clearer.

MozReview-Commit-ID: AXJEGLh6pEV
2017-08-21 23:14:14 +00:00
Dustin J. Mitchell
8f421b7a25 Bug 1383880: allow only one optimization per task; r=ahal,glandium
It is not at *all* clear how multiple optimizations for a single task should
interact. No simple logical operation is right in all cases, and in fact in
most imaginable cases the desired behavior turns out to be independent of all
but one of the optimizations. For example, given both `seta` and
`skip-unless-files-changed` optimizations, if SETA says to skip a test, it is
low value and should be skipped regardless of what files have changed. But if
SETA says to run a test, then it has likely been skipped in previous pushes, so
it should be run regardless of what has changed in this push.

This also adds a bit more output about optimization, that may be useful for
anyone wondering why a particular job didn't run.

MozReview-Commit-ID: 3OsvRnWjai4
2017-08-01 20:02:59 +00:00
Geoff Brown
60c88bed97 Bug 1400979 - Follow-up: Skip test-verify on linux64-ccov; r=gmierz a=merge
The previous patch was ineffective, because the noted transform over-wrote
the yml configuration.

MozReview-Commit-ID: ICENT0DGzxy
2017-09-20 18:13:59 -06:00
Joel Maher
91ce564d80 Bug 1373578 - split reftest non-e10s into 32 chunks. r=gbrown 2017-09-18 16:12:07 -04:00
J. Ryan Stinnett
01b2168ab5 Bug 1330412 - Convert Stylo jobs to Stylo disabled. r=jmaher
Convert all jobs that were exercising Stylo enabled to Stylo disabled instead.

Stylo enabled is now handled by the default jobs.

In Perfherder, Stylo enabled jobs will be untagged and take over the existing
Gecko series.  Stylo disabled jobs will have a new `stylo-disabled` tag and
create a new series.

MozReview-Commit-ID: BMXBRg3A95j
2017-08-31 11:18:46 -05:00
J. Ryan Stinnett
320f85bda9 Bug 1330412 - Limit reftest-stylo to linux64. r=jmaher
MozReview-Commit-ID: 4GIr1fIoils
2017-08-31 11:57:27 -05:00
Ryan VanderMeulen
c41dc43ff0 Backed out 9 changesets (bug 1383880) for decision task bustage.
Backed out changeset 53f5d47a7cb0 (bug 1383880)
Backed out changeset a0abda41172a (bug 1383880)
Backed out changeset 729a7e2091e8 (bug 1383880)
Backed out changeset a33f5a14a471 (bug 1383880)
Backed out changeset 5b10d321cfee (bug 1383880)
Backed out changeset 8056488d8aed (bug 1383880)
Backed out changeset e62c90e3c1e8 (bug 1383880)
Backed out changeset 91f116ce6c2a (bug 1383880)
Backed out changeset 045498bc36c4 (bug 1383880)
2017-09-01 15:37:08 -04:00
Dustin J. Mitchell
3082ddd79c Bug 1383880: Annotate builds and tests with SCHEDULES-related optimizations; r=ahal
This means that a push to try affecting only Android will only run android builds
and tests, for example.

MozReview-Commit-ID: HVUvIg0EUZn
2017-08-25 19:15:12 +00:00
Dustin J. Mitchell
464d6eeb31 Bug 1383880: parse try config during the decision task; r=ahal
This sets the try_mode property, and parses the try message (if given), early
in the decision task and puts the results into the parameters.

The proximate need is to set optimze_target_tasks for some try modes and not
others. This also replaces the existing logic for parsing messages for certain
kinds, and makes the distinction between the different try modes a little
clearer.

MozReview-Commit-ID: AXJEGLh6pEV
2017-08-21 23:14:14 +00:00
Dustin J. Mitchell
18da9b3836 Bug 1383880: allow only one optimization per task; r=ahal
It is not at *all* clear how multiple optimizations for a single task should
interact. No simple logical operation is right in all cases, and in fact in
most imaginable cases the desired behavior turns out to be independent of all
but one of the optimizations. For example, given both `seta` and
`skip-unless-files-changed` optimizations, if SETA says to skip a test, it is
low value and should be skipped regardless of what files have changed. But if
SETA says to run a test, then it has likely been skipped in previous pushes, so
it should be run regardless of what has changed in this push.

This also adds a bit more output about optimization, that may be useful for
anyone wondering why a particular job didn't run.

MozReview-Commit-ID: 3OsvRnWjai4
2017-08-01 20:02:59 +00:00
Johan Lorenzo
ff87fbb262 Bug 1384482 - Comply to Treeherder's nomenclature r=mtabara
MozReview-Commit-ID: 8bh8gI577sr
2017-08-31 11:17:54 +02:00
Johan Lorenzo
9d82d58d34 Bug 1384482 - Rename android-api-15 into android-api-16 r=mtabara
MozReview-Commit-ID: 4j66pTZEJzq
2017-08-09 16:18:15 +02:00
Tom Prince
a6dee70925 Bug 1385094 - Allow support for taskgraph taks to refer to indexed docker images, in addition to in-tree and docker-hub images. r=dustin
MozReview-Commit-ID: HFmsBswwsA1
2017-07-27 14:39:51 -06:00
Joel Maher
c77ba94113 Bug 1386717 - make taskcluster default to 16.04 for linux docker image and remove references to 16.04 from .yml file. r=gbrown
MozReview-Commit-ID: 224etabSwOp
2017-08-02 19:07:08 -04:00
Joel Maher
6ba7eaeddd Bug 1386689 - disable non-e10s tests which are duplicated with e10s jobs. r=gbrown
MozReview-Commit-ID: HObZQknHojc
2017-08-02 16:50:37 -04:00
J. Ryan Stinnett
154ba216b1 Bug 1380053 - Add Stylo tests for other desktop platforms. r=catlee
Enable Stylo tests for win32, win64, and macosx64.  Talos will be considered
separately.

MozReview-Commit-ID: BvTkddDX2Kk
2017-07-18 14:32:06 -05:00
J. Ryan Stinnett
7c6ad217ec Bug 1380053 - Default to parallel Stylo traversal in tests. r=catlee
Flip around the logic of bug 1356122, so that the default from Stylo runs is the
parallel traversal, but we can opt in to single traversal as desired.

This ensures that for testing on other desktop platforms, we use parallel
traversal as the default.

MozReview-Commit-ID: KoBe1ltHP52
2017-07-25 16:06:38 -05:00
Carsten "Tomcat" Book
d38de93268 Merge mozilla-central to autoland 2017-07-26 17:10:11 +02:00
Justin Wood
10b26fa1e2 Bug 1383257 - Do not attempt to schedule win10 hardware testing, unless we're on try. r=grenade
for: Land changes to flip windows nightlies on, and to tier 1 on central

MozReview-Commit-ID: EB0UVV3zQYX
2017-07-25 15:56:32 -04:00
Justin Wood
e3ecd3373c Bug 1383257 - Flip windows testing to be tier 1 by default. r=kmoir
for: Land changes to flip windows nightlies on, and to tier 1 on central

MozReview-Commit-ID: Ecqd48ef01i
2017-07-25 15:31:48 -04:00
Justin Wood
4690b315fc Bug 1383257 - Schedule devedition testing too. r=catlee
for: Land changes to flip windows nightlies on, and to tier 1 on central

Also sets awsy and marionette headless to just use built-projects for what to run on, and then sets
browser-screenshots to not run on deved.

MozReview-Commit-ID: C6KbHI7Hs81
2017-07-25 15:23:33 -04:00
Johan Lorenzo
e7c57ff3e1 Bug 1382725 - Try: Make Talos run on linux64-pgo r=catlee
MozReview-Commit-ID: 4fUG1gKgKjz
2017-07-24 11:37:40 +02:00
Justin Wood
744f7b7f75 Bug 1381577 - Part AK; Add support for win8 testing, will be via BBB, leave disabled until flag day. r=kmoir
Land date changes to support windows nightlies onto central

MozReview-Commit-ID: 4aM7JrfdGD3
2017-07-20 10:44:50 -04:00
Justin Wood
0356060e44 Bug 1381577 - Part AJ; Allow to override worker type in test definitions, supports explicitly buildbot-bridge tests. r=dustin
Land date changes to support windows nightlies onto central

MozReview-Commit-ID: 8AfCK50vRJc
2017-07-20 10:29:26 -04:00
Justin Wood
36e9acb1a8 Bug 1381577 - Part AF; Add tests for windows PGO and windows nightly. r=kmoir
Land date changes to support windows nightlies onto central

MozReview-Commit-ID: ANjwaLPNdqB
2017-07-19 21:36:46 -04:00
J. Ryan Stinnett
edd8cf908f Bug 1374748 - Use regular builds for Stylo via env var. r=catlee
MozReview-Commit-ID: BCMAuSRH1sQ
2017-07-11 13:39:22 -05:00
Carsten "Tomcat" Book
acef55d2e9 merge mozilla-inbound to mozilla-central a=merge 2017-07-12 11:07:09 +02:00
Rob Thijssen
85335f55a1 Bug 1379603 - enable windows hardware tests on try; r=dustin
MozReview-Commit-ID: 2yXsMEFOa00
2017-07-10 13:15:33 +03:00
Ryan VanderMeulen
cbf032f314 Bug 1379929 - Fix OSX TC test platform naming. r=catlee 2017-07-11 10:10:51 -04:00
Johan Lorenzo
411fcdb606 Bug 1374589 - Port windows tests which require signed builds to in-tree tasks r=Callek
MozReview-Commit-ID: JI0T2qW6P00
2017-06-29 13:50:13 -07:00
Greg Mierzwinski
20b6be5ebf Bug 1377915 - Increase page load timeout for talos tests running on linux64-ccov. r=dustin
This patch increases the amount of time that a page load is allowed to take from 5 seconds to 15 seconds (specified as milliseconds in the argument) when the Talos test suite is running on the linux64-ccov build.

MozReview-Commit-ID: BuoQP5wmxlb
2017-07-03 14:00:51 -04:00
Chris AtLee
cc0e5f0b94 Bug 1374351: Update platform names for cross-compiled OSX builds r=Callek
MozReview-Commit-ID: 4a2mhRVFhQP
2017-06-30 16:54:03 -07:00
Greg Mierzwinski
bd3b7c2204 Bug 1377982 - Use the Ubuntu 16.04 OS in Talos test suites that run on linux64-ccov. r=marco
This patch updates the OS that the Talos test suites use when they run on linux64-ccov to Ubuntu 16.04.

MozReview-Commit-ID: 4hx0jhTXv1C
2017-07-04 14:31:47 -04:00
Greg Mierzwinski
e60f6db28c Bug 1372324 - Enable talos tests on linux64-ccov. r=jmaher
This patch enables talos test suites to run on VM (taskcluster) and also enables these test suites to run with GCOV code coverage instrumentation on the linux64-ccov build.

MozReview-Commit-ID: 7p59zvra1ge
2017-06-09 14:51:20 -04:00
Dustin J. Mitchell
e65ef81096 Bug 1375044: remove temporary load-balancing check; r=wcosta
MozReview-Commit-ID: 7oy5C9KSpvR
2017-06-21 16:07:14 +00:00
Chris AtLee
c8cb2e7610 Bug 1374422 - Enable OSX cross-compile builds as tier1 on mozilla-central. r=dustin
This patch enables OSX cross compiled jobs as tier 1, and additionally adds testing for OSX Nightlies via Taskcluster. Initially tested on the 'date' project branch primarily with Bug 1373384

MozReview-Commit-ID: 7nWfiSEDbJd
2017-06-19 16:47:11 -04:00
Chris AtLee
90d74ace42 Bug 1370298: Move TC Win7 tests to Tier1 r=aselagea,jmaher
MozReview-Commit-ID: 5kIykFamr8g
2017-06-14 20:24:36 -04:00
Greg Mierzwinski
e654e0f854 Bug 1369908 - Schedule linux64-ccov, and linux64-jsdcov on all mozilla-central pushes. r=jmaher
This patch removes the nightly code coverage run in favor of simply running the two code coverage builds on every single push to mozilla-central for a more granular view of code coverage over time.

MozReview-Commit-ID: E4Xp5bB19m9
2017-06-13 13:04:08 -04:00