Commit Graph

102 Commits

Author SHA1 Message Date
Justin Wood
34b4a0f679 Bug 1408083 - Drop support for single locale fennec releases/betas. r=rail
MozReview-Commit-ID: 3xiILzghRoY
2017-10-13 16:29:09 -04:00
Dustin J. Mitchell
935b8b7768 Bug 1403342 - default to -j none and do not optimize_target_tasks for try; r=ahal
With this in place, all `-j`obs will not run by default on try.  This will omit
such jobs in most try pushes even if files-changed matches. This is
unfortunate, but better than running them unconditionally.  Fuzzy selections,
and later `just try it` pushes, are the ultimate solution here.

With this change, a push with no try syntax or try_task_config.json will schedule
no tasks at all.

MozReview-Commit-ID: FGjqlDW1FT6
2017-10-03 21:15:15 +00:00
Justin Wood
725bc543fa Bug 1402457 - fix the file update target task to not schedule the world. r=aki
for: Run buildbot's periodic_file_update job scheduled via taskcluster.

I messed up thinking this was filter-out not filter in the target task method.
I'm also renaming the target_task method in order to avoid these decision jobs
from needing to contact balrog for partial data (because it had 'nightly' in the
target task name.

MozReview-Commit-ID: 3uetnWG4vnW
2017-10-06 14:01:43 -04:00
Justin Wood
c7708e135d Bug 1402457 - Actually schedule periodic file updates. r=dustin
MozReview-Commit-ID: BJsNs86kNJu
2017-09-25 14:14:59 -04:00
Dustin J. Mitchell
d08f492fb6 Bug 1383880: parse try config during the decision task; r=ahal
This sets the try_mode property, and parses the try message (if given), early
in the decision task and puts the results into the parameters.

The proximate need is to set optimze_target_tasks for some try modes and not
others. This also replaces the existing logic for parsing messages for certain
kinds, and makes the distinction between the different try modes a little
clearer.

MozReview-Commit-ID: AXJEGLh6pEV
2017-08-21 23:14:14 +00:00
Phil Ringnalda
b76b48b887 Backed out 12 changesets (bug 1383880) for decision task bustage
CLOSED TREE

Backed out changeset fd3615e7e0a3 (bug 1383880)
Backed out changeset 8cceb6a82bfb (bug 1383880)
Backed out changeset 571a6c9054a5 (bug 1383880)
Backed out changeset ec2b8ba5a949 (bug 1383880)
Backed out changeset 8e5847d9acda (bug 1383880)
Backed out changeset b354fdf6e233 (bug 1383880)
Backed out changeset ebdd6ccbcfca (bug 1383880)
Backed out changeset ebcc9d20981a (bug 1383880)
Backed out changeset 97eedc84d6e8 (bug 1383880)
Backed out changeset a3116da52b4e (bug 1383880)
Backed out changeset b3eb0c939720 (bug 1383880)
Backed out changeset 7c07cb798530 (bug 1383880)

MozReview-Commit-ID: EPDuQHr7w2y
2017-09-20 19:57:39 -07:00
Dustin J. Mitchell
a7457a95f7 Bug 1383880: parse try config during the decision task; r=ahal
This sets the try_mode property, and parses the try message (if given), early
in the decision task and puts the results into the parameters.

The proximate need is to set optimze_target_tasks for some try modes and not
others. This also replaces the existing logic for parsing messages for certain
kinds, and makes the distinction between the different try modes a little
clearer.

MozReview-Commit-ID: AXJEGLh6pEV
2017-08-21 23:14:14 +00:00
Ryan VanderMeulen
c41dc43ff0 Backed out 9 changesets (bug 1383880) for decision task bustage.
Backed out changeset 53f5d47a7cb0 (bug 1383880)
Backed out changeset a0abda41172a (bug 1383880)
Backed out changeset 729a7e2091e8 (bug 1383880)
Backed out changeset a33f5a14a471 (bug 1383880)
Backed out changeset 5b10d321cfee (bug 1383880)
Backed out changeset 8056488d8aed (bug 1383880)
Backed out changeset e62c90e3c1e8 (bug 1383880)
Backed out changeset 91f116ce6c2a (bug 1383880)
Backed out changeset 045498bc36c4 (bug 1383880)
2017-09-01 15:37:08 -04:00
Dustin J. Mitchell
464d6eeb31 Bug 1383880: parse try config during the decision task; r=ahal
This sets the try_mode property, and parses the try message (if given), early
in the decision task and puts the results into the parameters.

The proximate need is to set optimze_target_tasks for some try modes and not
others. This also replaces the existing logic for parsing messages for certain
kinds, and makes the distinction between the different try modes a little
clearer.

MozReview-Commit-ID: AXJEGLh6pEV
2017-08-21 23:14:14 +00:00
Johan Lorenzo
9d82d58d34 Bug 1384482 - Rename android-api-15 into android-api-16 r=mtabara
MozReview-Commit-ID: 4j66pTZEJzq
2017-08-09 16:18:15 +02:00
Andrew Halberstadt
91fd656da8 Bug 1387135 - Add ability to apply templates to task definitions via try_task_config.json, r=dustin
This provides a mechanism to modify the behaviour of tasks from a try push. The try_task_config.json
looks something like:

{
  "tasks": ["build-linux64/opt", "test-linux64/opt-mochitest-e10s-1"],
  "templates": {
    "artifact": {"enabled": 1}
  }
}

This tells taskgraph to apply the 'artifact' template to all tasks. Templates are JSONe based
.yml files that live under taskcluster/taskgraph/templates. Taskgraph will render every template
against every task definition. The templates themselves can then use JSONe condition statements to
filter out which tasks they should or shouldn't apply to.

MozReview-Commit-ID: J8HVZzOt4mX
2017-08-15 11:36:29 -04:00
Aki Sasaki
576213e812 bug 1388581 - split win32/win64 nightly hooks. r=Callek
MozReview-Commit-ID: 8Gr8Cu9SLXQ
2017-08-08 18:04:18 -07:00
Johan Lorenzo
6f9022b7a5 Bug 1381520 - Stop making duplicated builds on beta for win{32,64} + mac r=Callek
MozReview-Commit-ID: sHT3VHav1s
2017-08-03 15:03:37 +02:00
Johan Lorenzo
a0cf4880f5 Bug 1386776 - Beta shouldn't schedule nightly l10n on-push r=Callek
MozReview-Commit-ID: 98jzxVfoQEo
2017-08-03 14:24:00 +02:00
Andrew Halberstadt
9cbe59ace4 Bug 1380306 - Create a new 'try_task_config' method for scheduling tasks on try, r=dustin
This introduces a 'try_task_config' method of scheduling. En lieu of (or in addition to) try
syntax, you can now check in a file called 'try_task_config.json' to the root of the source
tree. The format is either a list of task labels, or dict where task labels are the keys.
Taskcluster will simply schedule any tasks that are listed there.

This file is primarily meant to be generated by tools (which don't exist yet), as the json
format is much easier for tools to generate or consume. These tools should use an in-memory
commit to add the file so it is automatically removed again after the push.

A server-side hook will be added in bug 1380357 to prevent this file from accidentally
landing on non-try trees.

MozReview-Commit-ID: 2zKfZXuuDhH
2017-06-27 13:33:20 -07:00
Rail Aliiev
e45e59787e Bug 1380348 - Enable Devedition nightlies (beta only) r=Callek
MozReview-Commit-ID: EYpEMRSIxbB
2017-07-27 11:53:16 -04:00
Aki Sasaki
bc48f23f5b bug 1384794 - single hook for tc desktop nightlies (unify buildids) r=callek DONTBUILD
MozReview-Commit-ID: A0yzLvh9x3U
2017-07-27 09:23:41 -07:00
Justin Wood
0a8fa29fca Bug 1381577 - Part AL; Filter tasks based on run-on-projects for windows nightlies too. r=kmoir
Land date changes to support windows nightlies onto central

MozReview-Commit-ID: B9S2WXHESjG
2017-07-20 10:47:02 -04:00
Justin Wood
4709772b91 Bug 1381577 - Part G; Add win32 nightlies as well. r=kmoir
Land date changes to support windows nightlies onto central

MozReview-Commit-ID: 523yYvZR7Ib
2017-07-17 15:53:58 -04:00
Justin Wood
1e6e59c298 Bug 1381577 - Part B; Rename the nightly win64 hook to just nightly, support win32. r=dustin
Land date changes to support windows nightlies onto central

MozReview-Commit-ID: 6q7XwWTeXwo
2017-07-17 14:50:21 -04:00
Chris AtLee
e8497aa0e3 Bug 1371038: Add configs for doing DMD builds r=Callek
This adds the mozconfigs, mozharness configs and taskcluster changes required
to create optimized DMD builds for linux64, win32, win64 and macosx64.

These builds will happen nightly on mozilla-central

We also add support for custom build variants on Windows (or other generic
worker environments).

MozReview-Commit-ID: HrVT9PLSWVx
2017-06-22 12:49:03 -04:00
Chris AtLee
08523d0221 Bug 1371038: Remove unused stylo tasks target r=Callek
MozReview-Commit-ID: BXxHTeOyksO
2017-06-22 12:48:17 -04:00
Ryan VanderMeulen
c6c22dff9f Bug 1373301 - Fix flake8 indentation error. DONTBUILD 2017-06-23 16:27:09 -04:00
Kim Moir
dd98dc5772 Bug 1373301 - linux talos is not scheduled on mozilla-beta after merge day r=Callek DONTBUILD 2017-06-23 15:34:55 -04:00
Greg Mierzwinski
e654e0f854 Bug 1369908 - Schedule linux64-ccov, and linux64-jsdcov on all mozilla-central pushes. r=jmaher
This patch removes the nightly code coverage run in favor of simply running the two code coverage builds on every single push to mozilla-central for a more granular view of code coverage over time.

MozReview-Commit-ID: E4Xp5bB19m9
2017-06-13 13:04:08 -04:00
Andrew Halberstadt
16f7b57cf3 Bug 1372510 - Exclude 'job' tasks that require a build from the default try selection, r=dustin
It's a bit hacky to single out 'build' dependencies, but most tasks have a dependency on a docker
image, so we can't blanket skip all 'job' tasks with any dependencies at all. This is far from ideal
but is an improvement on the current behaviour of running build dependencies all the time, even if
the 'job' task gets optimized away.

There is likely a cleverer solution, but that can be follow-up work.

MozReview-Commit-ID: 6T68LT5VSrg
2017-06-13 11:04:08 -04:00
Aki Sasaki
0294f22c6c bug 1372412 - reenable osx opt builds on beta. r=catlee a=release CLOSED TREE
MozReview-Commit-ID: 97wCvP64neG
2017-06-12 16:23:08 -07:00
Justin Wood
a616277eab Bug 1372219 - Don't schedule macosx64-nightly or win64-nightly on-push for beta/release. r=mtabara
"migration commit on beta fails on TC decision task"

MozReview-Commit-ID: FbPyTQkm3P8
2017-06-12 10:11:00 -04:00
Alin Selagea
bf568eeaf1 Bug 1367472 - Please enable mac tests for cedar twig, r=mtabara (patch by aobreja) 2017-05-30 18:35:00 +03:00
Jim Chen
c51f50cf3a Bug 1366404 - Add AArch64 Nightly build; r=nalexander r=dustin
Add configurations for building and uploading AArch64 Nightly builds, in
tier 1 and without artifact support for now.

As for not denoting AArch64 builds as "api-21", I don't really think we
will split AArch64 the way we split ARMv7 before.  Originally, we split
into API 9 and API 11+ because of lots of "constrained" devices that
were stuck with API 9. We made an API 9 APK in order to lower our
footprint on those devices. That probably will not be a problem for
AArch64, because devices with API 21+ and AArch64 support are usually
more than capable for running Fennec. Secondly, it was a big change for
Android going from API 9 to API 11+, so we saved quite a bit of
code/resources when we stripped out API 11+.  I don't see such drastic
changes going from API 21 to upcoming versions, so even if we did split,
I don't think it'll get us much benefit.

MozReview-Commit-ID: 7N7Slv1pPgb
2017-05-25 16:53:33 -04:00
Ben Hearsum
49c4a92bff bug 1357808: switch mozilla-central fennec builds to org.mozilla.fennec_aurora id and add new builds for org.mozilla.fennec. r=aki,sylvestre,jlorenzo a=dawn 2017-05-24 15:27:40 -04:00
Ben Hearsum
37825844b8 Backout bug 1357808 for android mochitest bustage. 2017-05-24 12:32:03 -04:00
Ben Hearsum
29c15d74d2 bug 1357808: switch mozilla-central fennec builds to org.mozilla.fennec_aurora id and add new builds for org.mozilla.fennec. r=aki,sylvestre,jlorenzo a=dawn 2017-05-24 10:40:07 -04:00
Chris Manchester
03e99921f1 Bug 1317189 - Fix --rebuild-talos for TC try jobs by checking the correct attribute. r=wcosta
MozReview-Commit-ID: K3WwZS9rVdj
2017-05-09 14:04:10 -07:00
Justin Wood
b252c62804 Bug 1357112 - Add win64 nightly to Taskgraph. r=dustin
MozReview-Commit-ID: 1ZCjVE53gSe
2017-05-01 13:43:46 -04:00
Ryan VanderMeulen
4862fccf2f Bug 1361449 - Run Windows TC builds on Beta. r=jonasfj 2017-05-03 16:03:24 -04:00
Kim Moir
139537f424 Bug 1360964 - Promote Taskcluster Mac debug builds to Tier 1 and make sure that tests are scheduled off them. r=Callek 2017-05-01 09:34:00 -04:00
Dustin J. Mitchell
a9ae152390 Bug 1357465: include the full test platform like it says in the docs; r=jmaher
MozReview-Commit-ID: CkAsBNEznuw
2017-04-14 20:49:44 +00:00
Sebastian Hengst
a5210d8c66 Backed out changeset ccf614bcd296 (bug 1357465) for breaking gecko decision tasks for nightly-code-coverage and nightly-mochitest-valgrind. r=backout a=backout
MozReview-Commit-ID: LpexSmhHEFh
2017-04-22 11:21:21 +02:00
Justin Wood
4b2428ceed Bug 1357867 - Land in progress OSX cross compile nightly support. r=dustin
This commit adds the target_tasks method to trigger nightlies, and the unscheduled cron entry.

MozReview-Commit-ID: ELcZcUGPg2T
2017-04-18 09:36:27 -04:00
Dustin J. Mitchell
44aed2b792 Bug 1357465: include the full test platform like it says in the docs; r=jmaher
MozReview-Commit-ID: CkAsBNEznuw
2017-04-14 20:49:44 +00:00
Aki Sasaki
37d86abeb6 bug 1339179 - adjust pine's taskcluster tasks. r=jlorenzo DONTBUILD 2017-04-06 10:59:07 -07:00
Johan Lorenzo
1ef2d5229a Bug 1317783 - Put PushApk tasks in-tree r=aki
MozReview-Commit-ID: 8uGIuj7OXwZ
2017-04-04 11:21:07 +02:00
Johan Lorenzo
54f32a1bed Bug 1352477 - taskgraph ignores run-on-project for fennec-nightlies r=aki
MozReview-Commit-ID: 2cdNTV11gdn
2017-04-03 14:53:08 +02:00
Wes Kocher
a3386468d0 Backed out changeset 0edd9de2ca10 (bug 1317783) for future nightly bustage a=backout 2017-03-31 11:09:13 -07:00
Johan Lorenzo
65dab61921 Bug 1317783 - Put PushApk tasks in-tree r=aki
MozReview-Commit-ID: 8uGIuj7OXwZ
2017-03-30 12:13:01 +02:00
Kim Moir
8898701b6b Bug 1338871 - Enable Talos tests for linux64-stylo builds r=jmaher DONTBUILD 2017-03-23 12:12:46 -04:00
Aki Sasaki
528b1abb88 bug 1344321 - disable windows, mac, {win32,win64,linux}-pgo builds+tests on beta. r=dustin a=release
MozReview-Commit-ID: 3906jiTDdEv
2017-03-14 07:19:47 -07:00
Aki Sasaki
82ede80faa bug 1344321 - enable run-on-projects for nightlies. r=dustin a=release
This patch enables `run-on-projects` to work appropriately for
nightly builds and tests.  Initially, we were setting an empty
`run-on-projects` for nightly `build_platform`s, then explicitly
targeting the platforms in nightly-specific `target_task_method`s.

Instead, this patch enables nightlies to `run-on-projects` everywhere,
but governs the use of nightlies by either the `include_nightly`
parameter, or the `--include-nightly` try option.  This lets us filter
nightly-related `target_task_method`s against `run-on-projects` without
losing all nightly tasks.

Then, enable spidermonkey tests by removing optimization from beta and
release.  This patch also enables everything then disables specific
tasks, rather than disabling everything and enabling specific tasks.
Since we're beginning with a `filter_for_project` call, we should be
able to reduce these if blocks to zero over time, if desired.

MozReview-Commit-ID: A9tolynaChF
2017-03-14 15:31:58 -07:00
Kim Moir
2b008e8a17 Bug 1338871 - Enable Talos tests for linux64-stylo builds r=bustage DONTBUILD 2017-03-13 17:48:28 -04:00