Commit Graph

142 Commits

Author SHA1 Message Date
Simon Fraser
7fa579dc38 Bug 1436369 periodic file updates migration, stage 1 r=callek
Summary:
We'll be adding the new periodic file updates task to run in parallel. This patch
moves the existing one to make it clear it's running on buildbot, so we don't get confused
later on.

Reviewers: Callek

Reviewed By: Callek

Bug #: 1436369

Differential Revision: https://phabricator.services.mozilla.com/D681
***
Bug 1436369 Add taskcluster periodic file updates r=callek

Reviewers: Callek

Reviewed By: Callek

Differential Revision: https://phabricator.services.mozilla.com/D683
***
Bug 1436469 Fix task definition r=callek
***
Bug 1436469 Move periodic-file updates docker image r=callek
2018-03-06 15:27:58 +00:00
Andreea Pavel
d50ab2378e Backed out changeset 514feaa0c698 (bug 1436369) for taskcluster-images bustage on a CLOSED TREE 2018-03-07 14:22:54 +02:00
Simon Fraser
381fa78d1d Bug 1436369 periodic file updates migration, stage 1 r=callek
Summary:
We'll be adding the new periodic file updates task to run in parallel. This patch
moves the existing one to make it clear it's running on buildbot, so we don't get confused
later on.

Reviewers: Callek

Reviewed By: Callek

Bug #: 1436369

Differential Revision: https://phabricator.services.mozilla.com/D681
***
Bug 1436369 Add taskcluster periodic file updates r=callek

Reviewers: Callek

Reviewed By: Callek

Differential Revision: https://phabricator.services.mozilla.com/D683
***
Bug 1436469 Fix task definition r=callek
***
Bug 1436469 Move periodic-file updates docker image r=callek
2018-03-06 15:27:58 +00:00
Bogdan Tara
a5d6a81c08 Backed out changeset 6ba388ca08da (bug 1436369) for taskcluster-images bustage and linting failure at taskcluster/ci/repo-update/kind.yml:49:1 on a CLOSED TREE 2018-03-07 13:21:46 +02:00
Simon Fraser
f94c0b687d Bug 1436369 periodic file updates migration, stage 1 r=callek
Summary:
We'll be adding the new periodic file updates task to run in parallel. This patch
moves the existing one to make it clear it's running on buildbot, so we don't get confused
later on.

Reviewers: Callek

Reviewed By: Callek

Bug #: 1436369

Differential Revision: https://phabricator.services.mozilla.com/D681
***
Bug 1436369 Add taskcluster periodic file updates r=callek

Reviewers: Callek

Reviewed By: Callek

Differential Revision: https://phabricator.services.mozilla.com/D683
***
Bug 1436469 Fix task definition r=callek
***
Bug 1436469 Move periodic-file updates docker image r=callek
2018-03-06 15:27:58 +00:00
Csoregi Natalia
e3d7e7226b Backed out 3 changesets (bug 1436469) for Gecko Decision task failure. CLOSED TREE
Backed out changeset a03dea399278 (bug 1436469)
Backed out changeset 370c9dbdd572 (bug 1436369)
Backed out changeset b3b9609544ec (bug 1436369)
2018-03-06 17:36:19 +02:00
Simon Fraser
43976ff3d6 Bug 1436369 Add taskcluster periodic file updates r=callek
Reviewers: Callek

Reviewed By: Callek

Differential Revision: https://phabricator.services.mozilla.com/D683
2018-03-06 15:10:46 +00:00
Simon Fraser
18a8af2f77 Bug 1436369 Move buildbot periodic file updates to clearer name r=callek
Summary:
We'll be adding the new periodic file updates task to run in parallel. This patch
moves the existing one to make it clear it's running on buildbot, so we don't get confused
later on.

Reviewers: Callek

Reviewed By: Callek

Bug #: 1436369

Differential Revision: https://phabricator.services.mozilla.com/D681
2018-03-06 15:09:48 +00:00
Johan Lorenzo
84dcaef030 Bug 1432817 - [in-tree relpro] Delete push-apk-breakpoint task r=aki
MozReview-Commit-ID: G5nvGfNIVNN
2018-02-22 17:10:29 +00:00
Aki Sasaki
baf3d863e4 bug 1438735 - balrog scriptworker push and schedule support. r=bhearsum
- add balrog submit-toplevel - this replaces the final portion of the updates builder.
- rename balrog transform to balrog_submit, because it's for balrog locale submission
  - make this default to the 'promote' phase. balrog and beetmover currently take the current
    phase, which isn't always the wanted behavior.
- rename balrog publish to balrog schedule
- add balrog secondary push and secondary scheduling, for RCs
- remove the release_updates transforms
- make the task.py balrog transforms smarter
- get rid of the release_balrog_publishing transforms; ad a generic worker_type transform
- add BALROG_ACTIONS to scriptworker.py
- add get_balrog_action_scope()
- remove the unused balrog channel scopes

MozReview-Commit-ID: 369ACiOAd5F
2018-02-15 18:14:26 -08:00
Ben Hearsum
f034880215 bug 1398799: switch to in-tree mozharness update verify config creator. r=aki 2018-02-23 06:03:27 -05:00
Aki Sasaki
c18afe6617 bug 1438023 - stop running old-id android builds in promote_fennec. r=bhearsum
MozReview-Commit-ID: 6XqcXoHkSlF
2018-02-22 13:30:09 +00:00
Ben Hearsum
2b3fbda901 bug 1398799: split update verify primary/secondary tasks into multiple kinds. r=aki 2018-02-07 14:54:11 -05:00
Aki Sasaki
679d686a86 bug 1431799 - add ship_fennec_rc relpro flavor. r=bhearsum
Also add rc-{google-play-track,rollout-percentage} for RC pushapk.

One nice side effect of using the same push-apk kind: we don't re-run push-apk during the ship_fennec relpro flavor if we've run the ship_fennec_rc flavor with the same build. (Google Play would reject the same buildid.)

This is really for bug 1433536, but MozReview is forcing me to include this patch with the others for reasons.

MozReview-Commit-ID: 69ymqVLv9E2
2018-02-02 14:50:38 -08:00
Aki Sasaki
99eca8a17e bug 1431799 - rename desktop_release_type -> release_type. r=bhearsum
This used to only be relevant to Devedition and Firefox releases.
In bug 1433536 we're going to add RC Fennec releases. Let's rename
the parameter now, for less parameters churn.

MozReview-Commit-ID: 28e1Y5FG4On
2018-02-01 10:07:03 -08:00
Aki Sasaki
1143ca2ce3 bug 1431799 - add RC secondary tasks. r=bhearsum
MozReview-Commit-ID: 2hq4K5QVbWy
2018-01-29 16:19:52 -08:00
Aki Sasaki
8da6b5789a bug 1431799 - add version input to release promotion action. r=bhearsum
also clean up and move more config to the promotion config.

MozReview-Commit-ID: FmTWNNPcEaZ
2018-01-26 13:09:35 -08:00
Tom Ritter
185dde864c Bug 1432213 Fix the MinGW build on the beta branch and re-enable it r=froydnj
When we branched to beta, the MinGW build started failing with a strange error
like "could not find the robustcheckout Mercurial extension". We disabled it
for a while, but now we're re-enabling it (and fixing the problem.)

The root culprit of this was that we were using the incorrect mozconfig. MinGW
does all sorts of stuff in the mozconfig, but the beta branch overrides the
mozconfig using platform_overrides in
testing/mozharness/configs/builds/branch_specifics.py

We avoid this override by changing the MinGW platform so it doesn't match
and the mozconfig doesn't get overridden.

MozReview-Commit-ID: JkETWCRHacO
2018-01-24 14:13:54 -06:00
Aki Sasaki
bd65b15ffb bug 1423081 - desktop tc relpro taskcluster docs. r=callek
MozReview-Commit-ID: JJGlzcJbBR4
2017-12-05 19:42:24 -08:00
Aki Sasaki
6320defa0c bug 1423081 - target_tasks_methods updates. r=callek
Here we're adding/updating support for the promote/push/ship phases
for fennec, devedition, and firefox. These are now keyed off of the new
shipping_phase and shipping_product attributes as much as possible.

MozReview-Commit-ID: Fkg8jTPeZHZ
2017-12-05 19:10:28 -08:00
Bill McCloskey
44aa912ec0 Bug 1418188 - Run Searchfox indexing in TaskCluster on a daily basis (r=dustin,chmanchester)
MozReview-Commit-ID: FKrA8ejwuic
2017-11-23 07:25:12 -08:00
Bill McCloskey
566faeb775 Revert "Bug 1418188 - Run Searchfox indexing in TaskCluster on a daily basis (r=dustin,chmanchester)"
This reverts commit ae02e7fc64ac3c3faa991cee297defdf69643101.
2017-11-22 15:17:11 -08:00
Bill McCloskey
6e1ea609ed Bug 1418188 - Run Searchfox indexing in TaskCluster on a daily basis (r=dustin,chmanchester)
MozReview-Commit-ID: FKrA8ejwuic
2017-11-22 14:33:50 -08:00
Tom Ritter
0b5c90ef04 Bug 1414016 Remove the MinGW Build from beta due to build breaks r=aki
MozReview-Commit-ID: GqK0hNwLwoZ
2017-11-17 08:56:00 -06:00
Aki Sasaki
301155a682 bug 1415391 - add shipping_phase and shipping_product attributes. r=dustin
These two new attributes will help us determine which tasks belong in which release promotion graphs. In the future, we'll specify these for all shippable builds as well, and we can reduce the usage of the `product` keys. However, sometimes we need `product` to differ from `shipping-product` (e.g., `mobile` vs `fennec`; in this case we mean `stage_product` vs `shipping_product`), so I haven't yet touched those key/value pairs.

MozReview-Commit-ID: LEuf4CS277Q
2017-11-08 18:02:28 -08:00
Tom Prince
57d2bc9ee2 Bug 1414988: Update recursive calls to target_tasks_* functions; r=dustin
MozReview-Commit-ID: Fb7EYV4Vk4G
2017-11-06 16:54:03 -07:00
Tom Prince
31a9f87229 Bug 1410513: Move ridealong build configuration to ci/config.yml; r=dustin
MozReview-Commit-ID: 761zWtiZFtz
2017-11-02 14:34:47 -06:00
Aki Sasaki
f879cd0cc7 bug 1412690 - address review comments. r=mtabara
MozReview-Commit-ID: JKeqeF1hC30
2017-10-30 11:57:59 -07:00
Aki Sasaki
354b0684f2 bug 1412690 - add task dependencies. r=rail
This patch adds the `release_deps` transform, which adds every
kind-dependency task that has the same product as a task dependency
(with some exceptions).

This patch made it clear that we need a standard way of defining
product.

MozReview-Commit-ID: 4xOJRQSCTgF
2017-10-29 17:40:50 -07:00
Rok Garbas
504d0f106f Bug 1412690 - fennec release driver emails. r=aki
This patch adds the `release-notify-promote` and `release-notify-publish` kinds. It also genericizes all the notifications, and updates the kinds that use those notifications.

MozReview-Commit-ID: 9ymXKzthVF4
2017-10-29 17:35:03 -07:00
Aki Sasaki
62c2a90ad3 bug 1412690 - beetmover-cdns. r=rail
This patch adds the beetmover-cdns kind, and adds it to
`publish_fennec`.

This was the first non-buildbot-bridge, non-dummy relpro task, so this
needed a new transform.

This patch also updates the `previous_graph_kinds` and updates the
beetmover scopes in scriptworker.py.

MozReview-Commit-ID: 3rpkjuLjjXz
2017-10-29 17:32:22 -07:00
Aki Sasaki
1c21531040 bug 1412690 - stop building android nightlies on push. r=rail
We were building some Android nightly platforms on push, because we
didn't add them explicitly to the remove list.

I think longer term, we'll want to have `product` and
`release_promotion_action` attributes set in a standard manner, that we
can use to filter these things more intelligently.

MozReview-Commit-ID: KNZ7vxc3gRo
2017-10-29 17:30:05 -07:00
Rok Garbas
835074b626 Bug 1412690 - fennec version bump in-tree task. r=aki
This patch adds the initial `release-version-bump` kind, and adds it to
the `publish_fennec` `target_tasks_method`.

It also adds support for `next_version`.

MozReview-Commit-ID: 9YRswddeuZ3
2017-10-29 17:25:01 -07:00
Rail Aliiev
ac5aead3be Bug 1412690 - Fennec uptake monitoring in-tree task. r=aki
This patch adds the initial `release-uptake-monitoring` kind, and adds
it to the `publish_fennec` `target_tasks_method`.

MozReview-Commit-ID: 3RDMNGrbBwD
2017-10-29 17:23:12 -07:00
Rail Aliiev
6697b66d8f Bug 1412690 - Fennec bouncer aliases in-tree task. r=aki
This patch adds the initial `release-bouncer-aliases` kind, and adds it
to the `publish_fennec` `target_tasks_method`.

It also adds the ability to specify the `tuxedo_server_url`
`by-project`.

MozReview-Commit-ID: 9I4IaUlbCCD
2017-10-29 17:18:46 -07:00
Rail Aliiev
9ab4e939a4 Bug 1412690 - Fennec mark release as shipped in-tree task. r=aki
This patch adds the initial `release-mark-as-shipped` kind, and adds it to
the `publish_fennec` `target_tasks_method`.

MozReview-Commit-ID: F8AYscJQWlh
2017-10-29 17:16:37 -07:00
Aki Sasaki
60f9e70a9e bug 1412690 - add {promote,publish}_{fennec,firefox} target task methods. r=rail
This hooks up the `target_tasks_method`s and the
`release_promotion_flavor`s for these four release promotion flavors.

We also add some maple support and add `version_display.txt` to the
decision task sparse checkout so we can read the version number during
decision/action task time.

MozReview-Commit-ID: CdxUUXZtXO0
2017-10-29 17:10:42 -07:00
Aki Sasaki
667f105f2b bug 1412690 - allow for relpro target_tasks_method. r=rail
This patch creates a new `filter_beta_release_tasks` function. By
pulling this logic out of `mozilla_beta_tasks`, we can reuse it in the
release promotion `target_tasks_method`s.

MozReview-Commit-ID: Kwk3jgtooCS
2017-10-29 17:08:54 -07:00
Sebastian Hengst
2aef76451f Backed out changeset 87c05e34ef50 (bug 1409739) for valgrind bustage: '--enable-jemalloc' implied by '--enable-dmd' conflicts with '--disable-jemalloc' from the mozconfig. r=backout 2017-10-19 18:29:55 +02:00
Chris AtLee
076165fe10 Bug 1409739: Remove old DMD configs r=glandium
MozReview-Commit-ID: H7kc33CXIbQ
2017-10-17 11:26:04 -04:00
Justin Wood
34b4a0f679 Bug 1408083 - Drop support for single locale fennec releases/betas. r=rail
MozReview-Commit-ID: 3xiILzghRoY
2017-10-13 16:29:09 -04:00
Dustin J. Mitchell
935b8b7768 Bug 1403342 - default to -j none and do not optimize_target_tasks for try; r=ahal
With this in place, all `-j`obs will not run by default on try.  This will omit
such jobs in most try pushes even if files-changed matches. This is
unfortunate, but better than running them unconditionally.  Fuzzy selections,
and later `just try it` pushes, are the ultimate solution here.

With this change, a push with no try syntax or try_task_config.json will schedule
no tasks at all.

MozReview-Commit-ID: FGjqlDW1FT6
2017-10-03 21:15:15 +00:00
Justin Wood
725bc543fa Bug 1402457 - fix the file update target task to not schedule the world. r=aki
for: Run buildbot's periodic_file_update job scheduled via taskcluster.

I messed up thinking this was filter-out not filter in the target task method.
I'm also renaming the target_task method in order to avoid these decision jobs
from needing to contact balrog for partial data (because it had 'nightly' in the
target task name.

MozReview-Commit-ID: 3uetnWG4vnW
2017-10-06 14:01:43 -04:00
Justin Wood
c7708e135d Bug 1402457 - Actually schedule periodic file updates. r=dustin
MozReview-Commit-ID: BJsNs86kNJu
2017-09-25 14:14:59 -04:00
Dustin J. Mitchell
d08f492fb6 Bug 1383880: parse try config during the decision task; r=ahal
This sets the try_mode property, and parses the try message (if given), early
in the decision task and puts the results into the parameters.

The proximate need is to set optimze_target_tasks for some try modes and not
others. This also replaces the existing logic for parsing messages for certain
kinds, and makes the distinction between the different try modes a little
clearer.

MozReview-Commit-ID: AXJEGLh6pEV
2017-08-21 23:14:14 +00:00
Phil Ringnalda
b76b48b887 Backed out 12 changesets (bug 1383880) for decision task bustage
CLOSED TREE

Backed out changeset fd3615e7e0a3 (bug 1383880)
Backed out changeset 8cceb6a82bfb (bug 1383880)
Backed out changeset 571a6c9054a5 (bug 1383880)
Backed out changeset ec2b8ba5a949 (bug 1383880)
Backed out changeset 8e5847d9acda (bug 1383880)
Backed out changeset b354fdf6e233 (bug 1383880)
Backed out changeset ebdd6ccbcfca (bug 1383880)
Backed out changeset ebcc9d20981a (bug 1383880)
Backed out changeset 97eedc84d6e8 (bug 1383880)
Backed out changeset a3116da52b4e (bug 1383880)
Backed out changeset b3eb0c939720 (bug 1383880)
Backed out changeset 7c07cb798530 (bug 1383880)

MozReview-Commit-ID: EPDuQHr7w2y
2017-09-20 19:57:39 -07:00
Dustin J. Mitchell
a7457a95f7 Bug 1383880: parse try config during the decision task; r=ahal
This sets the try_mode property, and parses the try message (if given), early
in the decision task and puts the results into the parameters.

The proximate need is to set optimze_target_tasks for some try modes and not
others. This also replaces the existing logic for parsing messages for certain
kinds, and makes the distinction between the different try modes a little
clearer.

MozReview-Commit-ID: AXJEGLh6pEV
2017-08-21 23:14:14 +00:00
Ryan VanderMeulen
c41dc43ff0 Backed out 9 changesets (bug 1383880) for decision task bustage.
Backed out changeset 53f5d47a7cb0 (bug 1383880)
Backed out changeset a0abda41172a (bug 1383880)
Backed out changeset 729a7e2091e8 (bug 1383880)
Backed out changeset a33f5a14a471 (bug 1383880)
Backed out changeset 5b10d321cfee (bug 1383880)
Backed out changeset 8056488d8aed (bug 1383880)
Backed out changeset e62c90e3c1e8 (bug 1383880)
Backed out changeset 91f116ce6c2a (bug 1383880)
Backed out changeset 045498bc36c4 (bug 1383880)
2017-09-01 15:37:08 -04:00
Dustin J. Mitchell
464d6eeb31 Bug 1383880: parse try config during the decision task; r=ahal
This sets the try_mode property, and parses the try message (if given), early
in the decision task and puts the results into the parameters.

The proximate need is to set optimze_target_tasks for some try modes and not
others. This also replaces the existing logic for parsing messages for certain
kinds, and makes the distinction between the different try modes a little
clearer.

MozReview-Commit-ID: AXJEGLh6pEV
2017-08-21 23:14:14 +00:00
Johan Lorenzo
9d82d58d34 Bug 1384482 - Rename android-api-15 into android-api-16 r=mtabara
MozReview-Commit-ID: 4j66pTZEJzq
2017-08-09 16:18:15 +02:00