Commit Graph

63 Commits

Author SHA1 Message Date
Ricky Stewart
31b8ca9716 Bug 1654103: Standardize on Black for Python code in mozilla-central.
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Make some ad-hoc manual updates to `testing/marionette/client/setup.py`, `testing/marionette/harness/setup.py`, and `testing/firefox-ui/harness/setup.py`, which have hard-coded regexes that break after the reformat.

5. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-26 18:34:53 +00:00
Bogdan Tara
612312a64c Backed out 10 changesets (bug 1654103, bug 1672023, bug 1518999) for PanZoomControllerTest.touchEventForResult gv-junit failures CLOSED TREE
Backed out changeset ff3fb0b4a512 (bug 1672023)
Backed out changeset e7834b600201 (bug 1654103)
Backed out changeset 807893ca8069 (bug 1518999)
Backed out changeset 13e6b92440e9 (bug 1518999)
Backed out changeset 8b2ac5a6c98a (bug 1518999)
Backed out changeset 575748295752 (bug 1518999)
Backed out changeset 65f07ce7b39b (bug 1518999)
Backed out changeset 4bb80556158d (bug 1518999)
Backed out changeset 8ac8461d7bd7 (bug 1518999)
Backed out changeset e8ba13ee17f5 (bug 1518999)
2020-10-24 03:36:18 +03:00
Ricky Stewart
065d2eb893 Bug 1654103: Standardize on Black for Python code in mozilla-central. r=remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers,devtools-backward-compat-reviewers,jgilbert,preferences-reviewers,sylvestre,maja_zf,webcompat-reviewers,denschub,ntim,whimboo,sparky
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Make some ad-hoc manual updates to `testing/marionette/client/setup.py`, `testing/marionette/harness/setup.py`, and `testing/firefox-ui/harness/setup.py`, which have hard-coded regexes that break after the reformat.

5. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-23 20:40:42 +00:00
Dorel Luca
95b44c982f Backed out changeset 7558c8821a07 (bug 1654103) for multiple failures. CLOSED TREE 2020-10-22 03:51:06 +03:00
Ricky Stewart
43baed3c18 Bug 1654103: Standardize on Black for Python code in mozilla-central. r=remote-protocol-reviewers,marionette-reviewers,webdriver-reviewers,perftest-reviewers,devtools-backward-compat-reviewers,jgilbert,preferences-reviewers,sylvestre,maja_zf,webcompat-reviewers,denschub,ntim,whimboo,sparky
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-21 21:27:27 +00:00
Nick Thomas
66ca4016e6 Bug 1630809 - read attribution configuration from github r=aki
The partner attribution config is stored in the same repository as the repo manifest for partner repacks, but all in attribution_config.yml instead of default.xml. This extends the existing support for using the Github API to read files to retrieve and process the attribution config.

Differential Revision: https://phabricator.services.mozilla.com/D87728
2020-08-27 22:19:39 +00:00
Butkovits Atila
797523cdf6 Backed out 9 changesets (bug 1630809, bug 1653476) for Gecko Decision failures. CLOSED TREE
Backed out changeset 02a27bfc76dd (bug 1653476)
Backed out changeset afb5df61943a (bug 1630809)
Backed out changeset 04628c1f98e9 (bug 1630809)
Backed out changeset 4b4d50e0b1bf (bug 1630809)
Backed out changeset 2fa2deb5c993 (bug 1630809)
Backed out changeset d6652114cac3 (bug 1630809)
Backed out changeset ad5e4caa3291 (bug 1630809)
Backed out changeset d3d841cd14f3 (bug 1630809)
Backed out changeset b3746502e227 (bug 1630809)
2020-08-28 01:15:03 +03:00
Nick Thomas
14d697a9f8 Bug 1630809 - read attribution configuration from github r=aki
The partner attribution config is stored in the same repository as the repo manifest for partner repacks, but all in attribution_config.yml instead of default.xml. This extends the existing support for using the Github API to read files to retrieve and process the attribution config.

Differential Revision: https://phabricator.services.mozilla.com/D87728
2020-08-27 05:29:18 +00:00
Narcis Beleuzu
9ad46eadd4 Backed out changeset 3755692f8d5f (bug 1649987) as per glandium req 2020-08-19 10:32:09 +03:00
Joel Maher
28b62ffe7c Bug 1649987 - Set default task expiry to 12 weeks r=bhearsum
Set default task expiry for artifacts

Differential Revision: https://phabricator.services.mozilla.com/D87496
2020-08-18 20:39:58 +00:00
Mihai Alexandru Michis
4009b8dbe9 Backed out changeset d244e80dc826 (bug 1649987) for causing builds to fail as exceptions.
CLOSED TREE
2020-08-13 17:56:12 +03:00
Chris AtLee
61f1034311 Bug 1649987: Set default task expiry to 12 weeks r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D82229
2020-08-12 20:54:39 +00:00
Bogdan Tara
da97e2773f Backed out changeset 49da43027193 (bug 1649987) for gecko decision bustage CLOSED TREE 2020-08-12 18:18:23 +03:00
Chris AtLee
b03c4a2d20 Bug 1649987: Set default task expiry to 12 weeks r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D82229
2020-08-12 14:51:05 +00:00
Armen Zambrano G.
a8f5254df3 Bug 1639873 - New backfill action r=tomprince
This backfill action schedules a secondary action per push. This secondary action
schedules the intended task on behalf of the primary action.

This introduces logic on how to trigger a hook by an action.

Differential Revision: https://phabricator.services.mozilla.com/D79351
2020-07-03 13:45:21 +00:00
Simon Fraser
e81537ccb0 Bug 1635072 treescript/merge-automation move version file to config r=rjl
Differential Revision: https://phabricator.services.mozilla.com/D73722
2020-05-04 16:36:17 +00:00
Rob Lemley
1f50d0f88b Bug 1624763 - Enable custom actions to be defined in a repo. r=tomprince
This is a port of https://hg.mozilla.org/ci/taskgraph/rev/a61ab06c25222 to allow
for custom actions in a project repo. Previously, registration of actions worked
but did not run when triggered.

Differential Revision: https://phabricator.services.mozilla.com/D68891
2020-04-09 07:37:21 +00:00
Simon Fraser
30209825a0 Bug 1626933 Support bump_esr action in merge automation action r=jlorenzo
The action now requires a 'behavior' and not a 'merge_flavor'. An example log is https://firefox-ci-tc.services.mozilla.com/tasks/Qzsu8CY2QnylZSpO66Dy-g/runs/0/logs/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FQzsu8CY2QnylZSpO66Dy-g%2Fruns%2F0%2Fartifacts%2Fpublic%2Flogs%2Fesr68.diff

Differential Revision: https://phabricator.services.mozilla.com/D69425
2020-04-03 10:36:42 +00:00
Simon Fraser
71df657e03 Bug 1626027 Add support for bump_and_tag_central merge day action r=jlorenzo
Differential Revision: https://phabricator.services.mozilla.com/D68992
2020-03-31 14:25:25 +00:00
Simon Fraser
3d2d062e1a Bug 1615311 Add merge day action r=mtabara
Calling the merge day automation requires an action so that we can pass in parameters such as source and destination repository and branch.

Differential Revision: https://phabricator.services.mozilla.com/D62763
2020-02-25 10:48:54 +00:00
Aki Sasaki
4b3b302cf4 Bug 1562412 - key mac-behavior off shippable r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D64413
2020-02-26 21:50:11 +00:00
Aki Sasaki
2db08c251f Bug 1562412 - adjust mac-behavior by project and kind. r=nthomas
Differential Revision: https://phabricator.services.mozilla.com/D57735
2020-02-25 15:38:27 +00:00
Dorel Luca
6fd8e69dd7 Backed out 17 changesets (bug 1562412) for for build-notarization failures.
Backed out changeset 9c3d85e9b9fe (bug 1562412)
Backed out changeset e39e5d6a77a8 (bug 1562412)
Backed out changeset aa62038d5d76 (bug 1562412)
Backed out changeset 2143a26de372 (bug 1562412)
Backed out changeset 5b7ca7cf6649 (bug 1562412)
Backed out changeset 7870fa417606 (bug 1562412)
Backed out changeset bf7896916b91 (bug 1562412)
Backed out changeset cd6f0176af52 (bug 1562412)
Backed out changeset af8ccde58367 (bug 1562412)
Backed out changeset 9be172fa19e1 (bug 1562412)
Backed out changeset 9ccdef3b8c9d (bug 1562412)
Backed out changeset 0fc1845ea46c (bug 1562412)
Backed out changeset 861e4a4a13aa (bug 1562412)
Backed out changeset 32f31a6daaa8 (bug 1562412)
Backed out changeset b51ce1cea46d (bug 1562412)
Backed out changeset b8ddcf8368c5 (bug 1562412)
Backed out changeset 19ac1668f0db (bug 1562412)
2020-02-25 02:54:24 +02:00
Aki Sasaki
c05a4bc3bf Bug 1562412 - adjust mac-behavior by project and kind. r=nthomas
Differential Revision: https://phabricator.services.mozilla.com/D57735
2020-02-20 23:49:54 +00:00
Rob Lemley
f386c19930 Bug 1609987 - Port bug 1568006: Allow projects to modify decision parameters. r=tomprince
More ports from external taskgraph project. Short term, this will be used to get partial updates
working for Thunderbird.

Differential Revision: https://phabricator.services.mozilla.com/D61636
2020-02-04 22:32:12 +00:00
Rob Lemley
f96a7a13a3 Bug 1609987 - Port bug 1568006: Add project's taskgraph directory to the python path. r=tomprince
For mozilla-central, all the code related to taskgraph lives in
taskcluster/taskgraph. Thunderbird's build requirements are evolving, and
we want to be able to have repository-specific code. The natural place for it
to live is an a package beside taskcluster/ci. Add that to python path,
and provide some hooks for adding to the various registries in taskgraph.

Differential Revision: https://phabricator.services.mozilla.com/D60540
2020-01-23 17:09:41 +00:00
Tom Prince
62d0f0bd43 Bug 1605275: [taskgraph] Use worker aliases for beetmover and balrog workers; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D60780
2020-01-23 16:54:13 +00:00
Ricky Stewart
02945d3f8a Bug 1524639: [taskgraph] Enforce unicode strings in schemas r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D18376
2020-01-21 17:12:08 +00:00
Razvan Maries
1b1233c4a4 Backed out changeset a57aed49dc58 (bug 1524639) for beetmover bustages. a=backout 2020-01-16 14:04:31 +02:00
Ricky Stewart
16061a0a81 Bug 1524639: [taskgraph] Enforce unicode strings in schemas r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D18376
2020-01-15 20:33:20 +00:00
Tom Prince
a96b0dcc45 Bug 1605275: Adjust how signing workers are selected; r=Callek
When I was working on release-promotion for Thunderbird, I needed a way to
control the scriptworker worker-types used on try vs. on release branches.
At the time, there did not exist a way to vary worker types so I introduced
a scriptworker-specific way to vary the worker type.

Since then, we add support for worker aliases, which can currently vary by
level. This reuses that machinery for selecting signing workers.

Differential Revision: https://phabricator.services.mozilla.com/D58018
2019-12-27 23:44:06 +00:00
Gurzau Raul
65587fb236 Backed out 2 changesets (bug 1605275, bug 1605277) for build sign bustage on a CLOSED TREE.
Backed out changeset af16e71c6922 (bug 1605277)
Backed out changeset 4534f3e46f6e (bug 1605275)
2019-12-24 03:37:17 +02:00
Tom Prince
43eef5b2a1 Bug 1605275: Adjust how signing workers are selected; r=Callek
When I was working on release-promotion for Thunderbird, I needed a way to
control the scriptworker worker-types used on try vs. on release branches.
At the time, there did not exist a way to vary worker types so I introduced
a scriptworker-specific way to vary the worker type.

Since then, we add support for worker aliases, which can currently vary by
level. This reuses that machinery for selecting signing workers.

Differential Revision: https://phabricator.services.mozilla.com/D58018
2019-12-23 21:59:01 +00:00
Tom Prince
248a63a7f1 Bug 1589706: Add support worker worker-manager pool aliases; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D49763
2019-10-18 16:04:30 +00:00
Aki Sasaki
7ab88585fb Bug 1471004 - add esr support for entitlements. r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D38208
2019-07-16 17:22:40 +00:00
Aki Sasaki
0a2bef120c Bug 1546299 - add mac geckodriver signing support. r=jlorenzo
Also add the `mac_geckodriver` behavior, and remove the unused `mac_pkg` behavior.

Differential Revision: https://phabricator.services.mozilla.com/D36690
2019-07-15 16:38:43 +00:00
Aki Sasaki
9e5d3ddf17 Bug 1471004 - add entitlements url for hardened runtime signing. r=tomprince
For mac hardened runtime signing, we use an entitlements file that's now
in-tree. This patch passes the url for that file in the task definition.

The original patch for this was written by sfraser.

Differential Revision: https://phabricator.services.mozilla.com/D33859
2019-06-05 15:03:36 -07:00
Aki Sasaki
42172abea7 Bug 1471004 - mac-signing transform logic + config. r=tomprince
This moves mac signing tasks to the notarization/iscript pool. It also
adds support for pkg installers and notarization.

Differential Revision: https://phabricator.services.mozilla.com/D33857
2019-06-05 15:02:25 -07:00
Tom Prince
03059bf676 Bug 1532783: Implement worker aliases; r=aki,glandium,jmaher,dustin
There are a number of ways we want to vary workers over time and jobs, including

 - we are working on migrating to gce
 - pgo builds have a dedicated worker-type for running the instrumented build
   at level 3 but not level 1

Rather than have all tasks know about how the machines are provisioned, this
moves to using short-names for the worker types, and then has a config mapping
those to the actual worker types.

This adds support for aliases, and an initial set of them. Follow up work will
switch the existing uses of these worker types to using the aliases.

Differential Revision: https://phabricator.services.mozilla.com/D22549
2019-03-19 19:13:56 +00:00
Tom Prince
8aae294e17 Bug 1532710: [taskgraph] Move default branch priorities to graph config; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D22127
2019-03-07 04:20:36 +00:00
Tom Prince
bc04b4b311 Bug 1524639: [taskgraph] Change load_yaml to accept any number of path components; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D18374
2019-02-04 16:55:54 +00:00
Nick Thomas
f08da23210 Bug 1492033 - Create partner repacks during esr60 releases r=tomprince
Supports partner builds on esr60 by re-arranging how we specify the manifest repositories, which are different for esr60 compared to beta+release. The defaults for enabling partners and EME-free now depend on the partner-urls definition in taskcluster/ci/config.yml.

This patch also adds support for partner & EMEfree repacks in try staging releases, for all the various release branches. It makes release_level available early in the decision task (for the release promotion action) where a Parameters object is not available. Signing worker type is no longer hard-coded, and we use level-1 secrets for querying Github (via bug 1513375).

Differential Revision: https://phabricator.services.mozilla.com/D15185
2018-12-27 09:30:52 +00:00
Tom Prince
7a634fb183 Bug 1494415: [taskgraph] Remove ignored default from graph config; r=dustin
We don't apply schema defaults, since when `taskgraph.fast`, we skip validation --
which if we were using the result of applying defaults would mean that
behavior changes when we skip validation.

Differential Revision: https://phabricator.services.mozilla.com/D7381
2018-10-02 21:17:07 +00:00
Rob Lemley
aa9835dcd1 Bug 1491907 - Get comm/ version from comm/mail/*version.txt r=dustin
The release-update-verify-config task requires that the versions passed
to it match up with what's been released. The version of Thunderbird
does not necessarily match the Gecko version it's based on.

Depends on D6509

Differential Revision: https://phabricator.services.mozilla.com/D6510
2018-09-29 20:53:10 +00:00
Tom Prince
a4d8a90466 Bug 1490094: [taskgraph] Change release_type to include more than just rc; r=bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D5787
2018-09-17 18:09:16 +00:00
Gregory Szorc
61b22ffc3d Bug 1469999 - Use yaml.safe_load() in taskgraph; r=dustin
yaml.load() can evaluate arbitrary Python code via syntax such as
`!!python/object/apply:os.system`. Seriously.

Let's switch taskgraph to yaml.safe_load(), which is reasonable
about limiting magic.

Differential Revision: https://phabricator.services.mozilla.com/D1736
2018-06-25 21:34:30 +00:00
Tom Prince
5531089b90 Bug 1458700: [release-promotion] Move configuration of version-bump and partial-update flavors to graph config; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D1452
2018-05-30 07:16:41 +00:00
Tom Prince
0afd3fc330 Bug 1447460: [taskgraph] Use the graph config root to guess find the path to .taskcluster.yml in actions; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D1126
2018-05-02 20:30:15 -06:00
Tom Prince
30ff257010 Bug 1458700: [release-promotion] Move configuration of flavors into the graph configuration; r=aki,dustin
Differential Revision: https://phabricator.services.mozilla.com/D1121
2018-04-23 00:17:30 -06:00
Aki Sasaki
d28bfdaad3 bug 1457034 - generate release_partner_config in release_promotion r=nthomas
If we're not passed `release_partner_config` in the input, let's poll github for it in the action.

MozReview-Commit-ID: 2swx76vhTE5
2018-04-25 15:16:49 -07:00