Commit Graph

370 Commits

Author SHA1 Message Date
Johan Lorenzo
accfa9efd5 Bug 1551738 - Add mozilla_esr68_tasks target tasks r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D33971
2019-06-06 18:48:15 +00:00
alexandru.ionescu
b638be5fac Bug 1554608 Schedule raptor fennec v64 tests in CI r=dustin,tomprince
Ran locally `./mach taskgraph cron --head-repository=https://hg.mozilla.org/mozilla-central --project=mozilla-central --level=1` and got no errors:
```
 0:00.54 using current time for params['time']; try setting $CRON_TIME to a timestamp
 0:00.54 calculated cron schedule time is 2019-05-27 09:30:00
 0:00.56 not running cron job bouncer-check
 0:00.56 not running cron job chromium-update
 0:00.56 not running cron job customv8-update
 0:00.56 not running cron job nightly-android
 0:00.56 not running cron job nightly-desktop
 0:00.56 not running cron job nightly-desktop-linux
 0:00.56 not running cron job nightly-desktop-osx
 0:00.56 not running cron job nightly-desktop-win32
 0:00.56 not running cron job nightly-desktop-win64
 0:00.56 not running cron job nightly-desktop-win64-aarch64
 0:00.56 not running cron job periodic-update
 0:00.56 not running cron job pipfile-update
 0:00.56 not running cron job searchfox-index
** 0:00.56 not running cron job tp6m-fennec-v64**
```
Feel free to add to this review whoever is relevant.

Differential Revision: https://phabricator.services.mozilla.com/D32674
2019-06-03 13:59:18 +00:00
Johan Lorenzo
f1cb606876 Bug 1552573 - nightly_fennec: Use task.kind instead of task.label r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D32844
2019-05-31 12:21:41 +00:00
Johan Lorenzo
c9d171a224 Bug 1553853 - Rename "nightly-android" hooks to "nightly-geckoview" r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D32968
2019-05-30 23:48:20 +00:00
Nick Alexander
c28f19deb3 Bug 1522581 - Publish GeckoView multi-architecture fat AAR Nightly. r=jlorenzo
Differential Revision: https://phabricator.services.mozilla.com/D15774
2019-05-30 15:22:41 +00:00
Johan Lorenzo
59cf4d0c0b Bug 1548552 - Stop shipping Fennec nightlies to the Play Store from mozilla-central. r=tomprince, a=RyanVM
Test Plan:
taskgraph-diff

Differential Revision: https://phabricator.services.mozilla.com/D29689
2019-05-02 16:16:18 +00:00
Andrew Halberstadt
ab01f1e9b1 Bug 1550127 - [ci] Disable release and nightly tasks on ash, r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D30409
2019-05-13 21:55:08 +00:00
Andrew Halberstadt
03bc4efb44 Bug 1523303 - Align mozharness suite names with the ones in 'moztest.resolve', r=gbrown
This officially makes 'moztest.resolve' the source of truth when it comes to
suite names. It aligns that file with the names used in both the
desktop_unittest and android_emulator_unittest scripts.

Differential Revision: https://phabricator.services.mozilla.com/D27555
2019-04-22 22:32:34 +00:00
Andrew Halberstadt
a51c632aae Bug 1539446 - [ci] Run talos and raptor on ash, r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D27892
2019-04-17 13:34:31 +00:00
Justin Wood
2c2331467a Bug 1352113 - Shippable Builds - Support shippable where 'nightly' is used. r=aki
Makes most kinds that reference nightly attribute reference the shippable attribute.
Also makes most transforms that use nightly use shippable

Transfers dependencies/ownership for some things to shippable from nightly where it was harder to support both.

In no particular order, full list:
Send shippable attribute down to dep tasks.
Set tests as shippable attribute
Add new signing routes
Add shippable routes to repackage_routes transform
Adjust target tasks
Add shippable nightly-l10n
Add nightly-signing and as a side affect add repackage and repackage-signing
Add support for proper balrog platforms for shippable
Add shippable to the nightly sccache guard
Fix TC_PLATFORM_PER_FTP in partners.py to use shippable
Add shippable to mozharness_test variants
Only actually used for android which doesn't have shippable at this time.
Add shippable variant to beetmover transforms
Do nightly signing for mars on shippable
Support shippable in partner-repack transform
Support shippable in amo langpacks transform
Use proper signing for shippable tasks in repackage transforms
Set upload symbols to use shippable too
Use shippable as deps for geckodriver extraction
Use shippable as dep for autograph-stage signing
Do not run beetmover-l10n for shippable
Run shippable style jobs for repackage signing
Set build_platform for update verify and uvc to be shippable
Run repackage-msi for shippable
Add shippable to osx partner repack signing
add shippable to emefree repackage
add shippable to emefree repackage signing
add shippable to beetmover checksums
Add shippable to partner repack repackage signing
add partner repack beetmover
Add shippable to mar signing
Add shippable to mar-signing-l10n
add shippable to eme free beetmover checksums
Add shippable to upload-generated-sources
Add beetmover langpacks to shippable
Add repackage-l10n to shippable
Add shippable to partner repack chunk-dummy
Do eme free builds with shippable
Add signing of language packs to shippable
Add snap repackage for shippable
Add shippable for release-eme-free repack signing
Add partials for shippable
Add partner repack repackage for shippable
Add emefree beetmover for shippable
Add checksums-signing to shippable
Switch partner repacks to shippable
Add shippable to beetmover-repackage
Add secondary update verify configs for shippable
secondary update verify for shippable

Differential Revision: https://phabricator.services.mozilla.com/D24699
2019-03-27 13:45:40 +00:00
Cosmin Sabou
c119a3957c Backed out 19 changesets (bug 1352113) for causing upload symbol bustages. CLOSED TREE
Backed out changeset 4943b23813fe (bug 1352113)
Backed out changeset 4b9413d05816 (bug 1352113)
Backed out changeset 3e2b6a495e8c (bug 1352113)
Backed out changeset 51ab82722846 (bug 1352113)
Backed out changeset 4b027c970719 (bug 1352113)
Backed out changeset 6b65273fab78 (bug 1352113)
Backed out changeset d7deec98601a (bug 1352113)
Backed out changeset b95b3f4e5243 (bug 1352113)
Backed out changeset 7cefe92f88d5 (bug 1352113)
Backed out changeset f64dfaf86a2e (bug 1352113)
Backed out changeset 686c228e3579 (bug 1352113)
Backed out changeset dd2eddef8b43 (bug 1352113)
Backed out changeset fc16a3ecfe68 (bug 1352113)
Backed out changeset b31cbe91bdf7 (bug 1352113)
Backed out changeset 694eac65a72e (bug 1352113)
Backed out changeset 6044aedac9c4 (bug 1352113)
Backed out changeset 456538d78b36 (bug 1352113)
Backed out changeset 01699fb72384 (bug 1352113)
Backed out changeset 4a2e544fea0d (bug 1352113)
2019-03-26 22:26:29 +02:00
Justin Wood
2fbc3b039e Bug 1352113 - Shippable Builds - Support shippable where 'nightly' is used. r=aki
Makes most kinds that reference nightly attribute reference the shippable attribute.
Also makes most transforms that use nightly use shippable

Transfers dependencies/ownership for some things to shippable from nightly where it was harder to support both.

In no particular order, full list:
Send shippable attribute down to dep tasks.
Set tests as shippable attribute
Add new signing routes
Add shippable routes to repackage_routes transform
Adjust target tasks
Add shippable nightly-l10n
Add nightly-signing and as a side affect add repackage and repackage-signing
Add support for proper balrog platforms for shippable
Add shippable to the nightly sccache guard
Fix TC_PLATFORM_PER_FTP in partners.py to use shippable
Add shippable to mozharness_test variants
Only actually used for android which doesn't have shippable at this time.
Add shippable variant to beetmover transforms
Do nightly signing for mars on shippable
Support shippable in partner-repack transform
Support shippable in amo langpacks transform
Use proper signing for shippable tasks in repackage transforms
Set upload symbols to use shippable too
Use shippable as deps for geckodriver extraction
Use shippable as dep for autograph-stage signing
Do not run beetmover-l10n for shippable
Run shippable style jobs for repackage signing
Set build_platform for update verify and uvc to be shippable
Run repackage-msi for shippable
Add shippable to osx partner repack signing
add shippable to emefree repackage
add shippable to emefree repackage signing
add shippable to beetmover checksums
Add shippable to partner repack repackage signing
add partner repack beetmover
Add shippable to mar signing
Add shippable to mar-signing-l10n
add shippable to eme free beetmover checksums
Add shippable to upload-generated-sources
Add beetmover langpacks to shippable
Add repackage-l10n to shippable
Add shippable to partner repack chunk-dummy
Do eme free builds with shippable
Add signing of language packs to shippable
Add snap repackage for shippable
Add shippable for release-eme-free repack signing
Add partials for shippable
Add partner repack repackage for shippable
Add emefree beetmover for shippable
Add checksums-signing to shippable
Switch partner repacks to shippable
Add shippable to beetmover-repackage
Add secondary update verify configs for shippable
secondary update verify for shippable

Differential Revision: https://phabricator.services.mozilla.com/D24699
2019-03-26 01:37:06 +00:00
Kartikaya Gupta
e59f3849c0 Bug 1538198 - Trigger a bugzilla-components job along with the searchfox indexing jobs. r=emilio
Searchfox relies on the bugzilla component job running on the same push
as the indexing jobs, but there's nothing that actually guarantees that.
Thus far pushes to m-c pretty much always have source changes so the
bugzilla component job gets run, but on beta/release branches it's
possible to get pushes with just tag changes and no source changes, so
the bugzilla component job would get optimized away. This patch ensures
that the job gets run along with the other indexing jobs that searchfox
needs.

Differential Revision: https://phabricator.services.mozilla.com/D24507
2019-03-22 14:53:01 +00:00
Dustin J. Mitchell
3b1bd056ef Bug 1534283 - filter out tasks when DONT-BUILD is in the message r=aki,tomprince
(without the dash, because I want *this* push to build)

This filters out all tasks, but that means that several things will still run:

 * docker images and tasks they depend on (debian packages)
 * always_run tasks (various python-y things)

Differential Revision: https://phabricator.services.mozilla.com/D23020
2019-03-14 21:31:09 +00:00
Gregory Mierzwinski
3622b0e963 Bug 1476372 - Add fetch tasks for raptor chromium builds. r=rwood,glandium,tomprince
Differential Revision: https://phabricator.services.mozilla.com/D21372
2019-03-06 19:45:34 +00:00
Brindusan Cristian
b777bddce2 Backed out 5 changesets (bug 1508976, bug 1522581) for android geckoview bustages at /usr/bin/python2.7. CLOSED TREE
Backed out changeset 7a6be593b0be (bug 1522581)
Backed out changeset c47b37ac1775 (bug 1522581)
Backed out changeset 91c31d2a7706 (bug 1508976)
Backed out changeset da57df805c56 (bug 1508976)
Backed out changeset 4e5d97c93515 (bug 1508976)
2019-03-05 22:42:15 +02:00
Nick Alexander
4e91a5350a Bug 1522581 - Publish GeckoView multi-architecture fat AAR Nightly. r=jlorenzo
Differential Revision: https://phabricator.services.mozilla.com/D15774
2019-03-05 17:52:15 +00:00
Bastien Abadie
4e74ebdb2c Bug 1527895 - Add code-review-issues task in CI, r=dustin,marco,tomprince
Differential Revision: https://phabricator.services.mozilla.com/D21348
2019-03-04 19:40:11 +00:00
Dorel Luca
22083fd99a Backed out changeset 7fdcccd878ad (bug 1527895) for Gecko Decision Task failure. CLOSED TREE 2019-03-04 19:40:12 +02:00
Bastien Abadie
2bed41b711 Bug 1527895 - Add code-review-issues task in CI, r=dustin,marco,tomprince
Differential Revision: https://phabricator.services.mozilla.com/D21348
2019-03-04 16:23:16 +00:00
Kartikaya Gupta
ad13b3a250 Bug 1500941 - Enable Android searchfox job as part of the daily cron. r=emilio
Depends on D20767

Differential Revision: https://phabricator.services.mozilla.com/D20768
2019-02-22 06:24:45 +00:00
Rob Lemley
977289c518 Bug 1489405 - Followup: Allow for thunderbird as shipping_product. r=tomprince
Changes to the desktop_nightly filter chain selected only tasks with no
shipping_product attribute set or tasks where it is  set to "firefox".

This led to the decision task optimizer removing a large portion of the tasks
that run as part of Thunderbird's nightly builds.

This update adds "thunderbird" to the list of shipping_product's whose tasks
are kept in the task graph.

Differential Revision: https://phabricator.services.mozilla.com/D18872
2019-02-06 21:01:05 +00:00
Tom Prince
e9a48422e9 Bug 1489405: Run bouncer-locations job after beetmover has run; r=mtabara
The `asan-reporter` builds have shipping-product set on mozilla-central, so
that they get pulled in by the as dependencies of `post-beetmover-dummy`.

Differential Revision: https://phabricator.services.mozilla.com/D16580
2019-02-04 23:03:18 +00:00
Tom Prince
2fb6603252 Bug 1522380: [win64-aarch64] Run win64-aarch64 nightly build on-push on release branches; r=me 2019-01-30 21:11:41 -07:00
Justin Wood
7b54717736 Bug 1523256 - Fix cedar by not using an outdated target tasks on it, and instead use the default target. r=tomprince
The language pack job specifically was failing becuase of trunk versioning attempting to submit to AMO, while it
should not have even run on central, especially not in an on-push job. Additionally this stops other related jobs
like devedition and beetmover from running for cedar.

Differential Revision: https://phabricator.services.mozilla.com/D17821
2019-01-28 20:07:41 +00:00
David Major
bfbe4889e6 Bug 1512822 - Remove "MSVC" from the name of AArch64 builds r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D17024
2019-01-24 15:02:06 +00:00
Tom Prince
33453b7613 Bug 1515649: [taskgraph] Disable asan-reporter-nigthly via run-on-projects; r=dustin
Now that the upload-* kinds inherit `run-on-projects`, we don't need to special
case handling of them in target-tasks.

Differential Revision: https://phabricator.services.mozilla.com/D15153
2018-12-22 16:55:28 +00:00
Gregory Mierzwinski
d8c607a522 Bug 1514087 - Rebuild custom d8 on a regular basis. r=jmaher
This patch adds a cron task to regularly schedule an update to the custom d8/v8 version in use in jsshell benchmarks.

Differential Revision: https://phabricator.services.mozilla.com/D15256
2018-12-22 19:55:10 +00:00
Tom Prince
8736f4d5de Bug 1514407 [win64-aarch64] Add a win64-aarch64 nightly cron target; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D14660
2018-12-17 21:17:39 +00:00
Aki Sasaki
81b020e7ba Bug 1501878 - required_signoffs attribute. r=tomprince
If a task has `required_signoffs` that match a release's `required_signoffs`, we should defer running that task until we have a matching `signoff_url`.

- add filter_out_missing_signoffs
- add transforms changes to inherit upstream `required_signoffs`
- add `mar-signing` `required_signoffs` to the `partials-signing`, `mar-signing`, and `mar-signing-l10n` kinds

Differential Revision: https://phabricator.services.mozilla.com/D11734
2018-11-20 21:26:18 +00:00
Andreea Pavel
b6d1437ae8 Backed out 7 changesets (bug 1501878) for breaking win partial generation nightlies a=backout
Backed out changeset 00f109437e82 (bug 1501878)
Backed out changeset f1843fdd4c0f (bug 1501878)
Backed out changeset af0ea80f7b08 (bug 1501878)
Backed out changeset 01311f87d287 (bug 1501878)
Backed out changeset 4e2dc6c23463 (bug 1501878)
Backed out changeset 050c4bba5d71 (bug 1501878)
Backed out changeset 9198c5a03b59 (bug 1501878)
2018-11-17 18:37:39 +02:00
Tom Prince
f972cf31a9 No bug: [try-staging] Rename beta-sim to release-sim to reflect flexibility; r=aryx
Now that `mach try release` also supports simulating release and esr, rename
the option to `release-sim`.

Differential Revision: https://phabricator.services.mozilla.com/D11516
2018-11-10 00:50:27 +00:00
Aki Sasaki
7d396d6d0f Bug 1501878 - required_signoffs attribute. r=tomprince
If a task has `required_signoffs` that match a release's `required_signoffs`, we should defer running that task until we have a matching `signoff_url`.

- add filter_out_missing_signoffs
- add transforms changes to inherit upstream `required_signoffs`
- add `mar-signing` `required_signoffs` to the `partials-signing`, `mar-signing`, and `mar-signing-l10n` kinds

Differential Revision: https://phabricator.services.mozilla.com/D11734
2018-11-16 21:04:01 +00:00
Tom Prince
e41d07a353 No bug: [try-staging] Filter out appropriate tasks for staging release on non-beta branches; r=nthomas
We should:
- filter out android builds on esr branches
- filter out devedition builds on non-beta branches
- look at the branch corresponding to the release type in beta-sims for
  evaluating `run-on-projects`.

Differential Revision: https://phabricator.services.mozilla.com/D11392
2018-11-09 19:42:38 +00:00
Kartikaya Gupta
f9f5f68d46 Bug 1418415 - Build the daily searchfox index on Windows as well. r=emilio
Also turn on saving of rust analysis for the windows searchfox job.

Depends on D10355

Differential Revision: https://phabricator.services.mozilla.com/D10356
2018-10-31 19:34:10 +00:00
Johan Lorenzo
11665b9d0a Bug 1500897 - geckoview: only spin beetmover tasks on GECKOVIEW_XX_RELBRANCH r=dustin,tomprince
geckoview: only spin beetmover tasks on GECKOVIEW_XX_RELBRANCH

Differential Revision: https://phabricator.services.mozilla.com/D9551
2018-10-29 11:11:46 +00:00
Narcis Beleuzu
86c5949e5a Backed out changeset deb0260b33c1 (bug 1500897) for taskgraph test failure 2018-10-29 12:18:13 +02:00
Johan Lorenzo
5e801b0e4b Bug 1500897 - geckoview: only spin beetmover tasks on GECKOVIEW_XX_RELBRANCH r=dustin,tomprince
geckoview: only spin beetmover tasks on GECKOVIEW_XX_RELBRANCH

Differential Revision: https://phabricator.services.mozilla.com/D9551
2018-10-26 16:36:49 +00:00
Tom Prince
7bd5dec3f4 Bug 1501759: [taskgraph] Add a beta-sim target; r=aki,RyanVM
Differential Revision: https://phabricator.services.mozilla.com/D9690
2018-10-24 20:44:11 +00:00
Tom Prince
1e4a85fb04 Bug 1501759: [taskgraph] Simplify release branch on-push target tasks; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D9688
2018-10-24 20:43:58 +00:00
Tom Prince
c276089ced Bug 1501759: [taskgraph] Remove include_nightly parameter; r=aki
We only use `include_nigthly` where we are also using
`filter_beta_release_tasks`, so just change the later to include nightly.

Differential Revision: https://phabricator.services.mozilla.com/D9687
2018-10-24 20:44:03 +00:00
Tom Prince
60f6916620 Bug 1492639: Only run cron bouncer checks on mozilla-beta; r=sfraser,mtabara
Differential Revision: https://phabricator.services.mozilla.com/D9137
2018-10-18 13:21:36 -06:00
Mike Hommey
a0a6ef70a3 Bug 1486554 - Enable static analysis on normal Windows CI builds r=ted
And turn off separate static analysis build tasks.

Differential Revision: https://phabricator.services.mozilla.com/D8810
2018-10-17 22:45:06 +00:00
Tom Prince
28abb1576b Bug 1497575: [staging-release] Add a target task's method that includes all release builds; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D8623
2018-10-17 17:14:58 +00:00
Tom Prince
6b281ee659 Bug 1498019: [release] Don't include on-push jobs in promote graph targets; r=aki
All the required on-push jobs will be pulled into the graph as dependencies.
The effect of this is to remove the upload symbols and generated sources tasks
from the release promotion graphs.

Differential Revision: https://phabricator.services.mozilla.com/D8306
2018-10-10 23:03:51 +00:00
Tom Prince
5600a4dc5f Bug 1498019: [release] Build fennec on-push, on release branches; r=aki
These were originally built in the promotion phase because they are multi-l10n
builds and the L10n information wasn't stored in-tree. Now that the information
is in-tree, there is no reason to delay building them.

Differential Revision: https://phabricator.services.mozilla.com/D8305
2018-10-10 22:09:50 +00:00
Chris AtLee
e3453fae45 Bug 1409739 - Part 2: Remove old DMD configs r=glandium
MozReview-Commit-ID: H7kc33CXIbQ
2017-10-17 11:26:04 -04:00
Cosmin Sabou
27c9274b42 Backed out 3 changesets (bug 1409739) for causing Linux x64 ccov & fuzzing bustages. a=backout
Backed out changeset 387f946c7c48 (bug 1409739)
Backed out changeset 617288a6b2d9 (bug 1409739)
Backed out changeset fcdc1d5eaf1a (bug 1409739)
2018-10-03 20:29:42 +03:00
Chris AtLee
74c145bc6f Bug 1409739 - Part 2: Remove old DMD configs r=glandium
MozReview-Commit-ID: H7kc33CXIbQ
2017-10-17 11:26:04 -04:00
Coroiu Cristina
4ee6d0ac9e Backed out 3 changesets (bug 1409739) for xpcshell failures at memory/replace/dmd/test/test_dmd.js
Backed out changeset dc3c5143ba4e (bug 1409739)
Backed out changeset e37ea5eb932a (bug 1409739)
Backed out changeset d39c2dfcc700 (bug 1409739)
2018-10-03 02:07:19 +03:00