Commit Graph

1172 Commits

Author SHA1 Message Date
Iulian Moraru
4f07ff3911 Backed out 2 changesets (bug 1906365, bug 1893181) for causing mass android-all build bustages. CLOSED TREE
Backed out changeset 71eaffe86901 (bug 1893181)
Backed out changeset 0ecbe936878e (bug 1906365)
2024-08-15 19:58:27 +03:00
Nicolas Guichard
8aa18297f1 Bug 1906365 - Configure the Glean Gradle Plugin to use our vendored glean_parser. r=nalexander,geckoview-reviewers,android-reviewers,owlish
The Glean Gradle plugin now exposes ext.gleanPythonEnvDir for users to
point to an existing Python virtualenv where glean_parser is available.

As documented in https://mozilla.github.io/glean/book/language-bindings/android/android-build-configuration-options.html,
the Glean Gradle plugin options such as ext.gleanPythonEnvDir must be
set before applying the plugin.

This enables us to use gradle offline for Android builds (except the
android-gradle-dependencies task of course).

Differential Revision: https://phabricator.services.mozilla.com/D215795
2024-08-15 12:31:39 +00:00
Jesse Schwartzentruber
286319c110 Bug 1909564 - Update AFL++ to support LLVM 20 r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D219156
2024-08-15 08:16:31 +00:00
KS
92b974e778 Bug 1858740 - Use ARM builder for Mac CaR builds. r=perftest-reviewers,taskgraph-reviewers,ahal,sparky
This patch switches the builder from the intel osx 10.15 builders to the
Apple Silicon builders. 10.15 Is no longer a supported build target for
CaR (Chromium-as-Release) so let's use this opportunity to just go to the latest version
builders we have.

Additionally, this patch removes the custom CaR osx 10.15 tasks as that
is no longer a supported platform for the application.

Differential Revision: https://phabricator.services.mozilla.com/D218368
2024-08-05 17:04:15 +00:00
Gabriel Bustamante
aa44fc75b9 Bug 1884254 - Update build-cpython.sh to fill in architecture dynamically for library copying r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D216630
2024-07-30 16:49:32 +00:00
Julien Cristau
bb9fe6a7c6 Bug 1796139 - use fetch-content script from taskgraph. r=taskgraph-reviewers,gabriel
Differential Revision: https://phabricator.services.mozilla.com/D217296
2024-07-23 07:08:11 +00:00
Julien Cristau
9a434d9d43 Bug 1906899 - remove unused resource-monitor code. r=taskgraph-reviewers,bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D216058
2024-07-17 08:57:42 +00:00
Mike Hommey
081ce9ed53 Bug 1907235 - Update wasi-libc build-time check for latest LLVM trunk. r=firefox-build-system-reviewers,sergesanspaille
Submitted upstream at https://github.com/WebAssembly/wasi-libc/pull/512

Differential Revision: https://phabricator.services.mozilla.com/D216243
2024-07-11 19:21:48 +00:00
Mike Hommey
29b026c4ef Bug 1906219 - Upgrade mozmake to 4.4.1. r=firefox-build-system-reviewers,nalexander
Differential Revision: https://phabricator.services.mozilla.com/D215715
2024-07-04 04:32:17 +00:00
Stanca Serban
cd19b5ef76 Backed out changeset 23a9f6555c7c (bug 1905251) as requested by dev because the upstream issue was fixed. CLOSED TREE 2024-07-03 07:54:17 +03:00
Jesse Schwartzentruber
01ac745c8c Bug 1894859 - Update AFL++ toolchain. r=decoder
Differential Revision: https://phabricator.services.mozilla.com/D215270
2024-07-02 20:08:46 +00:00
Mike Hommey
e36caeea97 Bug 1905251 - Build wasi-sdk with -mno-reference-types. r=firefox-build-system-reviewers,sergesanspaille
Clang trunk recently enabled reference types by default on wasm targets,
which for some reason breaks linking wasm. While the core problem is being
investigated, disable reference types.

Differential Revision: https://phabricator.services.mozilla.com/D215177
2024-06-28 19:41:30 +00:00
Mike Hommey
1b2ea4b062 Bug 1903956 - Update wasi-libc build-time check for latest LLVM trunk. r=firefox-build-system-reviewers,sergesanspaille
Submitted upstream at https://github.com/WebAssembly/wasi-libc/pull/509.

Differential Revision: https://phabricator.services.mozilla.com/D214492
2024-06-24 21:17:47 +00:00
KS
5c5c230713 Bug 1901936 - Set environment variables for custom-v8 and linux/android CaR builds. r=perftest-reviewers,sparky
Upstream changes have changed the config path of depot_tools to default
to `$HOME/.config`. Instead we also have the option to set
`$XDG_CONFIG_HOME`. At the moment this only affects linux, with
windows/macos slated to have a similar change soon with possibly
different setup.

Differential Revision: https://phabricator.services.mozilla.com/D213438
2024-06-13 15:04:33 +00:00
Mike Hommey
a861bf6d2d Bug 1901913 - Only consider channels starting with beta- or nightly- to be dated. r=firefox-build-system-reviewers,sergesanspaille
Until recently, beta-YYYY-MM-DD dated channels was the only way to get
specific betas, but now it's possible to use x.y.z-beta.n, but
repack_rust.py doesn't handle that string as a version.

By considering only channels starting with beta- or nightly to be dated,
we allow x.y.z-beta.n to be considered as a version.

Differential Revision: https://phabricator.services.mozilla.com/D213367
2024-06-12 08:28:12 +00:00
Greg Mierzwinski
41c761b2da Bug 1898229 - Add a toolchain for xmlstarlet tool. r=perftest-reviewers,kshampur
This patch adds new fetch, and toolchain tasks for the xmlstarlet tool that will be used for Android performance tests.

Differential Revision: https://phabricator.services.mozilla.com/D212629
2024-06-10 11:57:58 +00:00
KS
ca67c37e45 Bug 1900408 - Use CfT chromedriver for CaR tests. r=perftest-reviewers,taskgraph-reviewers,sparky,bhearsum
This patch replaces the chromedrivers retrieved from the chromium
snapshots with the Chrome for Testing (CfT) chromedrivers (through the
"Canary" channel) for our Chromium-as-Release tests.

There is an occasional intermittent issue that occurs where the
chromedriver from the snapshots don't always work. Instead we can use
the `last-known-good-versions-with-downloads.json` provided by CfT to
get guaranteed stable chromedrivers.

Differential Revision: https://phabricator.services.mozilla.com/D212707
2024-06-06 21:13:00 +00:00
Mike Hommey
be4feb9297 Bug 1900505 - Work around cmake issue with exporting symbols on Windows. r=firefox-build-system-reviewers,ahochheiden
Differential Revision: https://phabricator.services.mozilla.com/D212766
2024-06-06 19:44:59 +00:00
Mike Hommey
4272e10acf Bug 1900489 - Remove dist.missing-tools option from config.toml when building rust compiler. r=firefox-build-system-reviewers,sergesanspaille
Building rustfmt would fail regularly, so the option was added to ignore
the problem, but that presumably hasn't been the case in a while.

The option was removed in rustc 1.80.

Differential Revision: https://phabricator.services.mozilla.com/D212491
2024-06-05 22:37:09 +00:00
Mike Hommey
0c4db223e8 Bug 1337955 - Switch the toolchains project branch to nightly rust compiler. r=firefox-build-system-reviewers,sergesanspaille
Differential Revision: https://phabricator.services.mozilla.com/D210761
2024-05-30 06:03:28 +00:00
serge-sans-paille
375a76b25c Bug Bug 1896675 - Use LTO for taskcluster-built cpython r=ahochheiden
Differential Revision: https://phabricator.services.mozilla.com/D210328
2024-05-15 07:46:26 +00:00
Geoff Brown
7ea7089879 Bug 1881513 - Remove android-gradle-python-envs toolchain r=releng-reviewers,jcristau
Move the contents of the gradle-python-envs artifact into gradle-android-dependencies, stop referencing gradle-python-envs, and remove the android-gradle-python-envs toolchain task.

Differential Revision: https://phabricator.services.mozilla.com/D209149
2024-05-02 17:12:29 +00:00
Mike Hommey
2c1965c2e2 Bug 1894392 - Update wasi-libc build-time check for latest LLVM trunk. r=firefox-build-system-reviewers,ahochheiden
Submitted upstream at https://github.com/WebAssembly/wasi-libc/pull/493.

Differential Revision: https://phabricator.services.mozilla.com/D209098
2024-05-01 19:36:19 +00:00
Mike Hommey
29d0c34faf Bug 1893781 - Update wasi-libc build-time check for latest LLVM trunk. r=firefox-build-system-reviewers,sergesanspaille
Submitted upstream at https://github.com/WebAssembly/wasi-libc/pull/492.

Differential Revision: https://phabricator.services.mozilla.com/D208940
2024-04-30 05:58:40 +00:00
Mike Hommey
11bcfeb399 Bug 1893553 - Remove unused broken code from cctools. r=firefox-build-system-reviewers,sergesanspaille,nalexander
The base class doesn't have a clone member function, so the code was
never valid. As it was unused, that didn't cause problems until clang
caught this earlier than instantiation in
https://github.com/llvm/llvm-project/pull/84050

Submitted upstream as https://github.com/tpoechtrager/cctools-port/pull/148

Differential Revision: https://phabricator.services.mozilla.com/D208688
2024-04-29 20:58:11 +00:00
Jesse Schwartzentruber
12516a943b Bug 1892928 - Specify symbol visibility in AFL++ shared memory mode. r=firefox-build-system-reviewers,glandium?
Differential Revision: https://phabricator.services.mozilla.com/D208334
2024-04-25 09:12:47 +00:00
KS
dbfd23bc00 Bug 1890666 - Rework chromedriver fetch script for CaR builds. r=perftest-reviewers,sparky,taskgraph-reviewers,bhearsum
This patch reworks the `fetch-chromium.py` script to only fetch the
chromedriver binary.

Previously because of Bug 1867068 it looks like the chromium fetch tasks
were not run since then and there is a mismatch between the CaR versions
and chromedriver version was causing some failures.

Differential Revision: https://phabricator.services.mozilla.com/D207090
2024-04-22 15:57:30 +00:00
Mike Hommey
19edefac72 Bug 1889251 - Enable warnings as errors when building geckodriver. r=webdriver-reviewers,whimboo
Differential Revision: https://phabricator.services.mozilla.com/D206436
2024-04-03 06:55:16 +00:00
Mike Hommey
a2a2df8b4a Bug 1888321 - Rename .cargo/config.in to .cargo/config.toml.in. r=firefox-build-system-reviewers,webdriver-reviewers,ahochheiden
Cargo 1.79 is emitting a warning when using .cargo/config.
.cargo/config.toml has been supported since cargo 1.39.

Differential Revision: https://phabricator.services.mozilla.com/D205974
2024-04-01 21:26:49 +00:00
Tooru Fujisawa
9b104317cd Bug 1888648 - Stop the are-we-esmified-yet cron job. r=yulia,taskgraph-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D206104
2024-03-29 16:08:28 +00:00
Iulian Moraru
79c55cef54 Bug 1887728 - fix toolchain build bustages. r=fix CLOSED TREE 2024-03-29 00:46:58 +02:00
Mike Hommey
d7cd8b16e2 Bug 1887728 - Switch builds to macOS 14.4 SDK. r=spohl,firefox-build-system-reviewers,ahochheiden
Differential Revision: https://phabricator.services.mozilla.com/D205627
2024-03-28 21:22:56 +00:00
Greg Mierzwinski
ac10a13af2 Bug 1885880 - Add a toolchain task for talos pdf paint test. r=glandium,kshampur,perftest-reviewers
This patch adds a toolchain task for pdfs to be used in the talos pdfpaint test. This is done with a fetch task for the Mozilla pdf.js repository, and a toolchain task that gathers the pdfs from that repository. The toolchain task also handles downloading additional PDFs from files that contain links to them. The additional shell script is used to run the script that gathers the PDFs and allow us to use the in-tree redo python package.

Differential Revision: https://phabricator.services.mozilla.com/D204903
2024-03-26 17:00:47 +00:00
Mike Hommey
04e36eceea Bug 1886927 - Avoid getting hostutils.manifest off hg.mozilla.org. r=jmaher
This introduces a toolchain task that just re-exposes the hostutils from
tooltool, which means adding that task as dependency of the relevant
tests gets it automatically. We can then get the hostutils from
MOZ_FETCHES_DIR directly.

Differential Revision: https://phabricator.services.mozilla.com/D205424
2024-03-22 20:34:15 +00:00
Julien Cristau
6b169c93d4 Bug 1885155 - fetch-content: retry downloads on size or checksum mismatch. r=releng-reviewers,bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D205244
2024-03-21 15:38:03 +00:00
Julien Cristau
c68ecf1620 Bug 1886737 - fetch-content: fix download_to_memory retries. r=releng-reviewers,bhearsum DONTBUILD
Previously we would append data from each download to the previous,
failed one(s).

Differential Revision: https://phabricator.services.mozilla.com/D205315
2024-03-21 12:46:04 +00:00
Jason Kratzer
a94d253724 Bug 1883622: Build the profiler runtime for linux64-ccov-asan-fuzzing builds; r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D204223
2024-03-19 19:52:30 +00:00
Sandor Molnar
52ed551f4b Backed out changeset f983e945bb0d (bug 1883622) for causing toolchain bustages 2024-03-19 18:05:35 +02:00
Jason Kratzer
7f48b6d55c Bug 1883622: Build the profiler runtime for linux64-ccov-asan-fuzzing builds; r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D204223
2024-03-19 14:07:26 +00:00
Julien Cristau
7987c0763f Bug 1824856 - add firefox-android tasks to a-g-d to cache more required dependencies. r=geckoview-reviewers,nalexander
- add some firefox-android builds/tests, it seems some dependencies are
  conditionally downloaded based on which tasks run, so the
  downloadDependencies task isn't enough
- enable coverage for A-C, as the jacoco plugin is conditionally enabled (and
  thus downloaded) based on that property
- bump max run time to account for the extra work making us go over 30 minutes

Differential Revision: https://phabricator.services.mozilla.com/D201541
2024-01-30 19:22:34 +01:00
Julien Cristau
fc6e13c69e Bug 1876338 - use android-gradle-dependencies instead of external-gradle-dependencies. r=glandium,firefox-build-system-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D201502
2024-01-09 16:57:08 +01:00
Julien Cristau
42cd168aa9 Bug 1824856 - add android-gradle-python-envs toolchain task. r=ahochheiden,amejiamarmol,geckoview-reviewers,firefox-build-system-reviewers
Because of https://github.com/gradle/plugin-portal-requests/issues/164,
this plugin is not being downloaded by our nexus2 proxy.  Work around
that issue by downloading the plugin explicitly in a separate toolchain
task.

Differential Revision: https://phabricator.services.mozilla.com/D201500
2024-01-09 14:50:20 +01:00
Julien Cristau
3865004a90 Bug 1824856 - update external-gradle-dependencies scripts for new paths. r=bhearsum,releng-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D201421
2023-07-13 11:56:45 +02:00
Mike Hommey
c50bf35b2c Bug 1884838 - Support getting LLVM version from its new location. r=firefox-build-system-reviewers,ahochheiden
Patch sent upstream: https://github.com/WebAssembly/wasi-sdk/pull/399

Differential Revision: https://phabricator.services.mozilla.com/D204328
2024-03-12 22:08:41 +00:00
Julien Cristau
21ee43b9a6 Bug 1884685 - validate fetches against their content-length. r=releng-reviewers,gbrown
Even if we don't know the file size or hash up-front, we can do minimal
validation against the server's content-length to protect against truncated
downloads, and avoid extracting bad data.

Differential Revision: https://phabricator.services.mozilla.com/D204244
2024-03-12 13:24:23 +00:00
Mark Banner
a8b26230bb Bug 1884496 - Remove do_importModule. r=arai
Differential Revision: https://phabricator.services.mozilla.com/D204140
2024-03-11 11:31:31 +00:00
Jesse Schwartzentruber
1ad8fed106 Bug 1883136 - Fix AFL++ coverage collection r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D203323
2024-03-05 15:34:18 +00:00
Mike Hommey
7dfde03105 Bug 1882441 - Add a toolchain artifact for a static libxml2 for Windows. r=firefox-build-system-reviewers,ahochheiden
Differential Revision: https://phabricator.services.mozilla.com/D202901
2024-02-29 22:53:01 +00:00
Mike Hommey
60bc6b015b Bug 1881381 - Switch build to VS 2022. r=firefox-build-system-reviewers,sergesanspaille
Differential Revision: https://phabricator.services.mozilla.com/D202364
2024-02-29 22:24:57 +00:00
Stanca Serban
24e7571a0e Backed out changeset ab08a1a8a9c4 (bug 1881381) as requested by glandium for breaking developer builds. a=backout 2024-02-29 02:15:47 +02:00