Commit Graph

1644 Commits

Author SHA1 Message Date
Iulian Moraru
4f07ff3911 Backed out 2 changesets (bug 1906365, bug 1893181) for causing mass android-all build bustages. CLOSED TREE
Backed out changeset 71eaffe86901 (bug 1893181)
Backed out changeset 0ecbe936878e (bug 1906365)
2024-08-15 19:58:27 +03:00
Nicolas Guichard
8aa18297f1 Bug 1906365 - Configure the Glean Gradle Plugin to use our vendored glean_parser. r=nalexander,geckoview-reviewers,android-reviewers,owlish
The Glean Gradle plugin now exposes ext.gleanPythonEnvDir for users to
point to an existing Python virtualenv where glean_parser is available.

As documented in https://mozilla.github.io/glean/book/language-bindings/android/android-build-configuration-options.html,
the Glean Gradle plugin options such as ext.gleanPythonEnvDir must be
set before applying the plugin.

This enables us to use gradle offline for Android builds (except the
android-gradle-dependencies task of course).

Differential Revision: https://phabricator.services.mozilla.com/D215795
2024-08-15 12:31:39 +00:00
Jesse Schwartzentruber
286319c110 Bug 1909564 - Update AFL++ to support LLVM 20 r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D219156
2024-08-15 08:16:31 +00:00
KS
92b974e778 Bug 1858740 - Use ARM builder for Mac CaR builds. r=perftest-reviewers,taskgraph-reviewers,ahal,sparky
This patch switches the builder from the intel osx 10.15 builders to the
Apple Silicon builders. 10.15 Is no longer a supported build target for
CaR (Chromium-as-Release) so let's use this opportunity to just go to the latest version
builders we have.

Additionally, this patch removes the custom CaR osx 10.15 tasks as that
is no longer a supported platform for the application.

Differential Revision: https://phabricator.services.mozilla.com/D218368
2024-08-05 17:04:15 +00:00
Gabriel Bustamante
aa44fc75b9 Bug 1884254 - Update build-cpython.sh to fill in architecture dynamically for library copying r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D216630
2024-07-30 16:49:32 +00:00
Julien Cristau
bb9fe6a7c6 Bug 1796139 - use fetch-content script from taskgraph. r=taskgraph-reviewers,gabriel
Differential Revision: https://phabricator.services.mozilla.com/D217296
2024-07-23 07:08:11 +00:00
Julien Cristau
9a434d9d43 Bug 1906899 - remove unused resource-monitor code. r=taskgraph-reviewers,bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D216058
2024-07-17 08:57:42 +00:00
Mike Hommey
081ce9ed53 Bug 1907235 - Update wasi-libc build-time check for latest LLVM trunk. r=firefox-build-system-reviewers,sergesanspaille
Submitted upstream at https://github.com/WebAssembly/wasi-libc/pull/512

Differential Revision: https://phabricator.services.mozilla.com/D216243
2024-07-11 19:21:48 +00:00
Mike Hommey
29b026c4ef Bug 1906219 - Upgrade mozmake to 4.4.1. r=firefox-build-system-reviewers,nalexander
Differential Revision: https://phabricator.services.mozilla.com/D215715
2024-07-04 04:32:17 +00:00
Stanca Serban
cd19b5ef76 Backed out changeset 23a9f6555c7c (bug 1905251) as requested by dev because the upstream issue was fixed. CLOSED TREE 2024-07-03 07:54:17 +03:00
Jesse Schwartzentruber
01ac745c8c Bug 1894859 - Update AFL++ toolchain. r=decoder
Differential Revision: https://phabricator.services.mozilla.com/D215270
2024-07-02 20:08:46 +00:00
Mike Hommey
e36caeea97 Bug 1905251 - Build wasi-sdk with -mno-reference-types. r=firefox-build-system-reviewers,sergesanspaille
Clang trunk recently enabled reference types by default on wasm targets,
which for some reason breaks linking wasm. While the core problem is being
investigated, disable reference types.

Differential Revision: https://phabricator.services.mozilla.com/D215177
2024-06-28 19:41:30 +00:00
Mike Hommey
a290a45515 Bug 1903502 - Use in-tree robustcheckout.py in tasks running on generic-worker. r=releng-reviewers,sheehan,taskgraph-reviewers,jcristau
The robustcheckout.py that is in-tree ends up in docker images, used by
tasks running on docker-worker, but for tasks running on generic-worker,
we currently rely on whatever version of robustcheckout.py is there.
It currently seems out of date, but whenever we make changes to the
in-tree version, we don't end up with the fix on these jobs without some
additional manual work.

With this change, we do the same as with run-task and fetch-content: we
pull the in-tree version that we store as an artifact of the decision
task.

Differential Revision: https://phabricator.services.mozilla.com/D214234
2024-06-25 00:27:58 +00:00
Sandor Molnar
e016779c4f Backed out changeset 2147e0051e23 (bug 1903502) for causing build bustages. CLOSED TREE 2024-06-25 02:58:29 +03:00
Mike Hommey
3a42014dc3 Bug 1903502 - Use in-tree robustcheckout.py in tasks running on generic-worker. r=releng-reviewers,sheehan,taskgraph-reviewers,jcristau
The robustcheckout.py that is in-tree ends up in docker images, used by
tasks running on docker-worker, but for tasks running on generic-worker,
we currently rely on whatever version of robustcheckout.py is there.
It currently seems out of date, but whenever we make changes to the
in-tree version, we don't end up with the fix on these jobs without some
additional manual work.

With this change, we do the same as with run-task and fetch-content: we
pull the in-tree version that we store as an artifact of the decision
task.

Differential Revision: https://phabricator.services.mozilla.com/D214234
2024-06-24 23:40:38 +00:00
Mike Hommey
1b2ea4b062 Bug 1903956 - Update wasi-libc build-time check for latest LLVM trunk. r=firefox-build-system-reviewers,sergesanspaille
Submitted upstream at https://github.com/WebAssembly/wasi-libc/pull/509.

Differential Revision: https://phabricator.services.mozilla.com/D214492
2024-06-24 21:17:47 +00:00
KS
5c5c230713 Bug 1901936 - Set environment variables for custom-v8 and linux/android CaR builds. r=perftest-reviewers,sparky
Upstream changes have changed the config path of depot_tools to default
to `$HOME/.config`. Instead we also have the option to set
`$XDG_CONFIG_HOME`. At the moment this only affects linux, with
windows/macos slated to have a similar change soon with possibly
different setup.

Differential Revision: https://phabricator.services.mozilla.com/D213438
2024-06-13 15:04:33 +00:00
Mike Hommey
a861bf6d2d Bug 1901913 - Only consider channels starting with beta- or nightly- to be dated. r=firefox-build-system-reviewers,sergesanspaille
Until recently, beta-YYYY-MM-DD dated channels was the only way to get
specific betas, but now it's possible to use x.y.z-beta.n, but
repack_rust.py doesn't handle that string as a version.

By considering only channels starting with beta- or nightly to be dated,
we allow x.y.z-beta.n to be considered as a version.

Differential Revision: https://phabricator.services.mozilla.com/D213367
2024-06-12 08:28:12 +00:00
Greg Mierzwinski
41c761b2da Bug 1898229 - Add a toolchain for xmlstarlet tool. r=perftest-reviewers,kshampur
This patch adds new fetch, and toolchain tasks for the xmlstarlet tool that will be used for Android performance tests.

Differential Revision: https://phabricator.services.mozilla.com/D212629
2024-06-10 11:57:58 +00:00
KS
ca67c37e45 Bug 1900408 - Use CfT chromedriver for CaR tests. r=perftest-reviewers,taskgraph-reviewers,sparky,bhearsum
This patch replaces the chromedrivers retrieved from the chromium
snapshots with the Chrome for Testing (CfT) chromedrivers (through the
"Canary" channel) for our Chromium-as-Release tests.

There is an occasional intermittent issue that occurs where the
chromedriver from the snapshots don't always work. Instead we can use
the `last-known-good-versions-with-downloads.json` provided by CfT to
get guaranteed stable chromedrivers.

Differential Revision: https://phabricator.services.mozilla.com/D212707
2024-06-06 21:13:00 +00:00
Mike Hommey
be4feb9297 Bug 1900505 - Work around cmake issue with exporting symbols on Windows. r=firefox-build-system-reviewers,ahochheiden
Differential Revision: https://phabricator.services.mozilla.com/D212766
2024-06-06 19:44:59 +00:00
Mike Hommey
4272e10acf Bug 1900489 - Remove dist.missing-tools option from config.toml when building rust compiler. r=firefox-build-system-reviewers,sergesanspaille
Building rustfmt would fail regularly, so the option was added to ignore
the problem, but that presumably hasn't been the case in a while.

The option was removed in rustc 1.80.

Differential Revision: https://phabricator.services.mozilla.com/D212491
2024-06-05 22:37:09 +00:00
Mike Hommey
0c4db223e8 Bug 1337955 - Switch the toolchains project branch to nightly rust compiler. r=firefox-build-system-reviewers,sergesanspaille
Differential Revision: https://phabricator.services.mozilla.com/D210761
2024-05-30 06:03:28 +00:00
Jackie Johnson
cc1c8aab24 Bug 1896919 - Update Testrail Test Run API for Fenix/Focus Release Notification r=aaronmt
Differential Revision: https://phabricator.services.mozilla.com/D210503
2024-05-15 17:43:48 +00:00
serge-sans-paille
375a76b25c Bug Bug 1896675 - Use LTO for taskcluster-built cpython r=ahochheiden
Differential Revision: https://phabricator.services.mozilla.com/D210328
2024-05-15 07:46:26 +00:00
Jackie Johnson
f3602ac698 Bug 1892510 - Update TestRail APIs for Fenix/Focus TC release-notify-testrail task r=aaronmt
Differential Revision: https://phabricator.services.mozilla.com/D208653
2024-05-13 20:41:46 +00:00
Joel Maher
9be78f11c5 Bug 1896221 - unset MOZHARNESS_TEST_PATHS before calling xsession. r=gbrown DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D210123
2024-05-13 14:36:04 +00:00
Geoff Brown
7ea7089879 Bug 1881513 - Remove android-gradle-python-envs toolchain r=releng-reviewers,jcristau
Move the contents of the gradle-python-envs artifact into gradle-android-dependencies, stop referencing gradle-python-envs, and remove the android-gradle-python-envs toolchain task.

Differential Revision: https://phabricator.services.mozilla.com/D209149
2024-05-02 17:12:29 +00:00
Mike Hommey
2c1965c2e2 Bug 1894392 - Update wasi-libc build-time check for latest LLVM trunk. r=firefox-build-system-reviewers,ahochheiden
Submitted upstream at https://github.com/WebAssembly/wasi-libc/pull/493.

Differential Revision: https://phabricator.services.mozilla.com/D209098
2024-05-01 19:36:19 +00:00
Mike Hommey
29d0c34faf Bug 1893781 - Update wasi-libc build-time check for latest LLVM trunk. r=firefox-build-system-reviewers,sergesanspaille
Submitted upstream at https://github.com/WebAssembly/wasi-libc/pull/492.

Differential Revision: https://phabricator.services.mozilla.com/D208940
2024-04-30 05:58:40 +00:00
Mike Hommey
11bcfeb399 Bug 1893553 - Remove unused broken code from cctools. r=firefox-build-system-reviewers,sergesanspaille,nalexander
The base class doesn't have a clone member function, so the code was
never valid. As it was unused, that didn't cause problems until clang
caught this earlier than instantiation in
https://github.com/llvm/llvm-project/pull/84050

Submitted upstream as https://github.com/tpoechtrager/cctools-port/pull/148

Differential Revision: https://phabricator.services.mozilla.com/D208688
2024-04-29 20:58:11 +00:00
Jesse Schwartzentruber
12516a943b Bug 1892928 - Specify symbol visibility in AFL++ shared memory mode. r=firefox-build-system-reviewers,glandium?
Differential Revision: https://phabricator.services.mozilla.com/D208334
2024-04-25 09:12:47 +00:00
KS
dbfd23bc00 Bug 1890666 - Rework chromedriver fetch script for CaR builds. r=perftest-reviewers,sparky,taskgraph-reviewers,bhearsum
This patch reworks the `fetch-chromium.py` script to only fetch the
chromedriver binary.

Previously because of Bug 1867068 it looks like the chromium fetch tasks
were not run since then and there is a mismatch between the CaR versions
and chromedriver version was causing some failures.

Differential Revision: https://phabricator.services.mozilla.com/D207090
2024-04-22 15:57:30 +00:00
Aaron Train
9c042224c1 Bug 1886531 - Adjust matrix client label for test matrices on Firebase Test Lab r=ajoltan,jajohnson
Differential Revision: https://phabricator.services.mozilla.com/D207440
2024-04-15 20:18:51 +00:00
Geoff Brown
a45e33f4fe Bug 1889364 - Report java crashes from Robo Test crash log r=aaronmt
For "robo"-type ui-tests, when crash logs are found and copied to the task artifacts, parse the crash log to report a treeherder-friendly crash message.

Differential Revision: https://phabricator.services.mozilla.com/D206565
2024-04-05 21:17:06 +00:00
Mike Hommey
19edefac72 Bug 1889251 - Enable warnings as errors when building geckodriver. r=webdriver-reviewers,whimboo
Differential Revision: https://phabricator.services.mozilla.com/D206436
2024-04-03 06:55:16 +00:00
Mike Hommey
a2a2df8b4a Bug 1888321 - Rename .cargo/config.in to .cargo/config.toml.in. r=firefox-build-system-reviewers,webdriver-reviewers,ahochheiden
Cargo 1.79 is emitting a warning when using .cargo/config.
.cargo/config.toml has been supported since cargo 1.39.

Differential Revision: https://phabricator.services.mozilla.com/D205974
2024-04-01 21:26:49 +00:00
Geoff Brown
ca4fd2098f Bug 1886813 - Use well-known path to find version.txt in testrail r=jajohnson
Differential Revision: https://phabricator.services.mozilla.com/D206080
2024-04-01 19:20:54 +00:00
Tooru Fujisawa
9b104317cd Bug 1888648 - Stop the are-we-esmified-yet cron job. r=yulia,taskgraph-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D206104
2024-03-29 16:08:28 +00:00
Iulian Moraru
79c55cef54 Bug 1887728 - fix toolchain build bustages. r=fix CLOSED TREE 2024-03-29 00:46:58 +02:00
Mike Hommey
d7cd8b16e2 Bug 1887728 - Switch builds to macOS 14.4 SDK. r=spohl,firefox-build-system-reviewers,ahochheiden
Differential Revision: https://phabricator.services.mozilla.com/D205627
2024-03-28 21:22:56 +00:00
Greg Mierzwinski
ac10a13af2 Bug 1885880 - Add a toolchain task for talos pdf paint test. r=glandium,kshampur,perftest-reviewers
This patch adds a toolchain task for pdfs to be used in the talos pdfpaint test. This is done with a fetch task for the Mozilla pdf.js repository, and a toolchain task that gathers the pdfs from that repository. The toolchain task also handles downloading additional PDFs from files that contain links to them. The additional shell script is used to run the script that gathers the PDFs and allow us to use the in-tree redo python package.

Differential Revision: https://phabricator.services.mozilla.com/D204903
2024-03-26 17:00:47 +00:00
Aaron Train
6dd292ca43 Bug 1886241 - Copy and expose robo test cloud Storage crash stack artifact for processing r=jajohnson,isabel_rios
Differential Revision: https://phabricator.services.mozilla.com/D205650
2024-03-26 16:34:11 +00:00
Julien Cristau
4fe4ab7649 Bug 1886541 - don't re-download gradle in firefox-android CI tasks. r=releng-reviewers,bhearsum
The android-gradle-dependencies toolchain task already downloads gradle,
so we can reuse it instead of going through the wrapper.

Differential Revision: https://phabricator.services.mozilla.com/D205333
2024-03-26 14:27:27 +00:00
Mike Hommey
04e36eceea Bug 1886927 - Avoid getting hostutils.manifest off hg.mozilla.org. r=jmaher
This introduces a toolchain task that just re-exposes the hostutils from
tooltool, which means adding that task as dependency of the relevant
tests gets it automatically. We can then get the hostutils from
MOZ_FETCHES_DIR directly.

Differential Revision: https://phabricator.services.mozilla.com/D205424
2024-03-22 20:34:15 +00:00
Julien Cristau
6b169c93d4 Bug 1885155 - fetch-content: retry downloads on size or checksum mismatch. r=releng-reviewers,bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D205244
2024-03-21 15:38:03 +00:00
Julien Cristau
c68ecf1620 Bug 1886737 - fetch-content: fix download_to_memory retries. r=releng-reviewers,bhearsum DONTBUILD
Previously we would append data from each download to the previous,
failed one(s).

Differential Revision: https://phabricator.services.mozilla.com/D205315
2024-03-21 12:46:04 +00:00
Jason Kratzer
a94d253724 Bug 1883622: Build the profiler runtime for linux64-ccov-asan-fuzzing builds; r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D204223
2024-03-19 19:52:30 +00:00
Sandor Molnar
52ed551f4b Backed out changeset f983e945bb0d (bug 1883622) for causing toolchain bustages 2024-03-19 18:05:35 +02:00
Jason Kratzer
7f48b6d55c Bug 1883622: Build the profiler runtime for linux64-ccov-asan-fuzzing builds; r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D204223
2024-03-19 14:07:26 +00:00