Commit Graph

1536 Commits

Author SHA1 Message Date
Mike Hommey
41a19b8afe Bug 1868656 - Always build LLVM when building rust. r=firefox-build-system-reviewers,ahochheiden
The LLVM artifacts from rust CI expire after a while, and that happens
soon enough that it causes problems on long living branches, i.e. ESR.
So disable the download from there and always build LLVM locally.

Differential Revision: https://phabricator.services.mozilla.com/D195730
2023-12-07 17:10:06 +00:00
Mike Hommey
d656e1d77a Bug 1867727 - Upgrade linux64-rust-dev toolchain to Debian 12-based image. r=firefox-build-system-reviewers,sergesanspaille
Differential Revision: https://phabricator.services.mozilla.com/D195527
2023-12-06 20:20:14 +00:00
Mike Hommey
60fe72e0c0 Bug 1867872 - Ensure wrench-deps fails when it should. r=taskgraph-reviewers,firefox-build-system-reviewers,jcristau,sergesanspaille
The wrench-deps tasks should trigger when webrender-related Cargo.tomls
are updated, and it should fail when they are updated, but the
corresponding Cargo.lock isn't.

Differential Revision: https://phabricator.services.mozilla.com/D195317
2023-12-05 00:14:16 +00:00
Mike Hommey
3f4a40ba1f Bug 1839752 - Disable -Werror when building upx. r=firefox-build-system-reviewers,ahochheiden
Differential Revision: https://phabricator.services.mozilla.com/D194945
2023-11-30 08:47:32 +00:00
KS
693922dba0 Bug 1846849 - Add fetch for Chromium ARM for apple silicon. r=perftest-reviewers,taskgraph-reviewers,bhearsum,afinder
This patch updates the chromium fetches to now include the ARM builds so
that we can use the appropriate chromedriver for CaR apple silicon
(arm64) builds.

Differential Revision: https://phabricator.services.mozilla.com/D192943
2023-11-28 15:33:42 +00:00
KS
21d317dfa2 Bug 1846849 - Add toolchain for building custom Chromium-as-release for Apple silicon. r=perftest-reviewers,afinder
This patch adds a path to build CaR for Apple Silicon. We can cross
compile an arm64 build from the intel OSX machines. Minimal changes are
needed here as we can make use of the existing OSX build path with a
minor modification to ensure we grab the ARM PGO files.

In the future we can look into using silicon machines instead (Bug 1858740)

Differential Revision: https://phabricator.services.mozilla.com/D192712
2023-11-28 15:33:42 +00:00
KS
c5dbad5283 Bug 1866579 - Log revision for depot_tools and chromium src for CaR builds. r=perftest-reviewers,jrmuizel,aglavic
This patch adds minimal code just to keep track of the revisions used
for CaR builds. This will be helpful when trying to find out commits of
interest.

Additionally, in the past we've encountered changes in depot_tools which
caused breakages, so knowing ahead of time the commit(s) to look for
will be helpful.

Differential Revision: https://phabricator.services.mozilla.com/D194654
2023-11-24 21:51:42 +00:00
ChaseKnowlden
96b153b6e6 Bug 1858889 - [Linux] Remove dbus-glib from docs and CI. r=stransky
Differential Revision: https://phabricator.services.mozilla.com/D192088
2023-10-31 18:34:17 +00:00
Mike Hommey
e23c868598 Bug 1855564 - Switch Firefox builds to macOS 14.0 SDK. r=firefox-build-system-reviewers,sergesanspaille
Differential Revision: https://phabricator.services.mozilla.com/D189889
2023-10-24 00:47:15 +00:00
Jesse Schwartzentruber
3b093bad94 Bug 1860171 - Update AFL++ to current stable r=firefox-build-system-reviewers,sergesanspaille
Differential Revision: https://phabricator.services.mozilla.com/D191487
2023-10-23 21:37:16 +00:00
Kash Shampur
795191b4ec Bug 1848419 - Add a toolchain for building CaR for Android arm64. r=perftest-reviewers,sparky
This patch adds the ability to build custom chromium-as-release (CaR) for the android platform (arm64).
A linux host is used for the android builds so a new dockerfile is added to maintain as either platform (e.g. Linux and Android) may
have differing dependencies and potentially diverge further in the future.
We can look into consolidating them into one dockerfile later if needed.

Differential Revision: https://phabricator.services.mozilla.com/D189604
2023-10-23 13:50:48 +00:00
serge-sans-paille
c058e3ef61 Bug 1834414 - Consistent lzma support for taskcluster Python r=glandium
On OSX, depending on the node used to build python, lzma support was
available or not (depending on local setup). Then it could fail at
runtime if another node was used.

Build xz from source and use it as a build dependency to always provide
lzma on OSX, as we already do on Linux and Windows.

As a side effect, provide more verbose output during the post link
process.

Differential Revision: https://phabricator.services.mozilla.com/D191044
2023-10-19 19:39:38 +00:00
KS
b34070341b Bug 1857474 - Have CaR OSX toolchain use python 3.8. r=sparky,perftest-reviewers,glandium
In some recent changes upstream, a function caching method was added that
uses functionality introduced in python 3.8. Presently the OSX workers
only have 3.7 by default, so this patch fetches the 3.8 toolchain and
makes use of that binary instead.

Differential Revision: https://phabricator.services.mozilla.com/D190388
2023-10-11 00:30:39 +00:00
Mike Hommey
ae48779533 Bug 1839739 - Default to lld in more cases on Linux. r=firefox-build-system-reviewers,geckoview-reviewers,releng-reviewers,andi,gbrown,m_kato
Differential Revision: https://phabricator.services.mozilla.com/D188676
2023-10-05 20:11:07 +00:00
serge-sans-paille
2579f29839 Bug 1854162 - Use taskcluster-built python for webrender task r=glandium,taskgraph-reviewers,ahal
This required a few changes to work under taskcluster's Python instead
of system one. Most dependencies are now explicit through
gfx/wr/ci-scripts/requirements.txt

Differential Revision: https://phabricator.services.mozilla.com/D188736
2023-10-05 06:30:49 +00:00
Stanca Serban
6092855d3d Backed out changeset 46ec6a8d9505 (bug 1854162) for causing wrench bustages. 2023-10-04 09:20:46 +03:00
serge-sans-paille
74c61359e4 Bug 1854162 - Use taskcluster-built python for webrender task r=glandium,taskgraph-reviewers,ahal
This required a few changes to work under taskcluster's Python instead
of system one. Most dependencies are now explicit through
gfx/wr/ci-scripts/requirements.txt

Differential Revision: https://phabricator.services.mozilla.com/D188736
2023-10-04 05:26:24 +00:00
Cosmin Sabou
5648914c46 Backed out 2 changesets (bug 1854047, bug 1839739) for causing build bustages. CLOSED TREE
Backed out changeset 3fb508020251 (bug 1854047)
Backed out changeset 056fe66a8b3f (bug 1839739)
2023-10-04 03:34:26 +03:00
Mike Hommey
3f7084ed48 Bug 1839739 - Default to lld in more cases on Linux. r=firefox-build-system-reviewers,geckoview-reviewers,releng-reviewers,andi,gbrown,m_kato
Differential Revision: https://phabricator.services.mozilla.com/D188676
2023-10-04 00:06:57 +00:00
Mike Hommey
f2fb5ba66f Bug 1856485 - Update wasi-libc build-time check for latest LLVM trunk. r=firefox-build-system-reviewers,sergesanspaille
Submitted upstream at https://github.com/WebAssembly/wasi-libc/pull/438

Differential Revision: https://phabricator.services.mozilla.com/D189873
2023-10-03 22:55:05 +00:00
Mike Hommey
0864c0dd9d Bug 1856517 - Switch toolchain builds to macOS 14.0 SDK. r=firefox-build-system-reviewers,sergesanspaille
Differential Revision: https://phabricator.services.mozilla.com/D189430
2023-10-03 06:56:24 +00:00
Natalia Csoregi
5fa0a49a70 Backed out changeset 5e68dedeeaad (bug 1856517) for causing wrench macOS build bustages. CLOSED TREE 2023-10-03 09:15:25 +03:00
Mike Hommey
f4f1199587 Bug 1856517 - Switch toolchain builds to macOS 14.0 SDK. r=firefox-build-system-reviewers,sergesanspaille
Differential Revision: https://phabricator.services.mozilla.com/D189430
2023-10-03 05:41:10 +00:00
Norisz Fay
f91d9a8d48 Backed out changeset 7290f63f0ea4 (bug 1855564) as requested for causing Bug 1856296 a=backout 2023-10-02 19:46:14 +03:00
Mike Hommey
1d5b1255d8 Bug 1855564 - Switch Firefox builds to macOS 14.0 SDK. r=firefox-build-system-reviewers,sergesanspaille
Differential Revision: https://phabricator.services.mozilla.com/D189430
2023-09-30 20:14:33 +00:00
Narcis Beleuzu
736e3ec02c Backed out 2 changesets (bug 1854047, bug 1839739) for causing bug 1855568. CLOSED TREE
Backed out changeset 2b3b967b6571 (bug 1854047)
Backed out changeset f957fe22f28e (bug 1839739)
2023-09-29 11:13:56 +03:00
KS
96c8aa00cc Bug 1854267 - Update CaR OSX builds to use MacOSX14.0 sdk. r=perftest-reviewers,sparky
Upstream chromium builds now use version 14.0 SDK for OSX builds.
Additionally, bump up the wait time as that has been steadily
increasing, but more so for OSX (bug 1846810 follows up on other
platforms and cron scheduling if needed)

Differential Revision: https://phabricator.services.mozilla.com/D188981
2023-09-26 02:55:00 +00:00
Mike Hommey
77dea0fe41 Bug 1839739 - Default to lld in more cases on Linux. r=firefox-build-system-reviewers,geckoview-reviewers,releng-reviewers,andi,gbrown,m_kato
Differential Revision: https://phabricator.services.mozilla.com/D188676
2023-09-25 22:58:28 +00:00
Mike Hommey
7501264f11 Bug 1854524 - Enable wasm support to the clang 8 toolchain. r=firefox-build-system-reviewers,ahochheiden
Differential Revision: https://phabricator.services.mozilla.com/D188907
2023-09-22 04:39:06 +00:00
Mike Hommey
24cf936987 Bug 1854524 - Allow to pass the patch to apply to wasi-sdk via the command line. r=firefox-build-system-reviewers,ahochheiden
And only apply wasi-sdk.patch when needed.

Differential Revision: https://phabricator.services.mozilla.com/D188906
2023-09-22 04:39:05 +00:00
Mike Hommey
e5aec986ed Bug 1853082 - Don't rely on file extension to guess archive type in fetch-content. r=taskgraph-reviewers,bhearsum
I want to add a fetch for a rust crate archive from crates.io, and those
don't come with an extension in the url, so we can't rely on that.
Content sniffing is easy enough to put in place.

Differential Revision: https://phabricator.services.mozilla.com/D188152
2023-09-19 20:28:57 +00:00
Makoto Kato
aee3e62d45 Bug 1820295 - Increase GeckoView Lite's minimum API level to 21. r=geckoview-reviewers,firefox-build-system-reviewers,nalexander,owlish
Actually, Fenix's minimum is 21 even if 32-bit and  Google Play Service has
discontinued 4.4 support. We would like to increase Lite's minimum API to 21
even if 32-bit.

Differential Revision: https://phabricator.services.mozilla.com/D187861
2023-09-19 01:31:04 +00:00
Noemi Erli
f3ed21e781 Backed out changeset c78b822aff7e (bug 1853082) for causing the absence of Android shipp builds a=backout 2023-09-18 02:13:53 +03:00
Mike Hommey
6d5dcc9e53 Bug 1853082 - Don't rely on file extension to guess archive type in fetch-content. r=taskgraph-reviewers,bhearsum
I want to add a fetch for a rust crate archive from crates.io, and those
don't come with an extension in the url, so we can't rely on that.
Content sniffing is easy enough to put in place.

Differential Revision: https://phabricator.services.mozilla.com/D188152
2023-09-16 19:22:21 +00:00
Mike Hommey
29d2bf086c Bug 1852663 - Enable libgcc-compatible frame apis in mingw libunwind. r=firefox-build-system-reviewers,sergesanspaille
They were recently made opt-in, and are used by rust on i686 mingw.

Differential Revision: https://phabricator.services.mozilla.com/D187962
2023-09-15 19:53:46 +00:00
Sandor Molnar
5c81f2a3d6 Backed out changeset a3a52a852587 (bug 1853082) for causing python related failures. CLOSED TREE 2023-09-15 00:35:47 +03:00
Mike Hommey
3b281224ba Bug 1853082 - Don't rely on file extension to guess archive type in fetch-content. r=taskgraph-reviewers,bhearsum
I want to add a fetch for a rust crate archive from crates.io, and those
don't come with an extension in the url, so we can't rely on that.
Content sniffing is easy enough to put in place.

Differential Revision: https://phabricator.services.mozilla.com/D188152
2023-09-14 20:37:24 +00:00
Logan Rosen
45be05a920 Bug 1786490 - reformat the tree using black 23.3.0 r=sylvestre,webdriver-reviewers,taskgraph-reviewers,whimboo,jmaher,ahal,perftest-reviewers,geckoview-reviewers,afinder,m_kato
# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D186092
2023-09-06 16:14:30 +00:00
serge-sans-paille
1ef9b30501 Bug 1845510 - Compile taskcluster-built python using GCC instead of Clang r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D184572
2023-08-31 08:55:31 +00:00
Ryan VanderMeulen
9f3aba7cf5 Bug 1849470 - Upgrade zlib to 1.3 for NSIS. r=glandium
Depends on D186593

Differential Revision: https://phabricator.services.mozilla.com/D186594
2023-08-23 15:07:23 +00:00
Julien Cristau
ccf02c9fe9 Bug 1849176 - fix run-wizard with python3 r=releng-reviewers,gbrown DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D186469
2023-08-18 09:40:56 +00:00
Mark Banner
ae551e358e Bug 1846747 - Remove SpecialPowers.importInMainProcess as it is unused. r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D185571
2023-08-10 07:32:38 +00:00
KS
f0d7c38333 Bug 1847210 - Run the cipd setup script due to missing files in macOS and Linux CaR builds. r=perftest-reviewers,sparky
Due to some upstream changes, cipd binaries were not properly being
setup and necessary files were missing during the run hooks step (like dirmd).
This is only affecting macOS and Linux, so this patch just directly runs
the setup script before we proceed with the rest of the build sequence.

Differential Revision: https://phabricator.services.mozilla.com/D185497
2023-08-07 14:34:57 +00:00
Jesse Schwartzentruber
b88e92110c Bug 1844617 - Update AFL toolchain to AFL++ stable r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D184755
2023-08-03 01:38:12 +00:00
serge-sans-paille
21f06494a3 Bug 1844631 - Set RPATH on OSX and bundle libssl and libcrypto r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D184131
2023-07-22 14:26:34 +00:00
Mike Hommey
9f04525ef1 Bug 1844243 - Statically link libcrypto to xar. r=firefox-build-system-reviewers,sergesanspaille
When it's not built on the same kind of docker image that runs it,
there's a possibility of incompatibility because of the recent
change in openssl library version. This happens when crossing between
debian 11 and debian 12, for instance.

Differential Revision: https://phabricator.services.mozilla.com/D183944
2023-07-20 20:39:38 +00:00
Masatoshi Kimura
e2cc10b381 Bug 1843708 - Partially revert the removal of d3dcompiler_47.dll. r=firefox-build-system-reviewers,sergesanspaille
MinGW builds use fxc2 that requires d3dcompiler_47.

Differential Revision: https://phabricator.services.mozilla.com/D183634
2023-07-17 07:19:05 +00:00
Masatoshi Kimura
f08cbd047e Bug 1842497 - Unship d3dcompiler_47.dll. r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D183100
2023-07-15 12:29:51 +00:00
Mike Hommey
0706834a45 Bug 1841902 - Patch ld64 to avoid dead-stripping rust compiler_builtins atoms. r=firefox-build-system-reviewers,ahochheiden
Sent upstream at https://github.com/tpoechtrager/cctools-port/pull/135.

Differential Revision: https://phabricator.services.mozilla.com/D182833
2023-07-11 01:54:08 +00:00
Steve Fink
b673cc74b7 Bug 1841130 - Update hazard documentation r=bthrall
Differential Revision: https://phabricator.services.mozilla.com/D182499
2023-07-08 00:06:59 +00:00