Commit Graph

1309 Commits

Author SHA1 Message Date
Alexandre Lissy
689b39811f Bug 1839317 - Add Firefox Snap build of all branches using upstream toolings r=releng-reviewers,taskgraph-reviewers,jcristau
Differential Revision: https://phabricator.services.mozilla.com/D181502
2023-07-17 15:13:11 +00:00
Mike Hommey
812855979e Bug 1839788 - Switch valgrind task to a Debian 12 based docker image. r=firefox-build-system-reviewers,releng-reviewers,ahochheiden,jcristau
Differential Revision: https://phabricator.services.mozilla.com/D181721
2023-06-27 08:47:17 +00:00
ahochheiden
0fd6340f4c Bug 1838763 - Run the clone of version-control-tools in the push-to-try Dockerfile as worker r=firefox-build-system-reviewers,glandium
If this is not done, the state dir (`.mozbuild`) is owned by root. With
the upcoming changes to moving the python site venvs to the state dir,
this would prevent the mach process from writing to the state dir, and
causing the python virtualenvs to not be successfully created.

Differential Revision: https://phabricator.services.mozilla.com/D181910
2023-06-27 07:05:19 +00:00
Butkovits Atila
2f55c9071b Backed out changeset 0721a2ab9241 (bug 1839788) for causing bustages at libssl.so. 2023-06-27 02:27:07 +03:00
Mike Hommey
c87b830a2b Bug 1839788 - Switch valgrind task to a Debian 12 based docker image. r=firefox-build-system-reviewers,releng-reviewers,ahochheiden,jcristau
Differential Revision: https://phabricator.services.mozilla.com/D181721
2023-06-26 22:00:46 +00:00
Mike Hommey
10df123e3f Bug 1839658 - Introduce a hack to reduce the use of snapshot.debian.org. r=jcristau
snapshot.debian.org is causing us some grief by being extremely slow
(there are also more rare occasions of it returning e.g. 404s for files
that do exist, but those are less common).

The reason we use snapshot.debian.org rather than deb.debian.org is for
reproducibility of the docker images. But, in practical terms, most of
the packages we do pull from snapshot.debian.org are on deb.debian.org
because they haven't received updates between the snapshot date and now.

So we interpose the HTTP method from APT, such that when it requests
an URL on snapshot.debian.org, we check whether the equivalent URL
exists on deb.debian.org and make it use that instead.

The downside is that we do need to pull python first before being able
to use the script, since it's not in the base docker image.

There are a few alternatives I've considered:
- A shell script, but that's more fragile, requires curl or wget, which
  is not available either.
- A perl script, as perl is available in the base image, but pulling the
  required libraries is as much data as pulling python, spread across
  more packages, which unfortunately tends to make it slower to
  download.
- A custom proxy server, but that felt like more work, and would still
  require the same amount of extra packages.

I've kept the hack simple, not looking too deep in the internal protocol
used by APT to talk to its HTTP method.

We may want to dig deeper in the future, though, if the 404s get too
problematic.

Differential Revision: https://phabricator.services.mozilla.com/D181830
2023-06-26 20:02:49 +00:00
Mike Hommey
65f58582ae Bug 1839808 - Remove any extra APT sources from the Debian based docker images. r=jcristau
Differential Revision: https://phabricator.services.mozilla.com/D181733
2023-06-26 20:02:49 +00:00
Noemi Erli
a0e0eb0c43 Backed out changeset 842b3544af12 (bug 1839808) as requested by glandium CLOSED TREE 2023-06-22 14:08:01 +03:00
Mike Hommey
5ccb46db2c Bug 1839808 - Remove any extra APT sources from the Debian based docker images. r=jcristau
Differential Revision: https://phabricator.services.mozilla.com/D181733
2023-06-22 09:50:18 +00:00
serge-sans-paille
9d59eb649e Bug 1829297 - Use an ubuntu 18.04 image to build Python interpreter r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D176249
2023-06-14 06:48:21 +00:00
Alexandre Lissy
3d34b10239 Bug 1837376 - Process Flatpak debug symbols r=gsvelto
Differential Revision: https://phabricator.services.mozilla.com/D180351
2023-06-13 08:17:15 +00:00
Mark Banner
40de601f11 Bug 1834176 - Convert consumers of NetUtil.jsm to import the ES module directly. r=arai,webdriver-reviewers,perftest-reviewers,valentin,extension-reviewers,devtools-reviewers,sync-reviewers,cookie-reviewers,robwu,afinder,whimboo
Differential Revision: https://phabricator.services.mozilla.com/D178589
2023-06-07 08:42:36 +00:00
Mike Hommey
2f46b35dd9 Bug 1835730 - Use archive.debian.org for Debian jessie. r=jcristau
Differential Revision: https://phabricator.services.mozilla.com/D179406
2023-05-30 19:50:57 +00:00
Norisz Fay
ceadf5bfcf Backed out changeset df8e77c8a90b (bug 1835730) for causing docker images bustage 2023-05-30 11:42:59 +03:00
Mike Hommey
17e4d8aa85 Bug 1835730 - Use archive.debian.org for Debian jessie. r=jcristau
Differential Revision: https://phabricator.services.mozilla.com/D179406
2023-05-30 08:32:20 +00:00
Jan Horak
3fdefa412f Bug 1814897 Add org.mozilla.firefox.systemconfig extension to load system-wide settings; r=mkaply
The settings must be put into (path depends on architecture and branch):
/var/lib/flatpak/extension/org.mozilla.firefox.systemconfig/x86_64/stable/defaults/pref

Currently policies.json to be placed into:
/var/lib/flatpak/extension/org.mozilla.firefox.systemconfig/x86_64/stable/policies/policies.json

Differential Revision: https://phabricator.services.mozilla.com/D168803
2023-05-26 14:01:02 +00:00
Natalia Csoregi
1b67d0b941 Backed out 3 changesets (bug 1834222, bug 1834176) for causing RemoteProcessMonitor failures. CLOSED TREE
Backed out changeset 346d3a1568dd (bug 1834222)
Backed out changeset ea1d8b634bfc (bug 1834176)
Backed out changeset 74d1880272d3 (bug 1834176)
2023-05-24 04:29:45 +03:00
Mark Banner
d1fc869252 Bug 1834176 - Convert NetUtil.jsm to be an ES system module. r=arai,webdriver-reviewers,perftest-reviewers,valentin,extension-reviewers,devtools-reviewers,sync-reviewers,cookie-reviewers,robwu,afinder,whimboo
Differential Revision: https://phabricator.services.mozilla.com/D178589
2023-05-23 19:09:29 +00:00
Noemi Erli
1f146f097e Backed out 2 changesets (bug 1834176) for causing xpc failures in test_unload.js CLOSED TREE
Backed out changeset 57876d77a652 (bug 1834176)
Backed out changeset ae2f0837b528 (bug 1834176)
2023-05-23 12:14:37 +03:00
Mark Banner
08ff6c0ad9 Bug 1834176 - Convert NetUtil.jsm to be an ES system module. r=arai,webdriver-reviewers,perftest-reviewers,valentin,extension-reviewers,devtools-reviewers,sync-reviewers,cookie-reviewers,robwu,afinder,whimboo
Differential Revision: https://phabricator.services.mozilla.com/D178589
2023-05-23 08:13:08 +00:00
Mark Banner
91fde42f7b Bug 1826062 - Automatic fixes for Prettier 2.0.5 upgrade. r=mossop,perftest-reviewers,webcompat-reviewers,geckoview-reviewers,denschub,devtools-reviewers,sparky,owlish
Differential Revision: https://phabricator.services.mozilla.com/D177025
2023-05-20 12:26:49 +00:00
Kash Shampur
f34f0e5281 Bug 1831864 - Remove need for install-build-deps script for Linux CaR builds. r=perftest-reviewers,sparky
Recently the Chromium-as-Release linux builds started to fail and that is due to some changes upstream with the install-build-deps script.
This patch instead updates the Dockerfile packages and removes the (currently) failing script call.

Differential Revision: https://phabricator.services.mozilla.com/D177415
2023-05-09 18:50:04 +00:00
Mark Banner
0fadbc1ec4 Bug 1829618 - Enable Prettier on json files (automatic fixes). r=perftest-reviewers,webcompat-reviewers,extension-reviewers,andi,desktop-theme-reviewers,pip-reviewers,devtools-reviewers,sync-reviewers,mossop,denschub,dao,sparky,robwu,geckoview-reviewers,owlish
Differential Revision: https://phabricator.services.mozilla.com/D176336
2023-05-09 16:14:51 +00:00
Tom Ritter
7350be0673 Bug 1700396: Bump updatebot to get filing bug length fix r=jewilde
Differential Revision: https://phabricator.services.mozilla.com/D177163
2023-05-04 14:43:46 +00:00
Jed Davis
558ed0ec2f Bug 1653852 - Add features=devel to our flatpak packages to allow our crash reporter to work. r=jhorak
Differential Revision: https://phabricator.services.mozilla.com/D176883
2023-05-02 17:39:06 +00:00
stransky
6d02a2b621 Bug 1673437 [Flatpak] Enable access to kerberos r=jhorak,emersonbernier
Differential Revision: https://phabricator.services.mozilla.com/D173840
2023-04-26 07:23:59 +00:00
Julien Cristau
c98ec62938 Bug 1828619 - update base docker image for flatpak repackage. r=releng-reviewers,bhearsum DONTBUILD
Work around our docker version not supporting the close_range syscall
properly, by overriding it to return ENOSYS so glib knows to fall back.

Differential Revision: https://phabricator.services.mozilla.com/D175994
2023-04-20 13:12:03 +00:00
Kash Shampur
065c7dd6b6 Bug 1818364 - Add toolchain task for Chromium-as-Release for Linux. r=perftest-reviewers,ahal,glandium,sparky
This patch adds a Dockerfile and shell script for building an official custom configuration of Chromium i.e. "chromium-as-release" (CaR).
These CaR builds will be much more useful and realistic than our existing chromium performance tests in CI when doing
browser-browser comparisons for benchmarks, page load tests, etc.

Differential Revision: https://phabricator.services.mozilla.com/D173756
2023-04-13 14:18:47 +00:00
Sandor Molnar
a91d6f6b3b Backed out 2 changesets (bug 1818364) for causing browsertime failures in minidump-stackwalk. CLOSED TREE
Backed out changeset 765c496e216c (bug 1818364)
Backed out changeset 71620bc8f387 (bug 1818364)
2023-04-12 04:33:06 +03:00
Kash Shampur
198f1302bf Bug 1818364 - Add toolchain task for Chromium-as-Release for Linux. r=perftest-reviewers,ahal,glandium,sparky
This patch adds a Dockerfile and shell script for building an official custom configuration of Chromium i.e. "chromium-as-release" (CaR).
These CaR builds will be much more useful and realistic than our existing chromium performance tests in CI when doing
browser-browser comparisons for benchmarks, page load tests, etc.

Differential Revision: https://phabricator.services.mozilla.com/D173756
2023-04-11 22:53:57 +00:00
Mike Hommey
5368f3f071 Bug 1826691 - Make the debian-repackage docker image task fail when debootstrap fails. r=releng-reviewers,hneiva
Differential Revision: https://phabricator.services.mozilla.com/D174838
2023-04-06 05:54:52 +00:00
Mark Banner
e8daad195d Bug 1824173 - Enable ESLint configuration valid-jsdocs across the tree, disabling for currently failing locations. r=mossop,webcompat-reviewers,extension-reviewers,credential-management-reviewers,denschub,dimi,robwu
Depends on D173450

Differential Revision: https://phabricator.services.mozilla.com/D173451
2023-03-24 19:35:25 +00:00
Ben Hearsum
8f74de5caf Bug 1824368: update known hosts file in parter repack docker image for github host key change r=releng-reviewers,jlorenzo DONTBUILD
This adds the new RSA key from https://github.blog/2023-03-23-we-updated-our-rsa-ssh-host-key/, as well as the existing ed25519 keys (which I got from loading the partner repack image locally, and running `ssh github.com`).

Differential Revision: https://phabricator.services.mozilla.com/D173527
2023-03-24 15:03:32 +00:00
Julien Cristau
b2fb64b5ed Bug 1821513 - bump decision docker image version. r=releng-reviewers,gbrown DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D173400
2023-03-23 17:36:59 +00:00
Tom Ritter
64434274f1 Bug 1700396: Bump updatebot to get the phab fix r=jewilde
Differential Revision: https://phabricator.services.mozilla.com/D171763
2023-03-08 17:39:56 +00:00
ahochheiden
63003f4a5a Bug 1734402 - Upgrade to Python 3.7 for Ubuntu1804 r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D152244
2023-03-04 01:21:57 +00:00
Marian-Vasile Laza
bfb110fb15 Backed out 4 changesets (bug 1732228, bug 1734402) for multiple browsertime and talos failures. CLOSED TREE
Backed out changeset 266c417563fe (bug 1732228)
Backed out changeset ad9c880233ed (bug 1732228)
Backed out changeset dbab8862bb8a (bug 1734402)
Backed out changeset 2b233ff8eee7 (bug 1734402)
2023-03-01 06:34:22 +02:00
ahochheiden
a9a53768e3 Bug 1734402 - Upgrade to Python 3.7 for Ubuntu1804 r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D152244
2023-03-01 00:39:15 +00:00
Marian-Vasile Laza
6c9f170aa9 Backed out 4 changesets (bug 1734402, bug 1732228) for build bustages when upgrade pip-23.0.1-py3-none-any.whl. CLOSED TREE
Backed out changeset 675f6a2134ac (bug 1732228)
Backed out changeset 37b904639717 (bug 1732228)
Backed out changeset 9eaec62e8473 (bug 1734402)
Backed out changeset 2ad732e17790 (bug 1734402)
2023-02-28 23:53:18 +02:00
ahochheiden
d4900ec965 Bug 1734402 - Upgrade to Python 3.7 for Ubuntu1804 r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D152244
2023-02-28 21:25:00 +00:00
Stanca Serban
d5bdfc5744 Backed out 4 changesets (bug 1732228, bug 1734402) for causing mda failures. CLOSED TREE
Backed out changeset fe7621bd33fe (bug 1732228)
Backed out changeset 61a521ac78e9 (bug 1732228)
Backed out changeset abf785b6ffe4 (bug 1734402)
Backed out changeset e1f91aaed4c3 (bug 1734402)
2023-02-28 11:33:41 +02:00
ahochheiden
b838baf87c Bug 1734402 - Upgrade to Python 3.7 for Ubuntu1804 r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D152244
2023-02-28 08:15:45 +00:00
serge-sans-paille
b993f1cfed Bug 1805664 - Setup python toolchain tasks and add them to the build system r=glandium
This patch introduces:

1. fetch jobs to fetch python source / installer
2. a) build jobs to build python from source on Linux and OSX
   b) build job to manually extract python tree from Windows installer

Some details, per category:

(1) fetches Python 3.8.10 (source) and 3.8.10 (installer).

(2.a) the builds generate optimized version of Python (LTO + PGO)

(2.a) the builds are patched to honor MOZPYTHONHOME instead of
      PYTHONHOME. This is used to make OSX builds relocatable, and not
      needed on Windows.

(2) zstandard and psutil are added to the default build

Differential Revision: https://phabricator.services.mozilla.com/D164663
2023-02-22 06:24:51 +00:00
Cosmin Sabou
f40b22bea4 Backed out changeset 5c47ae2de529 (bug 1805664) for causing bug 1817894 and breaking clang 15. CLOSED TREE 2023-02-21 03:21:39 +02:00
serge-sans-paille
66d6c3de58 Bug 1805664 - Setup python toolchain tasks and add them to the build system r=glandium CLOSED TREE
This patch introduces:

1. fetch jobs to fetch python source / installer
2. a) build jobs to build python from source on Linux and OSX
   b) build job to manually extract python tree from Windows installer

Some details, per category:

(1) fetches Python 3.8.10 (source) and 3.8.10 (installer).

(2.a) the builds generate optimized version of Python (LTO + PGO)

(2.a) the builds are patched to honor MOZPYTHONHOME instead of
      PYTHONHOME. This is used to make OSX builds relocatable, and not
      needed on Windows.

(2) zstandard and psutil are added to the default build

Differential Revision: https://phabricator.services.mozilla.com/D164663
2023-02-20 16:07:55 +00:00
Iulian Moraru
89d8a89113 Backed out changeset cae102c770b7 (bug 1805664) for causing toolchain clang failures. CLOSED TREE 2023-02-20 19:35:34 +02:00
serge-sans-paille
7bf93d7db0 Bug 1805664 - Setup python toolchain tasks and add them to the build system r=glandium
This patch introduces:

1. fetch jobs to fetch python source / installer
2. a) build jobs to build python from source on Linux and OSX
   b) build job to manually extract python tree from Windows installer

Some details, per category:

(1) fetches Python 3.8.10 (source) and 3.8.10 (installer).

(2.a) the builds generate optimized version of Python (LTO + PGO)

(2.a) the builds are patched to honor MOZPYTHONHOME instead of
      PYTHONHOME. This is used to make OSX builds relocatable, and not
      needed on Windows.

(2) zstandard and psutil are added to the default build

Differential Revision: https://phabricator.services.mozilla.com/D164663
2023-02-20 16:07:55 +00:00
Julien Cristau
856b6c87a4 Bug 1816723 - add flathub::manifest to the firefox flatpak appdata. r=releng-reviewers,gbrown DONTBUILD
This is hardcoded to point at tip of mozilla-central instead of the revision
corresponding to the actual build, for simplicity's sake.

Thanks to barthalion for the tip.

Differential Revision: https://phabricator.services.mozilla.com/D169838
2023-02-15 10:44:09 +00:00
Tom Ritter
85d77907ce Bug 1700396: Bump updatebot for bug fixed r=jewilde
Differential Revision: https://phabricator.services.mozilla.com/D169722
2023-02-14 15:40:21 +00:00
Jaime Soriano Pastor
44d6fab483 Bug 1815736 - Fix locales in flatpak desktop file. r=stransky
Locales in the flatpak desktop files have the language and the country
separated by a hyphen, but it should be separated by underscore.

"-mac" in Japanese locale is also removed according to bug 418485.

Spanish translation is added for the action to open the profile manager.

Differential Revision: https://phabricator.services.mozilla.com/D169220
2023-02-09 09:05:01 +00:00