Commit Graph

8048 Commits

Author SHA1 Message Date
Andrew Halberstadt
599e696d24 Bug 1759030 - [gecko_taskgraph] Use 'generator.py' from upstream Taskgraph, r=releng-reviewers,jlorenzo
Differential Revision: https://phabricator.services.mozilla.com/D161057
2022-11-04 14:14:57 +00:00
Stanca Serban
821cf661d7 Backed out 3 changesets (bug 1759030) for causing Bug 1799074. CLOSED TREE
Backed out changeset 9c52daf6117c (bug 1759030)
Backed out changeset 9940b1cf6881 (bug 1759030)
Backed out changeset 3f2b2e009c00 (bug 1759030)
2022-11-04 11:22:09 +02:00
ahochheiden
ea574c1855 Bug 1795666 - Monkeypatch dlmanager.Download to increase chunk_size to 16 MB for artifact_cache.py downloads r=firefox-build-system-reviewers,andi,glandium
Differential Revision: https://phabricator.services.mozilla.com/D159658
2022-11-03 21:43:10 +00:00
Nick Alexander
4eea6ad46f Bug 1792258 - Post: Make it easier to test (Android) multi-locale packages. r=geckoview-reviewers,m_kato
This commit updates the outdated documentation for producing multi-locale
packages, and also arranges for Android multi-locale packages to produce a
GeckoViewExample binary that has `libs` and `assets/omni.ja`.  Together, these
greatly ease multi-locale testing.

Differential Revision: https://phabricator.services.mozilla.com/D160705
2022-11-03 21:36:26 +00:00
Andrew Halberstadt
5367b802c3 Bug 1759030 - [gecko_taskgraph] Use 'generator.py' from upstream Taskgraph, r=releng-reviewers,jlorenzo
Differential Revision: https://phabricator.services.mozilla.com/D161057
2022-11-03 20:51:15 +00:00
Greg Mierzwinski
e27dd67d9d Bug 1754823 - Add a flag to allow capturing the push-to-try logs. r=ahal,AlexandruIonescu
This patch adds a `capture_log` flag that will allow a user to capture the logs produced when running the `push_to_try` methods. Currently, we use `subprocess.check_call` which causes hg to hang when we attempt to redirect and gather stdout. Using `subprocess.run` is better as it lets us capture the logs, but the log output is very slow and can easily lead people to believe that hg is hanging when it's not. This results in corrupted repos. Using Popen, the logs are output slower than `check_call`, but faster than `run` so you know something is happening. The speed at which these logs are printed is also why I have this log capturing behind a flag.

This functionality will be used in the `./mach try perf` selector to capture the child revisions produced for the try task config file changes and allow us to produce a PerfCompare link to provide the user.

Differential Revision: https://phabricator.services.mozilla.com/D155980
2022-11-03 20:32:46 +00:00
Alex Finder
7c6d0acc1a Bug 1793823 disable p2 perf tests r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D159375
2022-11-03 14:42:39 +00:00
Mike Hommey
19823d5896 Bug 1787993 - Update how we install git-cinnabar. r=firefox-build-system-reviewers,andi
The download.py script can now run without a clone, which solves e.g.
problems stemming from the temporary git repository on windows.
It also now pulls from github by default, which doesn't suffer from
certificate validation issues like the taskcluster artifacts urls do.
Also, the self-update git-cinnabar subcommand handles upddates itself,
which leaves python out of the loop.

Differential Revision: https://phabricator.services.mozilla.com/D160997
2022-11-02 22:32:34 +00:00
Mike Hommey
6f7f9e788a Bug 1798603 - Fix bootstrap.py shebang. r=firefox-build-system-reviewers,andi
While here, also adjust its python version check, since it uses
f-strings, which aren't available before 3.6.

Differential Revision: https://phabricator.services.mozilla.com/D160994
2022-11-02 22:32:22 +00:00
Rob Lemley
a3b51acb33 Bug 1789178 - Extend MSIX repackaging to work with other products. r=nalexander
These are changes to decouple the MSIX repackaging from Firefox/browser and
allow repackaging Thunderbird. Branding and MSIX template paths are now found
by inspecting the input file rather than hard-coded values.

Differential Revision: https://phabricator.services.mozilla.com/D159657
2022-11-02 19:31:04 +00:00
ahochheiden
e7ae476fef Bug 1782785 - Remove carriage returns from ./mach vendor python output files to eliminate the differences from vendoring on Windows r=firefox-build-system-reviewers,glandium
Depends on D153662

Differential Revision: https://phabricator.services.mozilla.com/D153663
2022-11-02 19:08:25 +00:00
ahochheiden
040140437c Bug 1782785 - Make stripping environment markers more robost r=ahal
Depends on D153661

Differential Revision: https://phabricator.services.mozilla.com/D153662
2022-11-02 19:08:24 +00:00
ohall-m
b2fc6a8523 Bug 1771343 - GeckoView Android API 33 (Android 13) r=geckoview-reviewers,jgraham,jnicol,nalexander,jonalmeida
Updating GeckoView from Android API level 31 to API 33 for target and compile.

Differential Revision: https://phabricator.services.mozilla.com/D159764
2022-11-02 10:53:33 +00:00
ahochheiden
02f3532107 Bug 1796956 - Check for both variants of an executable ('no suffix' and ".exe") on Windows regardless of the executable r=firefox-build-system-reviewers,glandium
Differential Revision: https://phabricator.services.mozilla.com/D160570
2022-11-02 01:41:05 +00:00
Makoto Kato
512a46d050 Bug 1790301 - Allow Unicode-DFS-2016 license to import ICU4X 1.0. r=mhoye,glandium
By bug 1715232, we added ICU4X license SHA256 hash to whitelist. But when
releasing ICU4X 1.0, license becomes Unicode-DFS-2016 like ICU4C. So I would
like to allow this license to import ICU4X 1.0.

Also, due to dependencies, some crates still use old ICU4X license. Although it
will be fixed by 1.1 release, we keep this hash.

Differential Revision: https://phabricator.services.mozilla.com/D160588
2022-11-02 00:13:57 +00:00
Mark Banner
51f50abca4 Bug 1798565 - Partner repacks no longer need to handle the 'searchplugins' directory. r=firefox-build-system-reviewers,nalexander
Depends on D160964

Differential Revision: https://phabricator.services.mozilla.com/D160966
2022-11-01 21:45:26 +00:00
Mark Banner
cc4015f0eb Bug 1798563 - Remove search related python build files that are no longer used. r=firefox-build-system-reviewers,nalexander
Differential Revision: https://phabricator.services.mozilla.com/D160964
2022-11-01 21:45:26 +00:00
Tom Ritter
98be2e7ddd Bug 1797325: Support try presets in moz.yaml r=andi
Differential Revision: https://phabricator.services.mozilla.com/D160232
2022-11-01 14:13:42 +00:00
Ryan VanderMeulen
7e6f016ffd Bug 1797588 - Update to JDK 17.0.5+8. r=geckoview-reviewers,m_kato
Differential Revision: https://phabricator.services.mozilla.com/D160396
2022-11-01 12:34:47 +00:00
John Schanck
1fa889d4b8 Bug 1754746 - example tlsserver that fails in handshake. r=necko-reviewers,kershaw
Differential Revision: https://phabricator.services.mozilla.com/D148845
2022-11-01 09:52:52 +00:00
ahochheiden
e08aea9374 Bug 1766497 - Manually copy pyvenv.cfg on Windows to workaround a bug with venv on Python 3.6 r=firefox-build-system-reviewers,glandium
Depends on D159196

Differential Revision: https://phabricator.services.mozilla.com/D160599
2022-11-01 07:48:07 +00:00
Alex Hochheiden
74171826e3 Bug 1766497: Remove unused virtualenv package r=ahal
Now that Python's stdlib `venv` is used, `virtualenv` is no longer
needed.

Since mozharness depends on the wheels for `setuptools` and `pip`, and
they were vendored within `virtualenv` we must move them somewhere else.

I've chosen to add `third_party/python/venv/wheels` to hold those wheels
now that `virtualenv` is no longer there.

Depends on D145786

Differential Revision: https://phabricator.services.mozilla.com/D145787
2022-11-01 07:48:01 +00:00
Alex Hochheiden
d2539fe338 Bug 1766497: Mach: use venv instead of virtualenv r=ahal
Brew's Python 3.10 causes `virtualenv==20.7.2` to produce a wonky folder
structure (`$venv/opt/homebrew/lib/python3.10/site-packages`?).

This is likely fixed with newer `virtualenv`, but the simpler workaround
here is to use `venv` instead now that Python 3 is always used.

Adds `python3-venv` to docker image so that tests and debian-based tasks
can leverage it.

Differential Revision: https://phabricator.services.mozilla.com/D144872
2022-11-01 07:48:00 +00:00
Mike Hommey
7d9b39c2f7 Bug 1797904 - Don't require mercurial when bootstrapping with git. r=firefox-build-system-reviewers,nalexander
The version of git-cinnabar that the bootstrap script pulls now doesn't
require Mercurial. Even older versions have been working fine without
Mercurial for a while.

Differential Revision: https://phabricator.services.mozilla.com/D160601
2022-10-31 22:35:02 +00:00
Mike Hommey
93c64c7edb Bug 1797869 - Bump minimum Rust version to 1.63. r=firefox-build-system-reviewers,nalexander
Differential Revision: https://phabricator.services.mozilla.com/D160585
2022-10-28 03:53:25 +00:00
Ray Kraesig
a57a12db2a Bug 1797399 - fix rust-analyzer's invocation of mach r=andi
The fix for bug 1759555 involves having rust-analyzer invoke `mach`.
However, `mach` can't be executed directly on Windows systems -- it's a
Python script, not an executable, and so `::CreateProcessW` has no idea
what to do with it.

Work around this by having `mach` explicitly direct `rust-analyzer` to
use `sys.executable` to execute `mach`.

Differential Revision: https://phabricator.services.mozilla.com/D160306
2022-10-27 00:10:45 +00:00
Chris H-C
8a5ea0e8a7 Bug 1797363 - Vendor Glean SDK v51.7.0 r=TravisLong,supply-chain-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D160269
2022-10-26 13:02:54 +00:00
Sandor Molnar
22934e1811 Backed out changeset b9a80242b74c (bug 1754746) for causing xpc failures in security/manager/ssl/tests/unit/test_ev_certs.js 2022-10-26 14:58:12 +03:00
Mark Banner
38be40d5b9 Bug 1795322 - Update toolkit modules references in remaining places. r=mossop,zeid,geckoview-reviewers,calu
Differential Revision: https://phabricator.services.mozilla.com/D160036
2022-10-26 08:06:37 +00:00
Mike Hommey
341da5dbc0 Bug 1797275 - Bootstrap the appropriate clang tidy on arm64 macos. r=firefox-build-system-reviewers,ahochheiden
Differential Revision: https://phabricator.services.mozilla.com/D160291
2022-10-25 22:55:55 +00:00
Mike Hommey
f044f0131c Bug 1797227 - Avoid dependency on wget in bootstrap. r=firefox-build-system-reviewers,nalexander
Differential Revision: https://phabricator.services.mozilla.com/D160174
2022-10-25 22:54:41 +00:00
Csoregi Natalia
5edbe31601 Backed out 12 changesets (bug 1795322) for causing multiple failures e.g. test_deletion_request_ping.py. CLOSED TREE
Backed out changeset aba25cbcda51 (bug 1795322)
Backed out changeset a4a35005ada9 (bug 1795322)
Backed out changeset 8e8d790eb0f4 (bug 1795322)
Backed out changeset db8903454bd3 (bug 1795322)
Backed out changeset 60cc71c61cad (bug 1795322)
Backed out changeset bc6a674994ad (bug 1795322)
Backed out changeset 6ac8a611f8c7 (bug 1795322)
Backed out changeset 9fb873ecfb31 (bug 1795322)
Backed out changeset c8a7a40c2a2f (bug 1795322)
Backed out changeset f2c118b6c6ce (bug 1795322)
Backed out changeset 38df43b4a70f (bug 1795322)
Backed out changeset 89aea8373411 (bug 1795322)
2022-10-25 23:47:58 +03:00
Mark Banner
1ad6baaea2 Bug 1795322 - Update toolkit modules references in remaining places. r=mossop,zeid,geckoview-reviewers,calu
Differential Revision: https://phabricator.services.mozilla.com/D160036
2022-10-25 19:49:28 +00:00
John Schanck
62f8234c53 Bug 1754746 - example tlsserver that fails in handshake. r=necko-reviewers,kershaw
Differential Revision: https://phabricator.services.mozilla.com/D148845
2022-10-25 08:10:30 +00:00
Tom Ritter
3f177d82b7 Bug 1792627: Use mach vendor-based updating for irregexp r=iain
Differential Revision: https://phabricator.services.mozilla.com/D158289
2022-10-24 16:50:05 +00:00
Jan-Erik Rediger
4e5372b0ce Bug 1796087 - Update to Glean v51.5.0 and UniFFI 0.21.0. r=chutten,supply-chain-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D159689
2022-10-20 12:42:47 +00:00
Paul Adenot
de20ff2de0 Bug 1347955 - Move the logging facilities from about:networking to a new page, about:logging. r=valentin,fluent-reviewers,flod
Differential Revision: https://phabricator.services.mozilla.com/D159606
2022-10-20 12:10:19 +00:00
Alex Ionescu
d419121dd0 Bug 1789229 - Create/define the side-by-side job in taskcluster r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D157853
2022-10-20 07:23:10 +00:00
Mike Hommey
d4800b2cf3 Bug 1784179 - Don't stop at the first error during CI builds. r=firefox-build-system-reviewers,nalexander
It can be a frustrating experience to push something to e.g. try, get
build errors, fix them, and realize on a subsequent push that there were
other build errors, but since the build failed as soon as it reached the
first error, the logs didn't show them.

While stopping at the first error locally is more helpful locally
(although it still stop immediately and errors are often buried in the
logs), it is actually desirable to avoid stopping on automation.

Differential Revision: https://phabricator.services.mozilla.com/D154327
2022-10-20 01:55:20 +00:00
Kagami Sascha Rosylight
375d9a9332 Bug 1793974 - Pass mode=staged for staged files r=tjr DONTBUILD
This argument is not relevant for mercurial, it's only for `git diff` which by default ignores staged files.

Differential Revision: https://phabricator.services.mozilla.com/D159625
2022-10-18 20:25:31 +00:00
Mike Hommey
0734824f37 Bug 1795209 - Suppress no-error warnings from post-build summary. r=firefox-build-system-reviewers,andi
And count all third-party warnings together.

Differential Revision: https://phabricator.services.mozilla.com/D159359
2022-10-18 19:46:45 +00:00
Mike Hommey
9ba04bac85 Bug 1795207 - Move the remainder of warning flags setup in old-configure to python. r=firefox-build-system-reviewers,andi
While we're here, make the setup more consistent across host/target
c/c++, and remove the C compiler warning flags from the C linker flags,
where they are irrelevant.

Differential Revision: https://phabricator.services.mozilla.com/D159358
2022-10-18 19:46:44 +00:00
Tom Ritter
03c7a144cd Bug 1792224: Implement vendoring individual files r=jewilde
Differential Revision: https://phabricator.services.mozilla.com/D158051
2022-10-18 16:56:07 +00:00
Tom Ritter
a28c9557ca Bug 1792224: Do not allow tag tracking with individual-files r=jewilde
Differential Revision: https://phabricator.services.mozilla.com/D158050
2022-10-18 16:56:07 +00:00
Tom Ritter
135ce5bbf8 Bug 1792224: Make the tracking field validation simpler r=jewilde
Differential Revision: https://phabricator.services.mozilla.com/D158049
2022-10-18 16:56:07 +00:00
Tom Ritter
fc31e19604 Bug 1792224: Move the Updatebot section below vendoring to make it more logical r=jewilde
Differential Revision: https://phabricator.services.mozilla.com/D158048
2022-10-18 16:56:06 +00:00
Tom Ritter
dd61d002fc Bug 1792224: Do not allow branch in vendoring tasks r=jewilde
I noticed that 'branch' is only used in Updatebot in the
Commit Alert task (we made it for Angle.) It doesn't do
anything anywhere else. So assert this in the validation checks

Differential Revision: https://phabricator.services.mozilla.com/D158047
2022-10-18 16:56:06 +00:00
Tom Ritter
5b7303f40d Bug 1792224: Do some refactoring in preparation for real work r=jewilde
If there is a vendoring section missing in the moz.yaml,
we will error out. Detect this right away and give a better error.

Perform some cleanup since we know we have a vendoring section.

Differential Revision: https://phabricator.services.mozilla.com/D158046
2022-10-18 16:56:05 +00:00
Tom Ritter
be2d98bede Bug 1792224: Add tests for individual-files yaml parsing r=jewilde
Differential Revision: https://phabricator.services.mozilla.com/D158045
2022-10-18 16:56:05 +00:00
Tom Ritter
3a94e4ae1b Bug 1792224: Add support for individual-files in the moz.yaml r=jewilde
Differential Revision: https://phabricator.services.mozilla.com/D158044
2022-10-18 16:56:05 +00:00