Commit Graph

2787 Commits

Author SHA1 Message Date
Chris Manchester
8fd2a8e93c Bug 1360360 - Package screenshot programs during artifact builds. r=mshal
MozReview-Commit-ID: ExYrFbObOrG
2017-04-27 14:03:19 -07:00
J. Ryan Stinnett
4a04812483 Bug 1359501 - Accept artifact builds from beta. r=chmanchester
MozReview-Commit-ID: 5a2NIi6U7n7
2017-04-25 12:12:16 -05:00
Tom Ritter
7f3e0b6468 Bug 1353541 Fix rustc in MinGW build r=froydnj,ted
rustc generates .lib files for its libraries when compiling for Windows
(even using MinGW on Linux). But MinGW expects .a files. So we add in
rust-specific prefix and suffixes so MinGW builds can find the libs that
rustc generates. (And the RUST_LIB- variables default to the same vales
as the LIB_ variables otherwise.)

MozReview-Commit-ID: ClsA0YuJaxh
2017-04-26 12:08:59 -05:00
Wes Kocher
1bb3fcd58a Merge inbound to m-c a=merge
MozReview-Commit-ID: A85cs7Yriqj
2017-04-25 13:53:00 -07:00
Luis de Bethencourt
77c35897ed Bug 1140088 - Update git URL to github; r=froydnj
git.mozilla.org has been decommissioned.

DONTBUILD because comment-only fixes are safe.
2017-04-25 14:46:52 +01:00
Mark Banner
1584c1721b Bug 1358540 - Change the *.lint files to be *.lint.py to better support editor integration & flake8 linting. r=smacleod
MozReview-Commit-ID: 4KK2GZK7xul
2017-04-21 17:31:15 +01:00
Carsten "Tomcat" Book
090519bc6f Backed out changeset eec770d062b4 (bug 1358540) for bustage 2017-04-25 10:15:07 +02:00
Mark Banner
45f13bc3e9 Bug 1358540 - Change the *.lint files to be *.lint.py to better support editor integration & flake8 linting. r=smacleod
MozReview-Commit-ID: 4KK2GZK7xul
2017-04-21 17:31:15 +01:00
Cameron McCormack
916c5f6589 Bug 1257451 - Make |mach run| use --debugger-args instead of --debugparams, like the mochitest/reftest commands do. r=gps
MozReview-Commit-ID: ChB9KjNKbHO
2017-04-21 13:17:31 +10:00
Mike Hommey
d51030340d Bug 1357323 - Remove support for gonk in the build system. r=gps
Everything depending on the widget being gonk can go away, as well as
everything depending on MOZ_AUDIO_CHANNEL_MANAGER, which was only
defined on gonk builds under b2g/ (which goes away in bug 1357326).
2017-04-18 16:56:09 +09:00
Mike Hommey
dab330c9a7 Bug 1357326 - Remove things relying on the b2g* MOZ_BUILD_APP in the build system. r=gps 2017-04-18 18:39:53 +09:00
Mike Hommey
559588e2bc Bug 1356937 - Avoid mach artifact toolchain failing to get taskcluster artifacts when they are not directly under public/. r=gps 2017-04-17 09:47:56 +09:00
Chris Manchester
f2477a98e4 Bug 1247567 - Include per-source flags in the CompileDB. r=glandium
MozReview-Commit-ID: Ivm4DeG8z94
2017-04-14 16:02:25 -07:00
Mike Hommey
c041d72727 Bug 1356976 - Don't make mach artifact toolchain return an error code when there is nothing to download. r=gps
There can be cases where there is simply nothing to download, especially
with the --for-job argument. So we just stop erroring out when nothing
was downloaded.

However, if the user explicitly requested a particular file(s) via the
command line and there is nothing to download, we still emit an error
code.
2017-04-17 16:02:25 +09:00
Mike Hommey
0829e42061 Bug 1356934 - Don't assume the path to the taskcluster config is relative to topsrcdir. r=gps 2017-04-17 09:05:13 +09:00
Alex Gaynor
478321d9d3 Bug 1294641 - whitelist reads from the .app directory in the macOS sandbox r=froydnj,haik
This patch does a few things:
a) Adds the resources location from the .app directory to the read whitelist
b) When it's a non-packaged build, mach run (and various mach tests) set an environment variable for the repo location which we allow reads from.

r=haik,froydnj

MozReview-Commit-ID: KNvAoUs5Ati
2017-04-07 14:53:19 -04:00
Sebastian Hengst
155e26d497 Backed out changeset 225683fed1d1 (bug 1294641) for breaking crashtests, reftests and Windows builds. r=backout on a CLOSED TREE 2017-04-17 16:29:52 +02:00
Alex Gaynor
d7af07ecbe Bug 1294641 - whitelist reads from the .app directory in the macOS sandbox r=froydnj,haik
This patch does a few things:
a) Adds the resources location from the .app directory to the read whitelist
b) When it's a non-packaged build, mach run (and various mach tests) set an environment variable for the repo location which we allow reads from.

r=haik,froydnj

MozReview-Commit-ID: KNvAoUs5Ati
2017-04-07 14:53:19 -04:00
Mike Hommey
2ff2f6029e Bug 1356524 - Add a mach artifact toolchain option to get artifacts from taskcluster builds. r=gps
Now that we have automated build jobs that produce toolchains, we want
to avoid the burden of uploading them to tooltool and then update the
tooltool manifests. But we don't have build jobs for all the possible
toolchains, so we allow `mach artifact toolchain` to get a mix of
tooltool and taskcluster artifacts.

For taskcluster artifacts, we can give a list of job names (conveniently
automatically normalized to begin with 'toolchain-' and end with '/opt')
for which the artifacts will be downloaded, in place of any tooltool
package with the same name (if a tooltool manifest is given).

The taskcluster artifacts that we download are the ones matching the
contents of the tree the command is run with, per the resources declared
for the corresponding toolchain build job (in
taskcluster/ci/toolchain*.yml)

So for example, a linux64 build could call the following command:
  mach artifact toolchain --tooltool-manifest \
    browser/config/tooltool-manifests/linux64/releng.manifest \
    --from-build linux64-gcc

and get the right gcc corresponding to the build-gcc script in tree,
along with the other non-gcc files from the tooltool manifest.

Things are however planned to be even more convenient, but some commands
can already benefit from this form (even without a tooltool manifest).
See e.g. bug 1328454.
2017-04-14 11:34:53 +09:00
Mike Hommey
5f1224fd91 Bug 1356524 - Only add Authorization header when sending requests to the tooltool url. r=gps
We're going to potentially use the same download manager for tooltool
and taskcluster artifacts, and we don't want to send the tooltool
authentication header to the taskcluster requests.
2017-04-14 10:28:42 +09:00
Gregory Szorc
c3f0bf3ccd Bug 1334525 - Handle tuple types and WPT manifests correctly; r=chmanchester
beb43155b7a6 changed WPT items to be 3-tuples instead of 2-tuples.
This broke test_defaults_for_path().

MozReview-Commit-ID: 7M0RcQ7bOIU
2017-04-12 15:15:36 -07:00
Mike Hommey
a3fde2761b Bug 1356142 - Use mozbuild.util.mkdir instead of os.makedirs for the artifact cache directory. r=gps
At the same time, make the artifact cache directory not indexed, and
move the directory creation to the base classes that actually use it.
2017-04-13 16:35:20 +09:00
Mike Hommey
e3198c5052 Bug 1355731 - Add a mach command wrapping tooltool. r=gps
The ultimate goal is to have a generic command that pulls relevant
toolchains from either tooltool or taskcluster artifacts.

This introduces the command and makes it work to allow to wrap tooltool
in most places where it's used currently, with the ability to replace
tooltool_wrapper.sh as well.
2017-04-12 17:42:17 +09:00
Mike Hommey
ee7e64fee7 Bug 1355731 - For artifacts cache, use the file name from the url if it looks like a hash digest. r=gps 2017-04-12 16:26:20 +09:00
Mike Hommey
187e7f6ebc Bug 1355731 - Move tooltool to mozbuild.action. r=gps 2017-02-22 17:20:41 +09:00
Wes Kocher
74eee0ab05 Merge m-c to autoland, a=merge 2017-04-13 17:35:34 -07:00
Wes Kocher
e18b7d684a Merge inbound to central, a=merge 2017-04-13 17:24:01 -07:00
Mike Hommey
0921909d80 Bug 1356064 - Remove the mach artifact print-cache subcommand. r=nalexander 2017-04-13 09:50:57 +09:00
Mike Hommey
d6d63bd867 Bug 1356064 - Remove the mach artifact last subcommand. r=nalexander
It has been broken for a while (bug 1341205).
2017-04-13 09:47:27 +09:00
Gregory Szorc
9922a34b43 Bug 1355630 - Inline specialized version of relpath(); r=chmanchester
Profiling revealed that mozpath.relpath() accounted for a lot of CPU
time when operating on an input of ~42,000 paths.

Due to the nature of the paths we're operating on, we don't need the
full power of mozpath.relpath() here. Instead, we can implement a
specialized version that works given already normalized paths and the
knowledge that context paths must be ancestors of the current path
being examined.

This change drops execution time of a mach command feeding ~42,000
paths to this function from ~90s to ~24s. On an input with 9131 paths,
execution time dropped from ~8.8s to ~3.7s.

MozReview-Commit-ID: EGLiJa10Zj2
2017-04-11 16:46:55 -07:00
Gregory Szorc
852c4554dc Bug 1355630 - Memoize tests_defaults_for_path call; r=chmanchester
Calling self.test_defaults_for_path() from files_info() with tens
of thousands of paths resulted in a CPU explosion in various path
normalization functions. I don't think it was so much the complexity
of the operations as much as the volume.

For an input with 9131 elements, this reduces execution time of a
mach command from ~25.7s to ~8.8s. With ~42,000 inputs, execution time
drops from <it took too long and I gave up> to ~90s.

MozReview-Commit-ID: pjQQByi2Bc
2017-04-11 16:24:42 -07:00
Gregory Szorc
e8781978ff Bug 1355630 - Use a set for membership testing; r=chmanchester
With ~42,000 entries in relpaths, this change drops execution time
of this loop from ~23s to ~0.01s.

MozReview-Commit-ID: Afm245tjWUQ
2017-04-11 15:25:13 -07:00
Nathan Froyd
d58a810176 Bug 1353810 - add a --enable-rust-debug option; r=chmanchester
For people working on Rust code, compiling in debug mode (Cargo's "dev"
profile) is convenient: debug assertions are turned on, optimization is
turned off, and parallel compilation inside of rustc itself can be
used.  These things make the build faster and the debugging experience
more pleasant.

To obtain that currently, one needs to --enable-debug at the Gecko
toplevel, which turns on debug assertions for the entire browser, which
makes things run unreasonably slowly.  So it would be desirable to be
able to turn *off* debug mode for the entirety of the browser, but turn
on debug mode for the Rust code only.

Hence this added switch, --enable-rust-debug, which does what it
suggests and defaults to the value of --enable-debug.  For our own
sanity and because we judge it a non-existent use case, we do not
support --enable-debug --disable-rust-debug.
2017-04-12 21:49:25 -04:00
Wes Kocher
197a1c4128 Merge autoland to central, a=merge CLOSED TREE 2017-04-12 15:13:30 -07:00
Axel Hecht
5ddef99a04 bug 1344782, update compare-locales to 1.2.3, r=flod
Dropped support for python 2.6
Removed support for bookmarks.html
Better internal APIs

Intermediate versions had incompatibilities with old versions
of python 2.7, but 1.2.3 does not.

MozReview-Commit-ID: LfKhr8qWe28
2017-04-12 15:26:40 +02:00
Petr Sumbera
3d759d1f3d Bug 1354510 - Firefox build should recognize Solaris. r=glandium 2017-04-11 00:01:32 -07:00
Mike Shal
6de79e3c28 Bug 1337145 - Remove python components used for EME generation; r=glandium
MozReview-Commit-ID: G8OhcbStQkG
2017-04-10 13:40:03 -04:00
Chris Manchester
dd7cb62d32 Bug 1337986 - Dump symbols during the compile tier. r=ted
This commit moves symbol dumping to the compile tier, to be run via "syms"
targets. Tracking files are used for the sake of incremental builds, because
dump_syms may genearate multiple outputs whose paths are not known ahead of
time.

Minimal changes to symbolstore.py are made here. More extensive
simplifications will be made in a future commit on the basis of symbolstore.py
handling one file at a time.

MozReview-Commit-ID: 3mOP8A6Y7iM
2017-02-10 08:34:08 -08:00
Chris Manchester
4d3d7f49e9 Bug 1337986 - Generate "syms" targets for directories containing programs or shared libraries. r=glandium
This creates "syms" targets that depend on the corresponding "target" for
directories containing shared libraries or programs. These targets are added
to the main compile graph in automation, and can be invoked through a special
"symbols" target. A future commit will use these targets to dump symbols for
shared libraries and programs during the compile tier.

MozReview-Commit-ID: KLuvmqsK4Zj
2017-04-10 10:27:49 -07:00
Simon Sapin
f3649eba80 Bug 1352815 - "codegen-units = 4" for Rust code in debug mode r=froydnj
MozReview-Commit-ID: IIFVmijY4B3
2017-04-02 14:17:44 +02:00
Sebastian Hengst
69276fe58f merge mozilla-central to autoland. r=merge a=merge 2017-04-07 22:16:26 +02:00
Carsten "Tomcat" Book
0175d8a0b6 Merge mozilla-central to mozilla-inbound 2017-04-07 15:33:03 +02:00
Michael Layzell
c7a9c27962 Bug 1320179 - Part 2: Add the nserror rust crate and generate NS_ERROR codes, r=froydnj
MozReview-Commit-ID: FFU6WfEqev
2017-04-06 18:37:25 -04:00
Ralph Giles
7d7a07b3c6 Bug 1354221 - Remove dead code in _process_rust_library. r=froydnj
These variables are ignored in favour or reading the same values
from the passed in libdef object.

MozReview-Commit-ID: 8Xkkd68clNN
2017-04-06 10:59:46 -07:00
Locke Chen
03c7eb072c Bug 1350229 - Removing Preview side panel. r=rickychien
MozReview-Commit-ID: aDksj7VKAp
2017-04-07 23:31:18 +08:00
Michael Layzell
d858933d13 Bug 1347290 - Set sgr0 to '' if blessings.tigetstr('sgr0') returns None, r=gps
MozReview-Commit-ID: vP4izM2RwP
2017-04-06 17:44:30 -07:00
Utkarsh Anand
3d88e8fbea Bug 1353460 Asked the user to restart the shell before building from source. r=rillian
When downloading rust manually, it's mandatory to restart the shell,
as the script does not export the PATH environment variable.
This fix also ensures that the rust version in PATH is modern enough for a successful build.

MozReview-Commit-ID: HdLpiLPBLW7
2017-04-06 08:27:57 +05:30
Ting-Yu Chou
f8fcde2d04 Bug 1333003 part 5 - Include ASan runtime dll in common.tests.zip. r=ted
MozReview-Commit-ID: AzPdxaWwJn4
2017-03-10 12:09:17 +08:00
Chris AtLee
24bb152a2d Bug 1351071: Get rid of pre-generated startup cache r=glandium
MozReview-Commit-ID: BcWcqEKwGBv
2017-04-04 09:26:25 -04:00
Carsten "Tomcat" Book
54d9a843d0 merge mozilla-inbound to mozilla-central a=merge 2017-04-04 12:35:03 +02:00