Commit Graph

3239 Commits

Author SHA1 Message Date
Blake Kaplan
d039250345 Bug 1406212 - Remove references to extensions.e10sBlocksEnabling. r=Felipe
MozReview-Commit-ID: 11q3Go0IkPh
2017-10-16 13:52:48 -07:00
Steve Armand
bc0b25b8f4 Bug 1408365 - Enable flake8/py2/py3 linters on python/mozboot. r=ahal
MozReview-Commit-ID: 3koZq509bjP
2017-10-13 23:33:00 -04:00
Nick Alexander
9a6823d923 Bug 1406572 - Install Proguard JAR as part of |mach bootstrap|. r=rillian
I think we're approaching an inflection point for the bootstrapper,
one where it no longer is possible to bootstrap without a source
checkout.  For now, however, let's just do the simplest thing and
install the Proguard JAR along the happy path.

MozReview-Commit-ID: xUY37eE6oR
2017-10-17 15:48:32 -07:00
Nick Alexander
cb1667ea5c Bug 1366644 - Part 3a: Update Android build-tools (25.0.3), Gradle (3.4.1), Android-Gradle (2.3.3). r=maliu
The goal is to use a newer Android-Gradle build plugin version (2.3.3
is latest stable).  That requires a modern Gradle (anything 3.3+, but
3.4.1 is the default from my Android Studio), and also a newer
build-tools (25.0.3 is latest stable).

The locations of lint output changed, and we want to use the standard
output location because it's difficult to accommodate variant details
in custom names.  We change the location of findbugs output to follow
suit.

This requires either:

- fixing lint errors
- adding to the lint whitelist
- using the new lint baseline

It's best to use the new lint baseline, which will happen in the next commit.

MozReview-Commit-ID: D19FzIDCJrE
2017-10-16 15:09:15 -07:00
Jonathan Watt
cd05e1448b Bug 1409121 - Include the generated WebIDL and IPDL source files in Eclipse CDT. r=botond DONTBUILD NPOTB
MozReview-Commit-ID: Er2rCZs45N3
2017-09-29 20:07:40 +01:00
Jonathan Watt
a3c81d5c7e Bug 1408795 - Disable Eclipse CDT's binary parser. r=botond DONTBUILD NPOTB
By default Eclipse CDT will scan the source tree for binaries so that it can
add those binaries to the list of things that it can run.  This scanning is a
constant interuption and can last several seconds.  Besides that, it's
currently useless for our setup since the only binaries that we're interested
in running are in the object directory (which it doesn't scan), and those are
set up during project generation.  (The only binaries found in the source tree
are a couple of uninteresting bundled libraries.)

CLOSED TREE

MozReview-Commit-ID: 2WaH8qceALq
2017-09-28 11:10:43 +01:00
Jonathan Watt
25d7fb39e3 Bug 1408795 - Disable Eclipse CDT's "scalability" mode for files with fewer than 15,000 lines. r=botond
By default, scalability mode is activated for files with 5,000 lines or more.
There are quite a few C++ files with more than 5,000 lines, and Eclipse seems
to work fine with them with scalability mode turned off (even
nsCSSFrameConstructor.cpp which is over 13,000 lines long).  Increasing the
number of lines before scalability mode is enabled allows Eclipse to handle
these files better.

MozReview-Commit-ID: 8mGYIHStHes
2017-09-28 10:57:30 +01:00
Jonathan Watt
3c1c61d993 Bug 1408795 - Have Eclipse CDT treat Objective-C files as C++. r=botond
Without this setting, eclipse will refuse to open Objective-C files (it will
defer to an external editor).  Adding *.mm to the file types that are treated
as C++ allows Eclipse to open them, and to provide some code assistance for
the bits of the files that it can understand.

MozReview-Commit-ID: ASeXesWxY4g
2017-09-28 10:36:53 +01:00
Jonathan Watt
260991054c Bug 1408795 - Enable Eclipse CDT's "Refresh using native hooks or polling" setting. r=botond
This setting allows Eclipse to notice when files it has open are changed
externally (such as by hg/git, for example).  It can then update the contents
that it has for the open files, avoiding annoying issues such as saving changes
after an `hg pull -u` resulting in either "Resource is out of sync" errors or
else clobbering of the changes hg made to files.

MozReview-Commit-ID: 8WmewM7lbHe
2017-09-28 10:12:47 +01:00
Jonathan Watt
714d6d39e7 Bug 1408795 - Prevent Eclipse CDT's blocking "Welcome" screen from showing on startup. r=botond
The blocking Welcome screen is quite confusing for a new user. It is not clear
where to find the Mozilla stuff they expect to see when opening Eclipse, or
that the user needs to close the entire content area to get to it. Besides that
the screen isn't very useful for Mozilla people who will find more relevant
help from searching the online documentation, and who won't be creating new
projects in the generated workspace, etc.

MozReview-Commit-ID: 8YssnonAR1d
2017-09-28 09:53:08 +01:00
Jonathan Watt
2746d55e71 Bug 1408795 - Turn off Eclipse CDT's "Ensure newline at the end of file" setting. r=botond
The setting to ensure that there is a newline at the end of files when they
are saved is very annoying.  Besides adding unnecessary and unexpected cruft
to diffs, some parts of the codebase (some of the reftest directories for
example) have a policy of NOT having a newline at the end of their files.

MozReview-Commit-ID: IjIYxDsKS13
2017-09-28 09:37:10 +01:00
Jonathan Watt
df45c40a14 Bug 1408810 - Get the Eclipse CDT code formatter working again. r=botond
This makes us write the code formatter settings into the workspace settings
directory instead of the project settings directory.  This is preferable
since when users make settings changes they are more likely to work with the
workspace settings, so we should put them there.  Putting them there also
fixes a bug whereby the calls to _write_noindex/_remove_noindex would
overwrite the formatter settings file shortly after it had been created.

To get the formatter to show up in the UI we also need to set the formatter
settings as a one line pref value in the CDT UI settings.  This duplication
is what Eclipse does when a new formatter is manually added, and it's
necessary to get the formatter working correctly.

MozReview-Commit-ID: KP4w0VbNCF7
2017-09-27 19:43:16 +01:00
Ralph Giles
762edf96c4 Bug 1408565 - mozboot: Upgrade to rust 1.21.0. r=nalexander
We expect to start requiring rust 1.21 soon, so have
./mach bootstrap upgrade users to it to consolidate
churn between now and then.

MozReview-Commit-ID: HEnXm25duUr
2017-10-13 14:11:01 -07:00
Mike Hommey
15e2ea8ac5 Bug 1408224 - Avoid confusing errors in automation logs when failing to purge toolchain cache. r=mshal
For some reason, Windows builders are setup in a way that prevents a
task from purging the toolchain cache of old files. Until that is
figured out and fixed, all the error message related to that achieves is
confuse people because the treeherder Failure Classification tab shows
them first. Practically speaking, the error doesn't prevent anything
from working properly. The worst that can happen is disk space running
out because of the toolchain cache being filled up, which would lead to
actual errors.

As the error happens on very many windows build, that leads to a lot of
errors being bucketed on bug 1391811, while they may well be varying
unrelated issues.

It also leads to people thinking their try builds fail because of that,
when they aren't (e.g. bug 1408212).
2017-10-13 09:15:55 +09:00
Mike Hommey
56e6b1bde4 Bug 1408317 - Take endianness into consideration when looking for rust target. r=froydnj 2017-10-13 18:33:30 +09:00
Nick Alexander
0937817721 Bug 1352599 - Part 2: Add PROGUARD_JAR configure option. r=chmanchester
MozReview-Commit-ID: KOzcGY6txI6
2017-10-12 14:28:31 -07:00
Nick Alexander
c25ad0360d Bug 1407872 - Use Python yes-like pipe for --no-interactive in |mach bootstrap|. r=gbrown
The old system was simply in place because I couldn't figure out how
to pipe `yes | ...` in Python.  This is good enough to replace it, and
much less fragile since the license hashes change frequently.

MozReview-Commit-ID: AhJJPqMKfUh
2017-10-13 11:48:52 -07:00
Andrew Halberstadt
6b8c2e3636 Bug 1408385 - Make sure python-test tasks turn orange if no tests are run, r=davehunt
MozReview-Commit-ID: 8HAGvOg1Bbp
2017-10-13 09:42:06 -04:00
Sebastian Hengst
9afb04eba1 Backed out changeset cb5f4236d080 (bug 1352599) 2017-10-12 23:40:21 +02:00
Nick Alexander
cd988e0a10 Bug 1352599 - Post: Disable failing java.configure test. r=Aryx on a CLOSED TREE 2017-10-12 22:55:59 +02:00
Dustin J. Mitchell
d8abe9e132 Bug 1403322 - schedule test-verification inclusively; r=ahal
MozReview-Commit-ID: CsIUEq6CDln
2017-10-11 17:36:16 +00:00
Dustin J. Mitchell
839ffa1740 Bug 1403322 - schedule jsreftests inclusively; r=ahal
This is just one flavor of the "reftets" suite, so we need to add a distinct
scheduling component for it.

MozReview-Commit-ID: AtKuvuUCk1l
2017-10-11 17:31:20 +00:00
Dustin J. Mitchell
8b5a562e5d Bug 1403322 - schedule jittests inclusively; r=ahal
MozReview-Commit-ID: JcvMSTBJ83p
2017-10-11 17:21:11 +00:00
Mike Hommey
66590a08bb Bug 1407465 - Make most _MANIFESTS variables use SourcePaths. r=chmanchester 2017-10-05 11:15:27 +09:00
Nick Alexander
bc016f4d1f Bug 1405408 - Part 1: Use Task Cluster proxy to download non-public artifacts. r=dustin
MozReview-Commit-ID: L6VfQuAmHLC
2017-10-04 13:24:41 -07:00
Nick Alexander
35e24cfccc Bug 1405408 - Pre: Handle query string and fragments in URL parameters. r=dustin
This was simply oversight before.  I ran into this using the
taskcluster-proxy /bewit interface, which returns a URL of the form
https://domain.net/short/path/to.file?bewit="several thousand
characters", which leads to an IOError due to the long path.  Let's
assume that such query strings and fragments are transient; we should
drop these parts of the fetched URLs when writing to disk.

MozReview-Commit-ID: FMJHMp7a3rA
2017-10-05 13:30:21 -07:00
Sebastian Hengst
fbca931db2 merge mozilla-central to autoland. r=merge a=merge 2017-10-10 23:57:56 +02:00
Zibi Braniecki
0689712607 Bug 1407395 - Guard against empty defines entry when generating langpack manifest. r=Pike
MozReview-Commit-ID: t4Oc1tqbxE
2017-10-10 13:16:29 -07:00
André Reinald
9456c325e3 Bug 1405389 - Change port name from py27-readline to py27-gnureadline to enable mach bootstrap on current macports. r=nfroyd
MozReview-Commit-ID: E9AlS8RCSp9
2017-10-10 11:17:24 +02:00
Mike Hommey
9c814a6249 Bug 1319332 - Derive the rust targets from the build host/target. r=froydnj 2017-10-05 16:10:45 +09:00
Joel Maher
236ebecec3 Bug 1395247 - copy speedometer into talos package. r=rwood 2017-10-09 11:10:34 -04:00
Andi-Bogdan Postelnicu
cf75f4f510 Bug 1405602 - add clang-apply-replacements to path used by mach static-analysis. r=sylvestre
MozReview-Commit-ID: CiJ8sckSXNw
2017-10-04 17:02:50 +03:00
Andi-Bogdan Postelnicu
8efc204e23 Bug 1405654 - set default value for header-filter the same as source. r=sylvestre
MozReview-Commit-ID: 705as3mM1dA
2017-10-05 16:26:53 +03:00
Andi-Bogdan Postelnicu
088cafa3a2 Bug 1405607 - do not pass to run-clang-tidy files that are going to be scanned. r=sylvestre
MozReview-Commit-ID: BPyk9v7vzLr
2017-10-04 12:41:31 +03:00
Andreas Tolfsen
440d933e70 Bug 1405304 - Add Unix formatter for mozlint. r=ahal
This patch introduces a new report formatter for the mozlint
framework used by "./mach lint" that respects Unix output conventions,
popularised by grep(1), compilers, and preprocessors.

The output format looks like this:

	testing/marionette/driver.js:1153:48: no-unused-vars error: 'resp' is defined but never used.

Many editors (ed, Emacs, vi, Acme) recognise this format, allowing
users to interact with the output like a hyperlink to jump to the
specified location in a file.

MozReview-Commit-ID: 3IyiFmNbtMY
2017-10-03 14:45:17 +01:00
Andrew Halberstadt
9d85bdcbc9 Bug 1403222 - Add test suite families to SCHEDULES.exclusive r=dustin
MozReview-Commit-ID: JWKB7eOgfWc
2017-09-26 10:47:22 -04:00
Andi-Bogdan Postelnicu
e60efc9020 Bug 1403846 - add "header-filter" option argument to static-analysis from mach. r=sylvestre
MozReview-Commit-ID: GulGPCCi9U4
2017-09-28 11:21:34 +03:00
Wes Kocher
faa6e08cb7 Merge inbound to central, a=merge
MozReview-Commit-ID: CvJ9hmTQBcR
2017-10-02 16:22:37 -07:00
Nathan Froyd
145280abfb Bug 1373878 - part 2 - build system support for Rust tests; r=rillian 2017-10-02 09:21:22 -04:00
Sebastian Hengst
95c011a9f0 Backed out changeset ddfc127526b2 (bug 1403222) for failing python/mozbuild/mozbuild/test/frontend/test_reader.py::TestBuildReader::test_schedules, at least for Linux asan opt builds. r=backout on a CLOSED TREE 2017-10-02 16:03:12 +02:00
Andrew Halberstadt
5c9a4c3849 Bug 1403222 - Add test suite families to SCHEDULES.exclusive r=dustin
MozReview-Commit-ID: JWKB7eOgfWc
2017-09-26 10:47:22 -04:00
Andrew Halberstadt
38330494a3 Bug 1401199 - [mozversioncontrol] Add property to get hash of HEAD revision, r=mshal
MozReview-Commit-ID: 9XWlLeGcPeQ
2017-09-29 11:10:59 -04:00
Andi-Bogdan Postelnicu
a5aa003329 Bug 1402302 - sync checkers for static-analysis with the mozreview bot. r=sylvestre
MozReview-Commit-ID: I5rn4DEXGOK
2017-09-30 14:54:58 +03:00
Wes Kocher
087ea69c08 Backed out changeset 048af66f7711 (bug 1402302) for lint issues in config.yaml a=backout
MozReview-Commit-ID: 8vkN5D8YVks
2017-09-29 14:23:59 -07:00
Andi-Bogdan Postelnicu
26af4b1aed Bug 1402302 - sync checkers for static-analysis with the mozreview bot. r=sylvestre
MozReview-Commit-ID: I5rn4DEXGOK
2017-09-29 23:48:19 +03:00
Mike Shal
3383b336e3 Bug 1402012 - Update buildconfig.py to use PartialConfigEnvironment; r=glandium
By using the PartialConfigEnvironment, the clients of buildconfig will
depend on config.statusd/ files instead of config.status directly.
Clients can access substs and defines using buildconfig.substs['FOO'] or
buildconfig.defines['BAR'], and then collect file-level dependencies for
make using buildconfig.get_dependencies(). All GENERATED_FILES rules
already make use of this because file_generate.py automatically includes
these dependencies (along with all python modules loaded).

As a result of this commit, re-running configure will no longer cause
the world to be rebuilt. Although config.status is updated, no build
steps use config.status directly and instead depend on values in
config.statusd/, which are written with FileAvoidWrite. Since those
files are not official targets according to the make backend, make won't
try to continually rebuild the backend when those files are out of date.
And since they are FileAvoidWrite, make will only re-run dependent steps
if the actual configure value has changed.

As a result of using JSON to load data from the config.statusd
directory, substs can be unicode (instead of a bare string type).
generate_certdata.py converts the subst manually to a string so the
value can be exported to the environment without issue on Windows.

Additionally, patching the buildconfig.substs dict no longer works, so
the unit-symbolstore.py test was modified to patch the underlying
buildconfig.substs._dict instead.

The other files that needed to be modified make use of all the defines
for the preprocessor. Those that are used during 'mach build' now use
buildconfig.defines['ALLDEFINES'], which maps to a special
FileAvoidWrite file generated for the PartialConfigEnvironment.

MozReview-Commit-ID: 2pJ4s3TVeS8
2017-08-24 22:52:01 -04:00
Mike Shal
66c656a6a3 Bug 1402012 - Use PartialConfigEnvironment in process_define_files.py; r=glandium
This removes the dependency on config.status for CONFIGURE_DEFINE_FILES.
Instead, each file depends on the specific configure values that it
uses.

MozReview-Commit-ID: H4oLmJei1KR
2017-08-21 15:34:07 -04:00
Mike Shal
07426254c6 Bug 1402012 - Create config.statusd directory; r=glandium
The config.statusd directory is created alongside config.status, which
contains the same information but is split across many files instead of
all in a single file. This allows the build system to track dependencies
on individual configure values.

MozReview-Commit-ID: 2DbwKCJuNSX
2017-08-18 10:41:50 -04:00
Andrew Halberstadt
c12a2cb5ee Bug 1401309 - [mozlint] Remove vcs.py and use mozversioncontrol instead, r=gps
This also migrates the vcs.py test to mozversioncontrol and adds a new task for
it.

MozReview-Commit-ID: 9jTRkjNupVA
2017-09-25 16:30:27 -04:00
Andrew Halberstadt
c7c63a9fb4 Bug 1401309 - [mozversioncontrol] Add an option to make failed subprocess commands non-fatal, r=gps
Sometimes commands return non-zero even though everything is ok. For example,
'hg outgoing' returns 1 if there are no outgoing files. This adds a way for
specific function calls not to abort if something goes wrong. Instead, stderr
will be printed (if any) and an empty string is returned.

MozReview-Commit-ID: E089djeHrmr
2017-09-25 16:30:13 -04:00