Commit Graph

315 Commits

Author SHA1 Message Date
Simon Fraser
a61e4a9d9c Bug 1452159 periodic file udpates, fix awk behaviour r=jlorenzo
Summary:
a difference in behaviours between awks meant the original didn't work in-situ,
although the task didn't fail due to the pipe chain.

Reviewers: jlorenzo

Reviewed By: jlorenzo

Bug #: 1452159

Differential Revision: https://phabricator.services.mozilla.com/D899
2018-04-10 13:10:45 +01:00
Simon Fraser
eb99276fe5 Bug 1452584 Removing pinning for periodic file updates r=jlorenzo
Reviewers: jlorenzo

Reviewed By: jlorenzo

Bug #: 1452584

Differential Revision: https://phabricator.services.mozilla.com/D883
2018-04-09 12:04:17 +01:00
Simon Fraser
8e3fb10c42 Bug 1452159 periodic file update clears out old reviews r=jlorenzo
Summary:
the periodic file updates keep adding new reviews, and it's easy to fall behind.
This adjusts the script so it clears out any previous submissions that are still awaiting review.

Reviewers: jlorenzo

Reviewed By: jlorenzo

Bug #: 1452159

Differential Revision: https://phabricator.services.mozilla.com/D872
2018-04-09 11:18:06 +01:00
Johan Lorenzo
5f2c6caa31 Bug 1447263 - Snap: Split build and upload task r=rail
MozReview-Commit-ID: DGLQZLTjJDu
2018-03-20 17:19:50 +01:00
Ciure Andrei
0b523d8933 Merge inbound to mozilla-central. a=merge 2018-04-04 00:54:16 +03:00
Olivier Tilloy
2e8e67ba8f Bug 1449864: [snap package] add the removable-media plug to allow saving downloaded files to /media. r=jlorenzo
MozReview-Commit-ID: LcKaZOZP6vS
2018-03-29 10:10:53 +02:00
Gregory Szorc
337058f98e Bug 1449629 - Install Python 3.5 in debian-base; r=glandium
We want Python 3.5+ to be available everywhere so various processes
can start using it.

The debian-base Dockerfile is shared by Debian 7 and 9 images.
Debian 9 ships with Python 3.5 and after the previous commit, we
have a Python 3.5 package for Debian 7. So we simply install the
"python3.5" package to get Python on all the Debian images.

MozReview-Commit-ID: 9ZmoSxtHWTZ
2018-04-02 16:58:21 -07:00
Simon Fraser
456c5da5c5 Bug 1379773 Update funsize to allow mar/mbsdiff definitions r=bhearsum 2018-03-26 12:16:08 +01:00
Csoregi Natalia
6c9936d0c2 Backed out changeset b42a6edd2645 (bug 1379773) for flake failure on scripts/funsize.py:229. CLOSED TREE 2018-03-26 13:55:44 +03:00
Simon Fraser
a059a53735 Bug 1379773 Update funsize to allow mar/mbsdiff definitions r=bhearsum 2018-03-26 11:38:05 +01:00
Gregory Szorc
40dbb29b49 Bug 1448438 - Upgrade to Mercurial 4.5.2; r=sheehan
We bump the version of Mercurial for Debian packages and for Ubuntu
Docker images.

MozReview-Commit-ID: KYmG4rOm3TQ
2018-03-23 12:09:36 -07:00
Gregory Szorc
ce33eca16e Bug 1448438 - Install Mercurial via install-mercurial.sh; r=Callek
All in-tree Docker images should be installing Mercurial via
install-mercurial.sh so that the Mercurial install is consistent
across all Docker images.

I noticed this image wasn't using install-mercurial.sh because
attempting to rebuild the image currently fails due to
mercurial-4.3.1-2 not being available in the upstream package repo.

install-mercurial.sh has been taught to handle Ubuntu 18.04 and the
Docker image building process has been taught to use
install-mercurial.sh. install-mercurial.sh uses tooltool and behavior
should work and be deterministic over all of time.

As part of this, we had to establish a standalone shell script for
building the image. That's because install-mercurial.sh requires a
"tooltool_fetch" alias. Meaningful image building code has been
moved into the new setup.sh. This also means things run as a single
RUN statement. So we don't need to hack around minimizing RUN
invocations.

I also discovered that the pinned curl version is no longer available.
So I removed the version pinning. FWIW we can't rely on version
pinning unless the Apt repository is snapshotted. Packages do get
yanked from time to time. Unless we absolutely require a specific
version of a specific package, we can probably get away without pinning
- at least for this Docker image. But that can be a follow-up.

MozReview-Commit-ID: As7Hq470QcK
2018-03-23 13:23:02 -07:00
Johan Lorenzo
6a425c5c02 Bug 1448239 - Force apt database update so snapcraft can fetch packages r=rail
MozReview-Commit-ID: KAp4dCyHMRA
2018-03-23 12:06:51 +01:00
Simon Fraser
826ba2b3a5 Bug 1430600 Fix retries for partials async downloads r=callek
Summary: This doesn't solve the download timeouts, but does ensure that retries are happening as they should.

Reviewers: rail

Reviewed By: rail

Bug #: 1430600

Differential Revision: https://phabricator.services.mozilla.com/D821
2018-04-03 18:31:05 +01:00
Johan Lorenzo
1da3e36f0b Bug 1444898 - Snap: Use dedicated snap docker image instead of the Ubuntu one r=rail
MozReview-Commit-ID: 2wDKUHJI9tr
2018-03-12 15:23:32 +01:00
Ken VanDine
f30fb05d09 Bug 1444140 - xdg-utils shouldn't be bundled in the firefox snap r=jlorenzo
MozReview-Commit-ID: CI6j8lxxA1T
2018-03-09 10:56:44 +00:00
Mark Banner
df8062cd7b Bug 1443547 - Upgrade Docker images to node 8.9.4 & npm 5.6.0. r=dustin
MozReview-Commit-ID: 3rrH3JcOrnu
2018-03-06 19:37:13 +00:00
Brindusan Cristian
c1e366687d Merge inbound to mozilla-central. a=merge 2018-03-08 20:00:36 +02:00
Ken VanDine
7c8c9c03cd Bug 1442419 - Fixed typo in the mimeapps.list bundled in the snap r=jlorenzo 2018-03-08 13:25:12 +00:00
shindli
4e6bac8c6c Merge inbound to mozilla-central. a=merge 2018-03-08 02:20:08 +02:00
Andreea Pavel
4ca8c99a69 Merge mozilla-central to mozilla-inbound. a=merge on a CLOSED TREE 2018-03-07 17:21:25 +02:00
Simon Fraser
7fa579dc38 Bug 1436369 periodic file updates migration, stage 1 r=callek
Summary:
We'll be adding the new periodic file updates task to run in parallel. This patch
moves the existing one to make it clear it's running on buildbot, so we don't get confused
later on.

Reviewers: Callek

Reviewed By: Callek

Bug #: 1436369

Differential Revision: https://phabricator.services.mozilla.com/D681
***
Bug 1436369 Add taskcluster periodic file updates r=callek

Reviewers: Callek

Reviewed By: Callek

Differential Revision: https://phabricator.services.mozilla.com/D683
***
Bug 1436469 Fix task definition r=callek
***
Bug 1436469 Move periodic-file updates docker image r=callek
2018-03-06 15:27:58 +00:00
Andreea Pavel
d50ab2378e Backed out changeset 514feaa0c698 (bug 1436369) for taskcluster-images bustage on a CLOSED TREE 2018-03-07 14:22:54 +02:00
Simon Fraser
381fa78d1d Bug 1436369 periodic file updates migration, stage 1 r=callek
Summary:
We'll be adding the new periodic file updates task to run in parallel. This patch
moves the existing one to make it clear it's running on buildbot, so we don't get confused
later on.

Reviewers: Callek

Reviewed By: Callek

Bug #: 1436369

Differential Revision: https://phabricator.services.mozilla.com/D681
***
Bug 1436369 Add taskcluster periodic file updates r=callek

Reviewers: Callek

Reviewed By: Callek

Differential Revision: https://phabricator.services.mozilla.com/D683
***
Bug 1436469 Fix task definition r=callek
***
Bug 1436469 Move periodic-file updates docker image r=callek
2018-03-06 15:27:58 +00:00
Bogdan Tara
a5d6a81c08 Backed out changeset 6ba388ca08da (bug 1436369) for taskcluster-images bustage and linting failure at taskcluster/ci/repo-update/kind.yml:49:1 on a CLOSED TREE 2018-03-07 13:21:46 +02:00
Simon Fraser
f94c0b687d Bug 1436369 periodic file updates migration, stage 1 r=callek
Summary:
We'll be adding the new periodic file updates task to run in parallel. This patch
moves the existing one to make it clear it's running on buildbot, so we don't get confused
later on.

Reviewers: Callek

Reviewed By: Callek

Bug #: 1436369

Differential Revision: https://phabricator.services.mozilla.com/D681
***
Bug 1436369 Add taskcluster periodic file updates r=callek

Reviewers: Callek

Reviewed By: Callek

Differential Revision: https://phabricator.services.mozilla.com/D683
***
Bug 1436469 Fix task definition r=callek
***
Bug 1436469 Move periodic-file updates docker image r=callek
2018-03-06 15:27:58 +00:00
Ken VanDine
59ce8189f2 Bug 1443736 - Improved mechanism for handing opening files after downloading with snap r=jlorenzo
MozReview-Commit-ID: 6WR2HBJRlBy
2018-03-07 08:26:48 +00:00
Johan Lorenzo
ade89a8466 Bug 1443419 - Extract gtk30.mo files from all the Ubuntu langpacks and bundle them into the snap. p=kenvandine r=sfraser
MozReview-Commit-ID: JB2PojGgike
2018-03-07 18:54:54 +01:00
Ken VanDine
476acd67e2 Bug 1443522 - Fix mime cache generation which was breaking themes r=jlorenzo
MozReview-Commit-ID: 52jjK66U7iO
2018-03-06 15:28:06 +00:00
Tiberius Oros
023aba83eb Backed out changeset 32c3c20fd489 (bug 1443419) for shell failure on shell failure on /firefox-snap/runme.sh:53 on CLOSED TREE 2018-03-06 15:25:37 +02:00
Ken VanDine
c2747ef69b Bug 1443419 - Extract gtk30.mo files from all the Ubuntu langpacks and bundle them into the snap. r=jlorenzo
MozReview-Commit-ID: BGioikt15CL
2018-03-06 09:15:26 +00:00
Johan Lorenzo
bc5ee68e27 Bug 1443144 - part2: Fix bad shell quotes r=sfraser a=RyanVM
MozReview-Commit-ID: BD8NTgd1Xgq
2018-03-05 16:33:19 +01:00
Ken VanDine
7fb740653f Bug 1443144 - Fix snap build failure caused by files not being copied into ${WORKSPACE} r=jlorenzo
MozReview-Commit-ID: KF1ZH9jZGOf
2018-03-05 14:32:26 +00:00
Ken VanDine
ba43beabec Bug 1442419 - Fix failure to open files after downloading with snap r=jlorenzo
This fix does several things:
 * Removes the mime cache generated by the desktop-gtk3 remote part
 * Installs a stub shared-mime-info database
 * Set default association for all types to use xdg-open

Note: There is still work[1] to be completed in snapd, adding OpenFile
support to xdg-open.  Landing this is harmless though, it will fail
silently just as it does today but will start working when the snapd
feature lands.

1. https://github.com/snapcore/snapd/pull/4766
opening requested files,

MozReview-Commit-ID: 1eeOLeVN8xQ
2018-03-01 22:02:21 +00:00
Ken VanDine
8714de2487 Bug 1441920 - Run update-mime-database at the end of the build rather than on startup of the snap r=jlorenzo
MozReview-Commit-ID: 8Fu1A8LsLSr
2018-02-28 17:44:00 +00:00
Ken VanDine
003e149060 Bug 1441884 - Add network-observe to plugs in snap r=jlorenzo
MozReview-Commit-ID: FZ5yOvnwmaF
2018-02-28 16:09:04 +00:00
Ken VanDine
681121a399 Bug 1441822 - Add upower-observe to plugs in snap r=jlorenzo
MozReview-Commit-ID: FqJ9lC9PwRF
2018-02-28 15:53:29 +00:00
Johan Lorenzo
10e3a2a5bb Bug 1411559 - Snap: Add upload on mozilla-release and restrict channels r=sfraser
MozReview-Commit-ID: DHszbMhpFKI
2018-02-28 14:50:28 +01:00
Henrik Skupin
78b5ab706f Bug 1443437 - Pre-build font cache for Firefox i386 binaries on x86_64 systems. r=jmaher
In automation for both Linux and Linux64 the same docker image is used,
which is based on Ubuntu 16.04 64bit. To run the 32bit Firefox binary
the necessary libraries for the i386 architecture get installed.

What's missing is the creation of the font cache for i386 binaries. As
such it will be created at the first start of the appropriate application.
It means there is an additional ~30s delay before Firefox opens, which
causes several test failures especially for wdspec tests.

To prevent this delay the i386 version of fontconfig will be installed
and apt automatically creates the font cache for the i386 architecture
by leaving the x86_64 cache in-place.

So the cache creation will happen one time  when the docker image is getting
build, and not for each and every test job, which saves us 30s for each.

MozReview-Commit-ID: 58xdOI4xYkP
2018-03-07 11:48:26 +01:00
Simon Fraser
fb801d4488 Bug 1436369 Add docker entrypoint for periodic file udpates r=catlee
MozReview-Commit-ID: 4c8bMADQg4t
2018-02-21 11:18:32 +00:00
Simon Fraser
12922eea98 Bug 1436369 Migrate HSTS and HPKP update scripts to docker image r=keeler
MozReview-Commit-ID: 6N7PqYsAXup
2018-02-21 11:04:24 +00:00
Simon Fraser
72fffedca6 Bug 1436369 Docker image for periodic file updates r=catlee
MozReview-Commit-ID: E6OFCGBTttX
2018-02-21 10:45:01 +00:00
Tom Ritter
bdd914d3ff Bug 1439726 Add patch to the MinGW Dockerfile r=glandium
MozReview-Commit-ID: DIzDSnNHzfM
2018-02-20 14:09:07 -06:00
Ben Hearsum
5c17f8cad9 bug 1398799: upgrade update verify docker image to Ubuntu 17.10. r=gps 2018-02-20 12:41:44 -05:00
Simon Fraser
e85e6b3af1 Bug 1438415 Re-order mbsdiff hook to allow exit values r=catlee
MozReview-Commit-ID: 9Z3DMyarcpt
2018-02-15 21:59:15 +00:00
Michael Kaply
30efa7adc0 Bug 1436468 - Send downloads to the correct directory. r=jlorenzo
MozReview-Commit-ID: LSPNgFOjQhz
2018-02-07 12:46:53 -06:00
Johan Lorenzo
f3babf240a Bug 1436445 - Use icon included in the snap r=mkaply
MozReview-Commit-ID: BXl5TghQpRx
2018-02-12 10:31:25 +01:00
Simon Fraser
51b860239a Bug 1437473 Don't cache smaller partials diffs r=mtabara
MozReview-Commit-ID: 7pYvEgRD382
2018-02-12 11:02:17 +00:00
Simon Fraser
03f340e3b9 Bug 1436994 Collect S3 cache hit/miss data for partials r=rail
MozReview-Commit-ID: GQfPglY5ovz
2018-02-09 16:19:20 +00:00
Tom Prince
477d908766 Bug 1426445: Add sanity check that worker uid/gid is 1000 in run-task; r=dustin,gps
MozReview-Commit-ID: 7T7rQpLhJIN
2018-01-02 14:22:36 -07:00