corysanin/tubestation
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
861,779 Commits 1 Branch 0 Tags
c4167a3cc664ca4001b8fab535de63a901bef5a0
Commit Graph

25 Commits

Author SHA1 Message Date
Geoff Brown
f97c1d2806 Bug 1896894 - Enable basic treeherder error formatting for A-C ui-tests r=aaronmt 
When running A-C ui-tests, use the same error parsing and formatting strategy used for focus and fenix.

Differential Revision: https://phabricator.services.mozilla.com/D210578
 2024-05-21 13:28:17 +00:00
Geoff Brown
4939eda588 Bug 1881094 - 2. remove whitespace exclusions for firefox-android r=android-reviewers,gl 
Whitespace changes made with `mach lint --fix`.

Differential Revision: https://phabricator.services.mozilla.com/D206702
 2024-04-04 22:19:32 +00:00
Geoff Brown
bd90c4e64e Bug 1886173 - Make --report-treeherder-failures a boolean flag r=jcristau,android-reviewers,Roger 
Differential Revision: https://phabricator.services.mozilla.com/D205075
 2024-03-19 15:51:04 +00:00
Geoff Brown
7f6f937c20 Bug 1882087 - Improve ui-test failure messages for treeherder r=aaronmt 
Recall that `test-lab.py` uses `parse-ui-test.py` and `parse-ui-test-fromfile.py` to parse test results, depending on the test type. `parse-ui-test-fromfile` can produce better failure messages, including the test class and test name.

The strategy here is to first run `parse-ui-test-fromfile` (subject to test type, as before), noting whether it produced a treeherder-friendly failure message; then run `parse-ui-test` (for all tests, as before) passing a new argument to print any failures in the treeherder-friendly way, only if `parse-ui-test-fromfile` did not report failures. Most of the complexity is to avoid duplicate reporting, favouring the more granular failure messages from `parse-ui-test-fromfile`.

Differential Revision: https://phabricator.services.mozilla.com/D204684
 2024-03-18 18:40:51 +00:00
Geoff Brown
43bbbb0609 Bug 1882087 - Format ui-test failure messages for treeherder. r=aaronmt,tthibaud,android-reviewers,aryx 
Example: https://treeherder.mozilla.org/logviewer?job_id=450541238&repo=try
```
TEST-UNEXPECTED-FAIL | failure | https://console.firebase.google.com/project/moz-fenix/testlab/histories/bh.66b7091e15d53d45/matrices/8658376039685060316 | 1 test cases failed, 589 passed
```
That's an unconventional and suboptimal error message, but it's the only information that I see readily available; hopefully someone can improve on this in the future.

Differential Revision: https://phabricator.services.mozilla.com/D204207
 2024-03-08 22:21:38 +00:00
Geoff Brown
e21a50229a Bug 1843157 - Correct link to Mobile Test Engineering (https://github.com/mozilla-mobile/firefox-android/pull/2854) 
Co-authored-by: dsmithpadilla <88508950+dsmithpadilla@users.noreply.github.com>
 2023-07-18 03:31:42 +00:00
Geoff Brown
95bdefe22a Bug 1825116 - Reformat some python files with black and avoid 'bare except' ruff warnings 2023-07-13 00:53:55 +00:00
Aaron Train
c17de6b4a5 No issue: Add matrix parsing markdown to UI checks 2022-11-14 15:52:39 +00:00
Aaron Train
41cc667597 No issue: Try Pixel2 (ARM) on Firebase Test Lab 2022-11-09 14:24:27 +00:00
Aaron Train
23563a9048 No issue: Update Flank Configs (https://github.com/mozilla-mobile/firefox-android/pull/117) 
* Bug 1797997 - part 8: Fix nit on event name

* No issue: Update Flank Configs

Co-authored-by: Johan Lorenzo <jlorenzo@mozilla.com>
 2022-11-07 18:58:35 +00:00
Aaron Train
f55f83c395 [components] For https://github.com/mozilla-mobile/android-components/issues/10406 - Expose Flank results as public artifacts 
fix: typo

fix: typo

Fix: Change artifacts path in kind.yml

Fix: Remove old copying artifacts step
 2021-06-02 20:33:54 +00:00
Sebastian Kaspari
e809a01c58 [components] Issue https://github.com/mozilla-mobile/android-components/issues/10070: Update ui-test.sh. 2021-04-20 18:51:39 +00:00
Aaron Train
11bb07981d [components] Update flank-arm.yml 2020-08-20 09:57:57 -04:00
MozLando
a992244373 [components] Merge https://github.com/mozilla-mobile/android-components/pull/7160 https://github.com/mozilla-mobile/android-components/pull/7196 (part 2) 
7160:  Closes https://github.com/mozilla-mobile/android-components/issues/7142: Sanitize url in HttpIconLoader  r=pocmo a=Amejia481



7196: Closes https://github.com/mozilla-mobile/android-components/issues/7176: Add to the configuration file for instrumentation tests components that use Room r=gabrielluong,pocmo,isabelrios a=Amejia481

Closes https://github.com/mozilla-mobile/android-components/issues/7176


Co-authored-by: Arturo Mejia <arturomejiamarmol@gmail.com>
 2020-06-03 14:55:40 +00:00
Grisha Kruglov
bc629b3229 [components] Run ui-samples-browser on API21 2020-06-02 18:29:48 -07:00
Arturo Mejia
c6db6fde88 [components] Add to the configuration file for instrumentation tests 
components that use Room
 2020-05-31 22:25:21 -04:00
Aaron Train
7fffafe121 [components] Closes https://github.com/mozilla-mobile/android-components/issues/6550: Update Flank templates to use single and same device 2020-04-06 16:20:13 -04:00
isabelrios
f3337375f4 [components] address reviwer comments 2020-04-02 15:59:15 +02:00
isabelrios
483351f61f [components] testing-branch-issue-3652 2020-04-02 15:59:15 +02:00
Johan Lorenzo
5aac7c3a63 [components] Bug 1583870 - Migrate ui-test task 2019-10-02 11:35:36 +02:00
Sebastian Kaspari
d31f9dfaa5 [components] Closes https://github.com/mozilla-mobile/android-components/issues/4280: Use universal GeckoView build in browser-engine-gecko. 2019-09-04 15:42:12 +02:00
Sebastian Kaspari
e494614bd3 [components] ui-test.sh: Add --json argument. 2019-06-07 11:33:48 +02:00
Richard Pappalardo
af3f337c1d [components] Fix UI test job error trigger 2019-06-03 14:32:35 -07:00
Sebastian Kaspari
3d5e9c3bab [components] Issue https://github.com/mozilla-mobile/android-components/issues/1447 - Depend on "fat" GeckoView build from browser-engine-gecko-nightly. 2019-06-03 18:04:20 +02:00
Richard Pappalardo
0b5ea8bcd1 [components] Add UI tests to taskcluster (WIP) 2019-05-21 09:35:13 -04:00