corysanin/tubestation
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Bug 1874900 - Add taskcluster configs and enable speedometer for the Samsung S21s. r=perftest-reviewers,afinder,sparky

Browse Source 
As a part of our performance strategy we are expanding the devices we run performance tests on
In this patch we are adding the S21 taskcluster definitions and the ability to run speedometer and speedometer3 on those devices

Differential Revision: https://phabricator.services.mozilla.com/D198721
This commit is contained in:
andrej
2024-02-12 13:00:04 +00:00
parent 19fa5ca157
commit 1ea93a33cb
7 changed files with 141 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
taskcluster/ci/test/browsertime-mobile.yml
View File

@@ -353,6 +353,7 @@ browsertime-benchmark-speedometer-mobile:
cstm-car-m:
by-test-platform:
android-hw-p6.*shippable-qr.*: []
android-hw-s21.*shippable-qr.*: []
default: [mozilla-central]
default: []
treeherder-symbol: Btime(sp)
@@ -380,6 +381,7 @@ browsertime-benchmark-speedometer3-mobile:
cstm-car-m:
by-test-platform:
android-hw-p6.*shippable-qr.*: []
android-hw-s21.*shippable-qr.*: []
default: [mozilla-central]
default: []
treeherder-symbol: Btime(sp3)

5
taskcluster/ci/test/test-platforms.yml
View File

@@ -498,3 +498,8 @@ android-hw-p6-13-0-android-aarch64-shippable-qr/opt:
build-platform: android-aarch64-shippable/opt
test-sets:
- android-hw-speedometer-tests
android-hw-s21-13-0-android-aarch64-shippable-qr/opt:
build-platform: android-aarch64-shippable/opt
test-sets:
- android-hw-speedometer-tests

2
taskcluster/gecko_taskgraph/target_tasks.py
View File

@@ -248,6 +248,8 @@ def accept_raptor_android_build(platform):
return False
if "p6" in platform and "aarch64" in platform:
return False
if "s21" in platform and "aarch64" in platform:
return False
if "a51" in platform:
return True

2
taskcluster/gecko_taskgraph/transforms/test/raptor.py
View File

@@ -277,6 +277,8 @@ def add_extra_options(config, tests):
extra_options.append("--device-name=p5_aarch64")
elif test_platform.startswith("android-hw-p6"):
extra_options.append("--device-name=p6_aarch64")
elif test_platform.startswith("android-hw-s21"):
extra_options.append("--device-name=s21_aarch64")
if test["raptor"].pop("run-visual-metrics", False):
extra_options.append("--browsertime-video")

5
taskcluster/gecko_taskgraph/transforms/test/worker.py
View File

@@ -164,6 +164,11 @@ def set_worker_type(config, tasks):
task["worker-type"] = "t-bitbar-gw-unit-p6"
else:
task["worker-type"] = "t-bitbar-gw-perf-p6"
elif test_platform.startswith("android-hw-s21"):
if task["suite"] != "raptor":
task["worker-type"] = "t-bitbar-gw-unit-s21"
else:
task["worker-type"] = "t-bitbar-gw-perf-s21"
elif test_platform.startswith("android-hw-a51"):
if task["suite"] != "raptor":
task["worker-type"] = "t-bitbar-gw-unit-a51"

1
taskcluster/gecko_taskgraph/try_option_syntax.py
View File

@@ -127,6 +127,7 @@ UNITTEST_PLATFORM_PRETTY_NAMES = {
"Android 13.0 Google Pixel 5 32bit": ["android-hw-p5-13.0-arm7"],
"Android 13.0 Google Pixel 5 64bit": ["android-hw-p5-13.0-android-aarch64"],
"Android 13.0 Google Pixel 6 64bit": ["android-hw-p6-13.0-android-aarch64"],
"Android 13.0 Samsung S21 64bit": ["android-hw-s21-13.0-android-aarch64"],
"Windows 10": ["windows10-64"],
}

124
testing/perfdocs/generated/raptor.rst
View File

@@ -3405,6 +3405,37 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
- ❌
.. list-table:: **test-android-hw-s21-13-0-android-aarch64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer-mobile-chrome-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer-mobile-fenix-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@@ -3763,6 +3794,37 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
- ❌
.. list-table:: **test-android-hw-s21-13-0-android-aarch64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer-mobile-chrome-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer-mobile-fenix-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@@ -4132,6 +4194,37 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
- ❌
.. list-table:: **test-android-hw-s21-13-0-android-aarch64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-fenix-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
@@ -4492,6 +4585,37 @@ Standard benchmarks are third-party tests (i.e. Speedometer) that we have integr
- ❌
.. list-table:: **test-android-hw-s21-13-0-android-aarch64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-fenix-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1