Commit Graph

23 Commits (fad6417c16a5533d57140f8786fd7071ca5766c7)

Author SHA1 Message Date
Dave Hunt b41082ac63 Bug 1670902 - Use WebRender platforms for Raptor performance tests 3 years ago
Dave Hunt df3dff5346 Bug 1701764 - Remove --no-conditioned-profile from Raptor tests now that they are disabled by default 3 years ago
Gregory Mierzwinski 7b1097e405
Bug 1699639 - Run browsertime tests in python3. (#18554)
This patch fixes an issue with the python version being used to run the browsertime tests.
3 years ago
Florin Strugariu 71d908b3ef Update taskcluster settings to use short names instead of indexes 3 years ago
Gregory Mierzwinski 401dd92ff4
Disable conditioned profiles in the fenix branch. (#17078) 4 years ago
Gregory Mierzwinski 647efa1b37
Bug 1670284 - Enable webrender for all tests and run a subset without webrender. (#16325)
* Enable webrender for all tests and run a subset without webrender.

* Run tests on PR.

* Change task labels for webrender-enabled tests.

* Move transform logic to after the main transform.

* Reformat group symbol.

* Check if extra field is empty.

* Try a different method for treeherder info.

* Fix up assignment issue.

* Reformat symbol field instead of groupSymbol.

* Add new task group to config.

* Change the platform name for webrender tasks.

* Undo testing changes.

* Undo platform naming changes.
4 years ago
Gregory Mierzwinski ff8e92bf20
Bug 1674186 - Use shippable platforms for Browsertime tests. (#16261)
* Use shippable platforms.

* Undo testing changes.
4 years ago
Gregory Mierzwinski fc8c91616c
Bug 1671415 - Remove 2019 youtube-playback tests. (#15918)
* Bug 1671415 - Remove 2019 youtube-playback tests.

* Run tests in PR.

* Undo testing changes.
4 years ago
alexandru-io e3fc2626b2
Bug 1654346 Add YTP 2020 tests (#14286) 4 years ago
gmierz b898965426 Undo test changes. 4 years ago
gmierz 0acfa992f2 Test vismet. 4 years ago
Johan Lorenzo 7e7d69cb8e
Bug 1652979 - Stop producing fennecNightly, fenixNightly and fenixBeta (#12225) 4 years ago
liuche db6e614d11
For #12240: Enable btime youtube-playback Fenix tests (#12760)
Co-authored-by: alexandru.ionescu <alexandru.ionescu@softvision.ro>
4 years ago
Gregory Mierzwinski ee0426e390
Bug 1642657 - Undo browsertime changes for nightly-simulation. (#11274)
* Undo browsertime changes for nightly-simulation.

* Make signing nightly-simulation run on all pushes.
4 years ago
Gregory Mierzwinski b936e1c077
Bug 1642657 - Add a per-commit fenix build that simulates the nightly. (#10821)
* Add new per-commit android-test build.

* Rename to nightly-simulation.

* Add treeherder group to the config file.

* Remove taskcluster index path and browsertime test.

* Add nightly-simulation to taskcluster indexes.
4 years ago
Johan Lorenzo 553b1ae42b
Bug 1627027 - part 2: Do not run perf tasks on Nd-gp graphs (#10681) 4 years ago
Gregory Mierzwinski fee37e4f12
Bug 1627027 - Use nightly Fenix variant instead of performancetest. (#10648) 4 years ago
gmierz d51f3121af Revert "Bug 1627027 - Use nightly Fenix variant. (#10265)"
This reverts commit d48784e646 for causing nightly cron failures.
4 years ago
Gregory Mierzwinski d48784e646
Bug 1627027 - Use nightly Fenix variant. (#10265)
* Use nightly Fenix variant.

* Run the tests in PR.

* Update visual-metrics scripts to include the similarity metrics.

* Use python3.5 in visual-metrics docker.

* Install wget in the docker.

* Use python3.6 hashes instead of python3.5.

* Undo run-visual-metrics.py python changes.

* Upgrade python setuptools version to 46.1.3.

* Add setuptools to transitive dependency list.

* Undo PR test changes.

* Remove setuptools install line and use requirements.txt instead.

* Undo PR test changes.

* Fix geckodriver artifact suffix.

* Test a browsertime task.

* Revert browsertime test.
4 years ago
Johan Lorenzo b7f650e31b
Bug 1632427 - Define artifact_prefix in browsertime task (#10151) 4 years ago
Gregory Mierzwinski b4a20f658d
Bug 1625971 - Add google-search-restaurants to pageload tests in browsertime. (#9622)
* Add google-search-restaurants to pageload tests in browsertime.

* Temporarily change the activity to pass tests.

* Change Raptor Fenix activity name.

* Remove test trigger for browsertime test.
4 years ago
Gregory Mierzwinski 2984e40db0
Bug 1624875 - Remove raptor tests and increase vismet tier to 2. (#9402)
* Remove raptor tests and increase vismet tier to 2.

* Remove aframe page load test.
4 years ago
Gregory Mierzwinski a457755388
Bug 1613483 - Add all Browsertime tests with visual metrics to Fenix repo. (#9087)
* Add visual-metrics docker type.

* Add required browsertime toolchain fetches.

* Add browsertime tests for technical and visual metrics.

* Run browsertime tests in a cron task.

* Run visual metrics on all browsertime tests.

* Use spaces instead of tabs, and resolve visual-metric nits.

* Enable browsertime on pull request for testing.

* Restrict PR tests to amazon on browsertime.

* First attempt using multi_dep.

* Add a primary dependency to browsertime.

* Try by not popping.

* Debug prints.

* Make one grouping per browsertime task.

* Try without the multi_dep transform.

* Delete dependent-tasks in visual-metrics transformer.

* Update setuptools installed and copy run-on-tasks-for.

* Use get when getting run-on-tasks-for.

* Add new pinned requirements.

* Try it.

* Set run-on-tasks-for properly.

* Remove print statement.

* Remove single_dep loader, and print statements.

* Remove run-on-tasks-for testing setting.

* Restart testing, and set user to root in visual-metrics Docker.

* Remove testing settings.

* Remove fetch-content from Docker.

* Change attributes grouping method.

* Run all tests as a check.

* Undo testing changes, and fix a bad test name.
4 years ago