Commit Graph

275 Commits (iceraven)

Author SHA1 Message Date
akliuxingyuan 75f90e48e6 Merge remote-tracking branch 'origin/fenix/113.0' into iceraven 1 year ago
Aaron Train 85aa34f11b Bug 1831628 - Swap COR-L29 Android Device in Flank configs 1 year ago
akliuxingyuan e95c430d11 Merge remote-tracking branch 'origin/fenix/112.0' into iceraven 1 year ago
AndiAJ ac88dd38c5 Bug 1827192 - Move main menu items related UI tests to a new class 1 year ago
Aaron Train 4125023a64 Bug 1825279 - Remove dreamlte device in legacy test configuration 1 year ago
akliuxingyuan 06c0bd88d8 migration 1 year ago
AndiAJ f784c2edc7 Bug 1825548 - Revert removal of dreamlte in legacy test configuration 1 year ago
Aaron Train 89afac341e Bug 1825015 - Remove dreamlte in legacy test configuration 1 year ago
Aaron Train 11db8a0b9d Bug 1820036 - Add Matrix labeling on Firebase Test Lab 1 year ago
Aaron Train a3b65617a6 Bug 1817250 - Add/Enable Robo Test on Firebase Test Lab 1 year ago
Francesco Lodolo ca4cf21be7 Bug 1816906 - Remove filter-incomplete-translations and clean up obsolete localization files
- Removed filter and associated code from TaskCluster
- Removed fenix/l10n-release.toml
- Removed android2po references from Focus for Android
1 year ago
Aaron Train 0824a0f4d0 Bug 1817003 - Remove low capacity ARM device on FTL 1 year ago
Aaron Train b9e1ecc33d [fenix] Bug 1813628 - Adjust shard count for debug UI tests 1 year ago
Aaron Train 83046224d0 [fenix] No issue: Update flank-arm-legacy-api-tests.yml
Removes org.mozilla.fenix.ui.HomeScreenTest#homeScreenItemsTest for recently failing
1 year ago
AndiAJ a8df7dfe3c [fenix] Bug 1812255 - Reduce UI tests max timeouts 1 year ago
Aaron Train b0b2bc5dc9 [fenix] Bug 1811045 - Expand device and scheduling for legacy Android testing cron 1 year ago
Aaron Train d57dc82a73 [fenix] Bug 1810204 - Schedule legacy Android API Cron for test coverage 1 year ago
Aaron Train aa6fa50e18 [fenix] No issue: Fix for None key-pair in Flank client-details
Remove URL construction
2 years ago
Aaron Train c311d23760 [fenix] No issue: Add source commit pair to Flank client-details flag 2 years ago
sv-ohorvath 169d4c944f [fenix] No issue: remove sdk suppression tests tags for API28 and unschedule cron job 2 years ago
Aaron Train 382fb20cb5 [fenix] No issue: Adjust shard count in legacy/nightly/beta UI test jobs 2 years ago
Aaron Train 95e632c11f [fenix] For https://github.com/mozilla-mobile/fenix/issues/26792 - Change active Firebase Test Lab emulator from x86 to ARM (https://github.com/mozilla-mobile/fenix/pull/26793)
* For https://github.com/mozilla-mobile/fenix/issues/26792 - Change active Firebase Test Lab emulator from x86 to ARM

Update startup-test kind.yml Jobs for ARM
Update ui-test kind.yml Jobs for ARM
Cleans up and renames Flank configurations for ARM
Updates ui-test.sh for ARM

* Fix BookmarksTest.kt and HomeScreenTest.kt

* Fix intent matcher for SettingsAboutTest

Adds a helper function for Play Store intent

* Fix SettingsSearchTest.kt

* ktlint fix TestHelper.kt and SettingsRobot.kt
2 years ago
sv-ohorvath 48135af917 [fenix] No issue: increase flaky tests attempts on Nightly tests 2 years ago
Julien Cristau 7672b99ec4 [fenix] Let relbot update A-C on trunk (https://github.com/mozilla-mobile/fenix/pull/26553)
* Let relbot update A-C on trunk

We already use relbot for this on fenix release branches and on all
branches for focus-android, so might as well avoid the duplication.

* Update mergify rules to auto-merge AC bumps from relbot on the main branch
2 years ago
Julien Cristau 5d1e66458c [fenix] update_android_components: don't create an empty PR if we couldn't push 2 years ago
sv-ohorvath 7d442af6d6 [fenix] Issue https://github.com/mozilla-mobile/fenix/issues/25972, https://github.com/mozilla-mobile/fenix/issues/25971: reduce test failures with more retries on legacy-api-tests 2 years ago
Aaron Train b7b938f96f [fenix] No issue: Add new cron target task for legacy API UI tests
Setups up a new daily cron task to run select UI tests on API 28 (we’ll call it legacy). We don’t necessarily want to invoke Flank twice (serial) with a different configuration (FTL APIs dont support API splitting per test-target) on event CI but we do want them running elsewhere (cron).
2 years ago
sv-ohorvath 51a694869d [fenix] Move collections tests to CollectionTest class 2 years ago
Aaron Train 0aa4769862 [fenix] Upgrade AndroidX Espresso Deps and support API 30 (https://github.com/mozilla-mobile/fenix/pull/23904) 2 years ago
Oana Horvath bb4a179078 [fenix] Re-organize existing tests to their own SettingsSearchTest class 2 years ago
Aaron Train 4d0237797d [fenix] No issue: Update references and doc in parse-ui-test.py (https://github.com/mozilla-mobile/fenix/pull/23354)
* No issue: Update references and doc in parse-ui-test.py

* Update parse-ui-test.py

* Clean up device data

* Revert device output

* Update parse-ui-test.py

* Update parse-ui-test.py

* Update parse-ui-test.py

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2 years ago
Aaron Train d2944ccdd7 [fenix] No issue: Add shared docs/team links to parse-ui-test.py 2 years ago
AndiAJ 8722950d3b [fenix] Improve homeThreeDotMenuItemsTest UI test coverage 3 years ago
Aaron Train 214d88f7c2 [fenix] Closes https://github.com/mozilla-mobile/fenix/issues/21340: Disable auto Google login in Flank config (https://github.com/mozilla-mobile/fenix/pull/21341) 3 years ago
Aaron Train f2fe9ae61d [fenix] Filter out test target packages in Flank-x86 (https://github.com/mozilla-mobile/fenix/pull/20841)
* Filter out test target packages in Flank-x86
* Ignore verifyRunBlockingAndStrictModeSuppresionCount
3 years ago
Stefan Arentz 1480a5292b [fenix] Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main (https://github.com/mozilla-mobile/fenix/pull/20457)
* Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main (Automation/TC)

* Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main (GitHub Workflows)

* Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main (GitHub Workflows)

* Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main (GitHub Issue Templates)

* Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main (Jenkins)

* Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main (README & Documentation)

* Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main (Jenkins)

* Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main (Random)
3 years ago
Aaron Train ba24312a8e [fenix] No issue: Update Flank to v21.07.1 (https://github.com/mozilla-mobile/fenix/pull/20456)
* Update Flank to v21.07.1
* Update approach to downloading Flank
* Update parse-ui-test.py
3 years ago
Aaron Train 4e7c93e6f6 [fenix] Test full-junit-result in Flank config (https://github.com/mozilla-mobile/fenix/pull/19897) 3 years ago
Aaron Train 17689b2d5d [fenix] Add matrix outcome details to parse-ui-test.py (https://github.com/mozilla-mobile/fenix/pull/19900) 3 years ago
Sebastian Kaspari 3a4b0e5ac7 [fenix] update_android_components.sh: Watch different component.
`browser-engine-gecko-nightly` doesn't exist anymore. Let's watch `browser-engine-gecko` instead.
3 years ago
Aaron Train 4b5f161e30 [fenix] No issue: test one shard per UI test on FTL (https://github.com/mozilla-mobile/fenix/pull/18998) 3 years ago
Oana Horvath bde6bb8f56 [fenix] Added UI smoke tests to run on Beta builds. 3 years ago
Oana Horvath a862baeda2 [fenix] Add first set of UI tests to Nightly 3 years ago
isabelrios 4523d2bfae [fenix] Taskgraph changes to allow running UI tests on nightly builds (https://github.com/mozilla-mobile/fenix/pull/18191)
* Modify taskgraph to allow running UI tests on Nightly builds

* adding try_task_config file

* remove try_task_config file
3 years ago
Mugurell 22ec6af4a3 [fenix] For https://github.com/mozilla-mobile/fenix/issues/17195 - Don't try setting an idle resource if the View is already off screen
Speculative fix based on the Firebase logs which shows that on a second check
of R.id.tab_wrapper it is not found the screen.
It may be because after `advanceToHalfExpandedState` and before getting a
reference to it in `waitForTabTrayBehaviorToIdle` it was already animated off
the screen.
With this in mind I've added a null check for the view reference before trying
to register an idling resource on it's Behavior.

Also added and used a way to click at a specific location in a View, not just
in the default middle in the View.
It was observed from the Firebase videos that a "click" on the topBar actually
selected the private tabs section. This would leave us to believe that the
"click" was caught by that other View which was placed above the x,y middle of
the topBar.
3 years ago
Mugurell e16ef0b3c6 [fenix] For https://github.com/mozilla-mobile/fenix/issues/17195 - Test a potential fix for the test 3 years ago
isabelrios 0b3f9aec8a [fenix] Revert "Add UI tests nightly build (https://github.com/mozilla-mobile/fenix/pull/17948)" (https://github.com/mozilla-mobile/fenix/pull/17960)
This reverts commit 02c08b3f6cba7d7c05322a91d31f887d39ba0160.
3 years ago
isabelrios b81a83b815 [fenix] Add UI tests nightly build (https://github.com/mozilla-mobile/fenix/pull/17948)
* Try adding UI Tests to Nightly build

* adding try_config file

* remove try_task_config
3 years ago
isabelrios a35b7e900b [fenix] Revert "Run UI tests nightly def (https://github.com/mozilla-mobile/fenix/pull/17513)" (https://github.com/mozilla-mobile/fenix/pull/17761)
This reverts commit 00d442ee4ab944cbeab0f357a5f7b69e29fd9237.
3 years ago
isabelrios e4ff93f889 [fenix] Run UI tests nightly def (https://github.com/mozilla-mobile/fenix/pull/17513)
* run-ui-test-nightly

* Run ui tests on nightly build

* set correct number of shard according to tests running

* fix typo

* removing testing file

Co-authored-by: isabel rios <isabelrios@MBP-de-isabel-2.home>
3 years ago
isabelrios 0f6e44f7bc [fenix] Changes to run tests on beta builds (https://github.com/mozilla-mobile/fenix/pull/16786)
* Changes to run tests on beta builds

* remove dontoptime and fix bookmarks tests

* fix ktlint and smokeTest

* add variable for package name

* rebase and fix conflicts

* add yml files and modify script to run tests

* fix yml file indentation

* changes in kind file and add try_task

* fix error kind file

* fix error kind file 2

* fix error kind file 3

* fix reviewer comments

* remove mockwebserver implementation as per reviewer comment

* run beta tests only on releases branches

* reg exp for master branch

* reg exp for master branch2

* modify try_task with release branch

* remove try file

* let's start by running only one test

* address latest reviewers comments

* double check correct tasks for release branch

* remove try file after confirming beta build run

Co-authored-by: isabel rios <isabelrios@MBP-de-isabel-2.home>
3 years ago
Sebastian Kaspari 2875338740 [fenix] Simplify build variants to just: debug, nightly, beta and release.
Co-authored-by: Johan Lorenzo <jlorenzo@mozilla.com>
4 years ago
Kainalu Hagiwara 5fe4feda53 [fenix] For https://github.com/mozilla-mobile/fenix/issues/13066 - Translate locale codes to Android specific variants before filtering 4 years ago
Kainalu Hagiwara 0d977a5e2d [fenix] Move release locales to a separate config file.
We should leave l10n.toml untouched unless the l10n team wants to
change it.
4 years ago
Kainalu Hagiwara 703edac9c5 [fenix] For https://github.com/mozilla-mobile/fenix/issues/12759 - Keep a separate list of release locales. 4 years ago
isabelrios 18b3fb95b4 [fenix] cron-job-ui-screenshots (https://github.com/mozilla-mobile/fenix/pull/12423)
Co-authored-by: isabel rios <isabelrios@MacBook-Pro-de-isabel-2.local>
4 years ago
Tiger Oakes 64e1a079ea [fenix] For https://github.com/mozilla-mobile/fenix/issues/11886 - Re-enable codecov (https://github.com/mozilla-mobile/fenix/pull/12258)
* Re-enable codecov

* Use local script

* Revert to old codecov script
4 years ago
Richard Pappalardo ffba3b3570 [fenix] Fixes https://github.com/mozilla-mobile/fenix/issues/11050 - Remove Nimbledroid 4 years ago
Aaron Train d4c5bdaee9 [fenix] Closes https://github.com/mozilla-mobile/fenix/issues/10611 - Fix exit status of Flank (https://github.com/mozilla-mobile/fenix/pull/10612) 4 years ago
Aaron Train 6c58867065 [fenix] No issue: remove listing directory contents on UI test results (https://github.com/mozilla-mobile/fenix/pull/10354) 4 years ago
Alessio Placitelli 970516c468 [fenix] Trigger UI test 4 years ago
Richard Pappalardo 2593abc7b1 [fenix] Fixes https://github.com/mozilla-mobile/fenix/issues/6760 - Show UI test results in TC task (https://github.com/mozilla-mobile/fenix/pull/10089) 4 years ago
Aaron Train 789ee895a6 [fenix] No issue: Set all Flank templates to one AVD (https://github.com/mozilla-mobile/fenix/pull/9745) 4 years ago
Aaron Train ff77588851 [fenix] No issue: Restore num-flaky-test-attempts in flank-x86.yml (https://github.com/mozilla-mobile/fenix/pull/9675) 4 years ago
Aaron Train fc410e973e [fenix] No issue: remove num-flaky-test-attempts from all Flank templates (https://github.com/mozilla-mobile/fenix/pull/9635) 4 years ago
Aaron Train b6f578da39 [fenix] Closes https://github.com/mozilla-mobile/fenix/issues/9433: Update Flank version in ui-tests Dockerfile (https://github.com/mozilla-mobile/fenix/pull/9466)
fix: flank_snapshot requires direct shard value

-1 shards -> 50 shards

fix: adjust flank-x86.yml shard value

try old results generator in flank-x86.yml

fix: legacy-junit-report -> legacy-junit-result

revert to modern reporting
4 years ago
Richard Pappalardo 23e57053da [fenix] Closes https://github.com/mozilla-mobile/fenix/issues/9469 - Change UI test failure output 4 years ago
Johan Lorenzo 357e8c6488 [fenix] Bug 1620190 - Run android-components bumps once a day (https://github.com/mozilla-mobile/fenix/pull/9251) 4 years ago
Aaron Train 5aad0aaf8c [fenix] No issue: Swap AVD (x86) Nexus 6 (API 25) with a Nexus6P (API 27) (https://github.com/mozilla-mobile/fenix/pull/9259)
The Nexus 6 (x86 AVD) on API 25 is causing too many instablility issues. Let’s see what happens with a Nexus 6P on API 27.
4 years ago
Johan Lorenzo 93f2c58d76 [fenix] Bug 1608103 - Fix dummy secrets generation (https://github.com/mozilla-mobile/fenix/pull/8855) 4 years ago
Johan Lorenzo 82cebdbb33 [fenix] Make nimbledroid not depend on a real token on staging releases (https://github.com/mozilla-mobile/fenix/pull/7570) 4 years ago
Severin Rudie a7aa2c0074 [fenix] 3088 filter locales 2nd try (https://github.com/mozilla-mobile/fenix/pull/7839)
* For https://github.com/mozilla-mobile/fenix/issues/3088: filter incomplete locales in release builds

* For 3088: update locale filtering to not error on nightly builds
4 years ago
Sebastian Kaspari 866eac2ca4 [fenix] Revert "3088 filter incomplete locales on release builds (https://github.com/mozilla-mobile/fenix/pull/7581)" (nightly build errors)
This reverts commit 313f536a440cf8920c87b6c8e01f441ce7543259.
4 years ago
Severin Rudie e1fe294e71 [fenix] 3088 filter incomplete locales on release builds (https://github.com/mozilla-mobile/fenix/pull/7581)
* For https://github.com/mozilla-mobile/fenix/issues/3088: add translation pruning Py scripts from Focus

The only change made was updating "Focus/Klar" to "Fenix"

* For 3088: call translation pruning scripts during release builds

* For 3088: fix filter-release-translations.py

Moving it into Fenix introduced one additional layer of nesting, which was not accounted for in a relative path.  🤦

* For 3088: comment about the risks of modifying source

* For 3088: updated locales.py to read from l10n.toml

Also removed some previously unused properties from locales.py

* For 3088: added error handling to script in locales.py

* For 3088: updated locale parser per review comments
4 years ago
Sawyer Blatz a5f8a5b415 [fenix] For https://github.com/mozilla-mobile/fenix/issues/6666: Adds back button to search screen 5 years ago
Emma Malysz f7d91c6343 [fenix] For perf-frontend-issueshttps://github.com/mozilla-mobile/fenix/issues/16: switch device_config parameter for Nimbledroid to be Android7 (https://github.com/mozilla-mobile/fenix/pull/6985)
* For perf-frontend-issueshttps://github.com/mozilla-mobile/fenix/issues/16: specify device_config parameter to be 'android7' when running Nimbledroid tests. This will switch the tests from running Android5 to Android7, which is a better representation of our user's experience

* Ensure we can test with both Android5 and Android7
5 years ago
Severin Rudie 8f7ef29cd2 [fenix] No issue: fix broken fetch in PrintMentionedIssuesAndPrs.kts (https://github.com/mozilla-mobile/fenix/pull/7258) 5 years ago
Richard Pappalardo a6231458fc [fenix] Add Nightly startup-test (https://github.com/mozilla-mobile/fenix/pull/6569) 5 years ago
Severin Rudie aead3da4e4 [fenix] No issue: add script for compiling closed issues from commit history (https://github.com/mozilla-mobile/fenix/pull/6509) 5 years ago
Johan Lorenzo 702121bdcf [fenix] Make nimbledroid compliant to UI tests 5 years ago
Johan Lorenzo 8eef026200 [fenix] Split UI test 5 years ago
MozLando ef0e2bdbe8 [fenix] Merge https://github.com/mozilla-mobile/fenix/pull/6115
6115: Clean up automation folder from what was used by the old decision task r=mitchhentges a=JohanLorenzo



Co-authored-by: Johan Lorenzo <jlorenzo@mozilla.com>
5 years ago
Richard Pappalardo 1839ce12f1 [fenix] Add verify items tests for settings menus 5 years ago
Johan Lorenzo 23f92d4f26 [fenix] Clean up automation folder from what was used by the old decision task 5 years ago
isabelrios a161afd41e [fenix] Fix TC error and run only ui tests 5 years ago
Richard Pappalardo 622e605f52 [fenix] Temporarily disable findInPage UI test (https://github.com/mozilla-mobile/fenix/pull/5620) 5 years ago
Johan Lorenzo e8573e3d2f [fenix] Bug 1580778 - Raptor: put ytp exceptions back 5 years ago
Johan Lorenzo a9dad8ba08 [fenix] Bug 1580778 - Migrate build tasks to taskgraph and retire the old decision task (https://github.com/mozilla-mobile/fenix/pull/5488) 5 years ago
Johan Lorenzo e510715efb [fenix] Bug 1580778 - Migrate lint and ui-test tasks to taskgraph (https://github.com/mozilla-mobile/fenix/pull/5430) 5 years ago
Richard Pappalardo 867b6485ee [fenix] Move UI tests to x86 devices on Firebase (https://github.com/mozilla-mobile/fenix/pull/5463) 5 years ago
Richard Pappalardo 62a25a8d6e [fenix] Fixes https://github.com/mozilla-mobile/fenix/issues/5438 - Upgrade UI test devices to prevent slowdowns in test lab (https://github.com/mozilla-mobile/fenix/pull/5439)
* Fixes https://github.com/mozilla-mobile/fenix/issues/5438 - Upgrade UI test devices to prevent slowdowns in test lab

* fix: change api to supported version

* refactor: try x86 devices instead
5 years ago
Johan Lorenzo a43bb4644b [fenix] Bug 1580778 - Migrate nimbledroid task to taskgraph (https://github.com/mozilla-mobile/fenix/pull/5408) 5 years ago
Johan Lorenzo 3f5bb4f0c4 [fenix] Bug 1580778 - Migrate signing tasks to taskgraph (https://github.com/mozilla-mobile/fenix/pull/5409) 5 years ago
Jonathan Almeida 8d8adae0f1 [fenix] No issue: Add Digital Asset Links token for TWAs 5 years ago
Johan Lorenzo b33f4bfde7 [fenix] Bug 1580778 - Migrate push-apk tasks to taskgraph (https://github.com/mozilla-mobile/fenix/pull/5377) 5 years ago
Johan Lorenzo 8b05dd0e0d [fenix] Bug 1580778 - Migrate raptor tests to taskgraph (https://github.com/mozilla-mobile/fenix/pull/5361) 5 years ago
Johan Lorenzo 628d53afd8 [fenix] For https://github.com/mozilla-mobile/fenix/issues/5369 - Fix push() call in old decision task (https://github.com/mozilla-mobile/fenix/pull/5373) 5 years ago
Johan Lorenzo eda4aeeb4e [fenix] Run UI tests on PRs (https://github.com/mozilla-mobile/fenix/pull/5011) 5 years ago
Johan Lorenzo 73a1dd17a9 [fenix] Bug 1580778 - Fix Nightly decision graph part 2 (https://github.com/mozilla-mobile/fenix/pull/5353) 5 years ago
Johan Lorenzo 521fd009c0 [fenix] Try to fix taskcluster-github broken PRs (https://github.com/mozilla-mobile/fenix/pull/5354) 5 years ago