382fb20cb5
[fenix] No issue: Adjust shard count in legacy/nightly/beta UI test jobs
2 years ago
95e632c11f
[fenix] For https://github.com/mozilla-mobile/fenix/issues/26792 - Change active Firebase Test Lab emulator from x86 to ARM ( https://github.com/mozilla-mobile/fenix/pull/26793 )
...
* For https://github.com/mozilla-mobile/fenix/issues/26792 - Change active Firebase Test Lab emulator from x86 to ARM
Update startup-test kind.yml Jobs for ARM
Update ui-test kind.yml Jobs for ARM
Cleans up and renames Flank configurations for ARM
Updates ui-test.sh for ARM
* Fix BookmarksTest.kt and HomeScreenTest.kt
* Fix intent matcher for SettingsAboutTest
Adds a helper function for Play Store intent
* Fix SettingsSearchTest.kt
* ktlint fix TestHelper.kt and SettingsRobot.kt
2 years ago
48135af917
[fenix] No issue: increase flaky tests attempts on Nightly tests
2 years ago
7d442af6d6
[fenix] Issue https://github.com/mozilla-mobile/fenix/issues/25972 , https://github.com/mozilla-mobile/fenix/issues/25971 : reduce test failures with more retries on legacy-api-tests
2 years ago
b7b938f96f
[fenix] No issue: Add new cron target task for legacy API UI tests
...
Setups up a new daily cron task to run select UI tests on API 28 (we’ll call it legacy). We don’t necessarily want to invoke Flank twice (serial) with a different configuration (FTL APIs dont support API splitting per test-target) on event CI but we do want them running elsewhere (cron).
2 years ago
51a694869d
[fenix] Move collections tests to CollectionTest class
2 years ago
0aa4769862
[fenix] Upgrade AndroidX Espresso Deps and support API 30 ( https://github.com/mozilla-mobile/fenix/pull/23904 )
2 years ago
bb4a179078
[fenix] Re-organize existing tests to their own SettingsSearchTest class
2 years ago
4d0237797d
[fenix] No issue: Update references and doc in parse-ui-test.py ( https://github.com/mozilla-mobile/fenix/pull/23354 )
...
* No issue: Update references and doc in parse-ui-test.py
* Update parse-ui-test.py
* Clean up device data
* Revert device output
* Update parse-ui-test.py
* Update parse-ui-test.py
* Update parse-ui-test.py
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2 years ago
d2944ccdd7
[fenix] No issue: Add shared docs/team links to parse-ui-test.py
3 years ago
8722950d3b
[fenix] Improve homeThreeDotMenuItemsTest UI test coverage
3 years ago
214d88f7c2
[fenix] Closes https://github.com/mozilla-mobile/fenix/issues/21340 : Disable auto Google login in Flank config ( https://github.com/mozilla-mobile/fenix/pull/21341 )
3 years ago
f2fe9ae61d
[fenix] Filter out test target packages in Flank-x86 ( https://github.com/mozilla-mobile/fenix/pull/20841 )
...
* Filter out test target packages in Flank-x86
* Ignore verifyRunBlockingAndStrictModeSuppresionCount
3 years ago
ba24312a8e
[fenix] No issue: Update Flank to v21.07.1 ( https://github.com/mozilla-mobile/fenix/pull/20456 )
...
* Update Flank to v21.07.1
* Update approach to downloading Flank
* Update parse-ui-test.py
3 years ago
4e7c93e6f6
[fenix] Test full-junit-result in Flank config ( https://github.com/mozilla-mobile/fenix/pull/19897 )
3 years ago
17689b2d5d
[fenix] Add matrix outcome details to parse-ui-test.py ( https://github.com/mozilla-mobile/fenix/pull/19900 )
3 years ago
4b5f161e30
[fenix] No issue: test one shard per UI test on FTL ( https://github.com/mozilla-mobile/fenix/pull/18998 )
3 years ago
bde6bb8f56
[fenix] Added UI smoke tests to run on Beta builds.
3 years ago
a862baeda2
[fenix] Add first set of UI tests to Nightly
3 years ago
4523d2bfae
[fenix] Taskgraph changes to allow running UI tests on nightly builds ( https://github.com/mozilla-mobile/fenix/pull/18191 )
...
* Modify taskgraph to allow running UI tests on Nightly builds
* adding try_task_config file
* remove try_task_config file
3 years ago
22ec6af4a3
[fenix] For https://github.com/mozilla-mobile/fenix/issues/17195 - Don't try setting an idle resource if the View is already off screen
...
Speculative fix based on the Firebase logs which shows that on a second check
of R.id.tab_wrapper it is not found the screen.
It may be because after `advanceToHalfExpandedState` and before getting a
reference to it in `waitForTabTrayBehaviorToIdle` it was already animated off
the screen.
With this in mind I've added a null check for the view reference before trying
to register an idling resource on it's Behavior.
Also added and used a way to click at a specific location in a View, not just
in the default middle in the View.
It was observed from the Firebase videos that a "click" on the topBar actually
selected the private tabs section. This would leave us to believe that the
"click" was caught by that other View which was placed above the x,y middle of
the topBar.
3 years ago
e16ef0b3c6
[fenix] For https://github.com/mozilla-mobile/fenix/issues/17195 - Test a potential fix for the test
3 years ago
0b3f9aec8a
[fenix] Revert "Add UI tests nightly build ( https://github.com/mozilla-mobile/fenix/pull/17948 )" ( https://github.com/mozilla-mobile/fenix/pull/17960 )
...
This reverts commit 02c08b3f6cba7d7c05322a91d31f887d39ba0160.
3 years ago
b81a83b815
[fenix] Add UI tests nightly build ( https://github.com/mozilla-mobile/fenix/pull/17948 )
...
* Try adding UI Tests to Nightly build
* adding try_config file
* remove try_task_config
3 years ago
a35b7e900b
[fenix] Revert "Run UI tests nightly def ( https://github.com/mozilla-mobile/fenix/pull/17513 )" ( https://github.com/mozilla-mobile/fenix/pull/17761 )
...
This reverts commit 00d442ee4ab944cbeab0f357a5f7b69e29fd9237.
3 years ago
e4ff93f889
[fenix] Run UI tests nightly def ( https://github.com/mozilla-mobile/fenix/pull/17513 )
...
* run-ui-test-nightly
* Run ui tests on nightly build
* set correct number of shard according to tests running
* fix typo
* removing testing file
Co-authored-by: isabel rios <isabelrios@MBP-de-isabel-2.home>
3 years ago
0f6e44f7bc
[fenix] Changes to run tests on beta builds ( https://github.com/mozilla-mobile/fenix/pull/16786 )
...
* Changes to run tests on beta builds
* remove dontoptime and fix bookmarks tests
* fix ktlint and smokeTest
* add variable for package name
* rebase and fix conflicts
* add yml files and modify script to run tests
* fix yml file indentation
* changes in kind file and add try_task
* fix error kind file
* fix error kind file 2
* fix error kind file 3
* fix reviewer comments
* remove mockwebserver implementation as per reviewer comment
* run beta tests only on releases branches
* reg exp for master branch
* reg exp for master branch2
* modify try_task with release branch
* remove try file
* let's start by running only one test
* address latest reviewers comments
* double check correct tasks for release branch
* remove try file after confirming beta build run
Co-authored-by: isabel rios <isabelrios@MBP-de-isabel-2.home>
4 years ago
18b3fb95b4
[fenix] cron-job-ui-screenshots ( https://github.com/mozilla-mobile/fenix/pull/12423 )
...
Co-authored-by: isabel rios <isabelrios@MacBook-Pro-de-isabel-2.local>
4 years ago
d4c5bdaee9
[fenix] Closes https://github.com/mozilla-mobile/fenix/issues/10611 - Fix exit status of Flank ( https://github.com/mozilla-mobile/fenix/pull/10612 )
4 years ago
6c58867065
[fenix] No issue: remove listing directory contents on UI test results ( https://github.com/mozilla-mobile/fenix/pull/10354 )
4 years ago
970516c468
[fenix] Trigger UI test
4 years ago
2593abc7b1
[fenix] Fixes https://github.com/mozilla-mobile/fenix/issues/6760 - Show UI test results in TC task ( https://github.com/mozilla-mobile/fenix/pull/10089 )
4 years ago
789ee895a6
[fenix] No issue: Set all Flank templates to one AVD ( https://github.com/mozilla-mobile/fenix/pull/9745 )
4 years ago
ff77588851
[fenix] No issue: Restore num-flaky-test-attempts in flank-x86.yml ( https://github.com/mozilla-mobile/fenix/pull/9675 )
4 years ago
fc410e973e
[fenix] No issue: remove num-flaky-test-attempts from all Flank templates ( https://github.com/mozilla-mobile/fenix/pull/9635 )
4 years ago
b6f578da39
[fenix] Closes https://github.com/mozilla-mobile/fenix/issues/9433 : Update Flank version in ui-tests Dockerfile ( https://github.com/mozilla-mobile/fenix/pull/9466 )
...
fix: flank_snapshot requires direct shard value
-1 shards -> 50 shards
fix: adjust flank-x86.yml shard value
try old results generator in flank-x86.yml
fix: legacy-junit-report -> legacy-junit-result
revert to modern reporting
4 years ago
23e57053da
[fenix] Closes https://github.com/mozilla-mobile/fenix/issues/9469 - Change UI test failure output
4 years ago
5aad0aaf8c
[fenix] No issue: Swap AVD (x86) Nexus 6 (API 25) with a Nexus6P (API 27) ( https://github.com/mozilla-mobile/fenix/pull/9259 )
...
The Nexus 6 (x86 AVD) on API 25 is causing too many instablility issues. Let’s see what happens with a Nexus 6P on API 27.
4 years ago
a6231458fc
[fenix] Add Nightly startup-test ( https://github.com/mozilla-mobile/fenix/pull/6569 )
5 years ago
702121bdcf
[fenix] Make nimbledroid compliant to UI tests
5 years ago
8eef026200
[fenix] Split UI test
5 years ago
1839ce12f1
[fenix] Add verify items tests for settings menus
5 years ago
a161afd41e
[fenix] Fix TC error and run only ui tests
5 years ago
622e605f52
[fenix] Temporarily disable findInPage UI test ( https://github.com/mozilla-mobile/fenix/pull/5620 )
5 years ago
e510715efb
[fenix] Bug 1580778 - Migrate lint and ui-test tasks to taskgraph ( https://github.com/mozilla-mobile/fenix/pull/5430 )
5 years ago
867b6485ee
[fenix] Move UI tests to x86 devices on Firebase ( https://github.com/mozilla-mobile/fenix/pull/5463 )
5 years ago
62a25a8d6e
[fenix] Fixes https://github.com/mozilla-mobile/fenix/issues/5438 - Upgrade UI test devices to prevent slowdowns in test lab ( https://github.com/mozilla-mobile/fenix/pull/5439 )
...
* Fixes https://github.com/mozilla-mobile/fenix/issues/5438 - Upgrade UI test devices to prevent slowdowns in test lab
* fix: change api to supported version
* refactor: try x86 devices instead
5 years ago
dd5ec5b640
[fenix] fix: dex error on UI test job
5 years ago
57cb83526b
[fenix] fix: broken apk paths for UI test job ( https://github.com/mozilla-mobile/fenix/pull/4951 )
5 years ago
1531d6d6ad
[fenix] Add taskcluster job for UI tests ( https://github.com/mozilla-mobile/fenix/pull/4088 )
5 years ago
Aaron Train
sv-ohorvath
Oana Horvath
AndiAJ
isabelrios
Mugurell
Alessio Placitelli
Richard Pappalardo
Johan Lorenzo