382fb20cb5
[fenix] No issue: Adjust shard count in legacy/nightly/beta UI test jobs
2 years ago
95e632c11f
[fenix] For https://github.com/mozilla-mobile/fenix/issues/26792 - Change active Firebase Test Lab emulator from x86 to ARM ( https://github.com/mozilla-mobile/fenix/pull/26793 )
...
* For https://github.com/mozilla-mobile/fenix/issues/26792 - Change active Firebase Test Lab emulator from x86 to ARM
Update startup-test kind.yml Jobs for ARM
Update ui-test kind.yml Jobs for ARM
Cleans up and renames Flank configurations for ARM
Updates ui-test.sh for ARM
* Fix BookmarksTest.kt and HomeScreenTest.kt
* Fix intent matcher for SettingsAboutTest
Adds a helper function for Play Store intent
* Fix SettingsSearchTest.kt
* ktlint fix TestHelper.kt and SettingsRobot.kt
2 years ago
48135af917
[fenix] No issue: increase flaky tests attempts on Nightly tests
2 years ago
7672b99ec4
[fenix] Let relbot update A-C on trunk ( https://github.com/mozilla-mobile/fenix/pull/26553 )
...
* Let relbot update A-C on trunk
We already use relbot for this on fenix release branches and on all
branches for focus-android, so might as well avoid the duplication.
* Update mergify rules to auto-merge AC bumps from relbot on the main branch
2 years ago
5d1e66458c
[fenix] update_android_components: don't create an empty PR if we couldn't push
2 years ago
7d442af6d6
[fenix] Issue https://github.com/mozilla-mobile/fenix/issues/25972 , https://github.com/mozilla-mobile/fenix/issues/25971 : reduce test failures with more retries on legacy-api-tests
2 years ago
b7b938f96f
[fenix] No issue: Add new cron target task for legacy API UI tests
...
Setups up a new daily cron task to run select UI tests on API 28 (we’ll call it legacy). We don’t necessarily want to invoke Flank twice (serial) with a different configuration (FTL APIs dont support API splitting per test-target) on event CI but we do want them running elsewhere (cron).
2 years ago
51a694869d
[fenix] Move collections tests to CollectionTest class
2 years ago
0aa4769862
[fenix] Upgrade AndroidX Espresso Deps and support API 30 ( https://github.com/mozilla-mobile/fenix/pull/23904 )
2 years ago
bb4a179078
[fenix] Re-organize existing tests to their own SettingsSearchTest class
2 years ago
4d0237797d
[fenix] No issue: Update references and doc in parse-ui-test.py ( https://github.com/mozilla-mobile/fenix/pull/23354 )
...
* No issue: Update references and doc in parse-ui-test.py
* Update parse-ui-test.py
* Clean up device data
* Revert device output
* Update parse-ui-test.py
* Update parse-ui-test.py
* Update parse-ui-test.py
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2 years ago
d2944ccdd7
[fenix] No issue: Add shared docs/team links to parse-ui-test.py
3 years ago
8722950d3b
[fenix] Improve homeThreeDotMenuItemsTest UI test coverage
3 years ago
214d88f7c2
[fenix] Closes https://github.com/mozilla-mobile/fenix/issues/21340 : Disable auto Google login in Flank config ( https://github.com/mozilla-mobile/fenix/pull/21341 )
3 years ago
f2fe9ae61d
[fenix] Filter out test target packages in Flank-x86 ( https://github.com/mozilla-mobile/fenix/pull/20841 )
...
* Filter out test target packages in Flank-x86
* Ignore verifyRunBlockingAndStrictModeSuppresionCount
3 years ago
1480a5292b
[fenix] Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main ( https://github.com/mozilla-mobile/fenix/pull/20457 )
...
* Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main (Automation/TC)
* Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main (GitHub Workflows)
* Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main (GitHub Workflows)
* Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main (GitHub Issue Templates)
* Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main (Jenkins)
* Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main (README & Documentation)
* Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main (Jenkins)
* Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main (Random)
3 years ago
ba24312a8e
[fenix] No issue: Update Flank to v21.07.1 ( https://github.com/mozilla-mobile/fenix/pull/20456 )
...
* Update Flank to v21.07.1
* Update approach to downloading Flank
* Update parse-ui-test.py
3 years ago
4e7c93e6f6
[fenix] Test full-junit-result in Flank config ( https://github.com/mozilla-mobile/fenix/pull/19897 )
3 years ago
17689b2d5d
[fenix] Add matrix outcome details to parse-ui-test.py ( https://github.com/mozilla-mobile/fenix/pull/19900 )
3 years ago
3a4b0e5ac7
[fenix] update_android_components.sh: Watch different component.
...
`browser-engine-gecko-nightly` doesn't exist anymore. Let's watch `browser-engine-gecko` instead.
3 years ago
4b5f161e30
[fenix] No issue: test one shard per UI test on FTL ( https://github.com/mozilla-mobile/fenix/pull/18998 )
3 years ago
bde6bb8f56
[fenix] Added UI smoke tests to run on Beta builds.
3 years ago
a862baeda2
[fenix] Add first set of UI tests to Nightly
3 years ago
4523d2bfae
[fenix] Taskgraph changes to allow running UI tests on nightly builds ( https://github.com/mozilla-mobile/fenix/pull/18191 )
...
* Modify taskgraph to allow running UI tests on Nightly builds
* adding try_task_config file
* remove try_task_config file
3 years ago
22ec6af4a3
[fenix] For https://github.com/mozilla-mobile/fenix/issues/17195 - Don't try setting an idle resource if the View is already off screen
...
Speculative fix based on the Firebase logs which shows that on a second check
of R.id.tab_wrapper it is not found the screen.
It may be because after `advanceToHalfExpandedState` and before getting a
reference to it in `waitForTabTrayBehaviorToIdle` it was already animated off
the screen.
With this in mind I've added a null check for the view reference before trying
to register an idling resource on it's Behavior.
Also added and used a way to click at a specific location in a View, not just
in the default middle in the View.
It was observed from the Firebase videos that a "click" on the topBar actually
selected the private tabs section. This would leave us to believe that the
"click" was caught by that other View which was placed above the x,y middle of
the topBar.
3 years ago
e16ef0b3c6
[fenix] For https://github.com/mozilla-mobile/fenix/issues/17195 - Test a potential fix for the test
3 years ago
0b3f9aec8a
[fenix] Revert "Add UI tests nightly build ( https://github.com/mozilla-mobile/fenix/pull/17948 )" ( https://github.com/mozilla-mobile/fenix/pull/17960 )
...
This reverts commit 02c08b3f6cba7d7c05322a91d31f887d39ba0160.
3 years ago
b81a83b815
[fenix] Add UI tests nightly build ( https://github.com/mozilla-mobile/fenix/pull/17948 )
...
* Try adding UI Tests to Nightly build
* adding try_config file
* remove try_task_config
3 years ago
a35b7e900b
[fenix] Revert "Run UI tests nightly def ( https://github.com/mozilla-mobile/fenix/pull/17513 )" ( https://github.com/mozilla-mobile/fenix/pull/17761 )
...
This reverts commit 00d442ee4ab944cbeab0f357a5f7b69e29fd9237.
3 years ago
e4ff93f889
[fenix] Run UI tests nightly def ( https://github.com/mozilla-mobile/fenix/pull/17513 )
...
* run-ui-test-nightly
* Run ui tests on nightly build
* set correct number of shard according to tests running
* fix typo
* removing testing file
Co-authored-by: isabel rios <isabelrios@MBP-de-isabel-2.home>
3 years ago
0f6e44f7bc
[fenix] Changes to run tests on beta builds ( https://github.com/mozilla-mobile/fenix/pull/16786 )
...
* Changes to run tests on beta builds
* remove dontoptime and fix bookmarks tests
* fix ktlint and smokeTest
* add variable for package name
* rebase and fix conflicts
* add yml files and modify script to run tests
* fix yml file indentation
* changes in kind file and add try_task
* fix error kind file
* fix error kind file 2
* fix error kind file 3
* fix reviewer comments
* remove mockwebserver implementation as per reviewer comment
* run beta tests only on releases branches
* reg exp for master branch
* reg exp for master branch2
* modify try_task with release branch
* remove try file
* let's start by running only one test
* address latest reviewers comments
* double check correct tasks for release branch
* remove try file after confirming beta build run
Co-authored-by: isabel rios <isabelrios@MBP-de-isabel-2.home>
4 years ago
2875338740
[fenix] Simplify build variants to just: debug, nightly, beta and release.
...
Co-authored-by: Johan Lorenzo <jlorenzo@mozilla.com>
4 years ago
5fe4feda53
[fenix] For https://github.com/mozilla-mobile/fenix/issues/13066 - Translate locale codes to Android specific variants before filtering
4 years ago
0d977a5e2d
[fenix] Move release locales to a separate config file.
...
We should leave l10n.toml untouched unless the l10n team wants to
change it.
4 years ago
703edac9c5
[fenix] For https://github.com/mozilla-mobile/fenix/issues/12759 - Keep a separate list of release locales.
4 years ago
18b3fb95b4
[fenix] cron-job-ui-screenshots ( https://github.com/mozilla-mobile/fenix/pull/12423 )
...
Co-authored-by: isabel rios <isabelrios@MacBook-Pro-de-isabel-2.local>
4 years ago
64e1a079ea
[fenix] For https://github.com/mozilla-mobile/fenix/issues/11886 - Re-enable codecov ( https://github.com/mozilla-mobile/fenix/pull/12258 )
...
* Re-enable codecov
* Use local script
* Revert to old codecov script
4 years ago
ffba3b3570
[fenix] Fixes https://github.com/mozilla-mobile/fenix/issues/11050 - Remove Nimbledroid
4 years ago
d4c5bdaee9
[fenix] Closes https://github.com/mozilla-mobile/fenix/issues/10611 - Fix exit status of Flank ( https://github.com/mozilla-mobile/fenix/pull/10612 )
4 years ago
6c58867065
[fenix] No issue: remove listing directory contents on UI test results ( https://github.com/mozilla-mobile/fenix/pull/10354 )
4 years ago
970516c468
[fenix] Trigger UI test
4 years ago
2593abc7b1
[fenix] Fixes https://github.com/mozilla-mobile/fenix/issues/6760 - Show UI test results in TC task ( https://github.com/mozilla-mobile/fenix/pull/10089 )
4 years ago
789ee895a6
[fenix] No issue: Set all Flank templates to one AVD ( https://github.com/mozilla-mobile/fenix/pull/9745 )
4 years ago
ff77588851
[fenix] No issue: Restore num-flaky-test-attempts in flank-x86.yml ( https://github.com/mozilla-mobile/fenix/pull/9675 )
4 years ago
fc410e973e
[fenix] No issue: remove num-flaky-test-attempts from all Flank templates ( https://github.com/mozilla-mobile/fenix/pull/9635 )
4 years ago
b6f578da39
[fenix] Closes https://github.com/mozilla-mobile/fenix/issues/9433 : Update Flank version in ui-tests Dockerfile ( https://github.com/mozilla-mobile/fenix/pull/9466 )
...
fix: flank_snapshot requires direct shard value
-1 shards -> 50 shards
fix: adjust flank-x86.yml shard value
try old results generator in flank-x86.yml
fix: legacy-junit-report -> legacy-junit-result
revert to modern reporting
4 years ago
23e57053da
[fenix] Closes https://github.com/mozilla-mobile/fenix/issues/9469 - Change UI test failure output
4 years ago
357e8c6488
[fenix] Bug 1620190 - Run android-components bumps once a day ( https://github.com/mozilla-mobile/fenix/pull/9251 )
4 years ago
5aad0aaf8c
[fenix] No issue: Swap AVD (x86) Nexus 6 (API 25) with a Nexus6P (API 27) ( https://github.com/mozilla-mobile/fenix/pull/9259 )
...
The Nexus 6 (x86 AVD) on API 25 is causing too many instablility issues. Let’s see what happens with a Nexus 6P on API 27.
4 years ago
93f2c58d76
[fenix] Bug 1608103 - Fix dummy secrets generation ( https://github.com/mozilla-mobile/fenix/pull/8855 )
4 years ago
Aaron Train
sv-ohorvath
Julien Cristau
Oana Horvath
AndiAJ
Stefan Arentz
Sebastian Kaspari
isabelrios
Mugurell
Kainalu Hagiwara
Tiger Oakes
Richard Pappalardo
Alessio Placitelli
Johan Lorenzo