Aaron Train
382fb20cb5
[fenix] No issue: Adjust shard count in legacy/nightly/beta UI test jobs
2022-09-16 14:41:38 +00:00
Aaron Train
95e632c11f
[fenix] For https://github.com/mozilla-mobile/fenix/issues/26792 - Change active Firebase Test Lab emulator from x86 to ARM ( https://github.com/mozilla-mobile/fenix/pull/26793 )
...
* For https://github.com/mozilla-mobile/fenix/issues/26792 - Change active Firebase Test Lab emulator from x86 to ARM
Update startup-test kind.yml Jobs for ARM
Update ui-test kind.yml Jobs for ARM
Cleans up and renames Flank configurations for ARM
Updates ui-test.sh for ARM
* Fix BookmarksTest.kt and HomeScreenTest.kt
* Fix intent matcher for SettingsAboutTest
Adds a helper function for Play Store intent
* Fix SettingsSearchTest.kt
* ktlint fix TestHelper.kt and SettingsRobot.kt
2022-09-14 16:42:25 +02:00
sv-ohorvath
48135af917
[fenix] No issue: increase flaky tests attempts on Nightly tests
2022-08-23 21:01:20 +00:00
Julien Cristau
7672b99ec4
[fenix] Let relbot update A-C on trunk ( https://github.com/mozilla-mobile/fenix/pull/26553 )
...
* Let relbot update A-C on trunk
We already use relbot for this on fenix release branches and on all
branches for focus-android, so might as well avoid the duplication.
* Update mergify rules to auto-merge AC bumps from relbot on the main branch
2022-08-22 18:18:49 +02:00
Julien Cristau
5d1e66458c
[fenix] update_android_components: don't create an empty PR if we couldn't push
2022-08-19 18:27:19 +00:00
sv-ohorvath
7d442af6d6
[fenix] Issue https://github.com/mozilla-mobile/fenix/issues/25972 , https://github.com/mozilla-mobile/fenix/issues/25971 : reduce test failures with more retries on legacy-api-tests
2022-07-20 07:27:48 +00:00
Aaron Train
b7b938f96f
[fenix] No issue: Add new cron target task for legacy API UI tests
...
Setups up a new daily cron task to run select UI tests on API 28 (we’ll call it legacy). We don’t necessarily want to invoke Flank twice (serial) with a different configuration (FTL APIs dont support API splitting per test-target) on event CI but we do want them running elsewhere (cron).
2022-07-06 21:19:08 +00:00
sv-ohorvath
51a694869d
[fenix] Move collections tests to CollectionTest class
2022-06-06 12:21:22 +00:00
Aaron Train
0aa4769862
[fenix] Upgrade AndroidX Espresso Deps and support API 30 ( https://github.com/mozilla-mobile/fenix/pull/23904 )
2022-04-27 10:53:45 -04:00
Oana Horvath
bb4a179078
[fenix] Re-organize existing tests to their own SettingsSearchTest class
2022-02-07 10:11:01 +00:00
Aaron Train
4d0237797d
[fenix] No issue: Update references and doc in parse-ui-test.py ( https://github.com/mozilla-mobile/fenix/pull/23354 )
...
* No issue: Update references and doc in parse-ui-test.py
* Update parse-ui-test.py
* Clean up device data
* Revert device output
* Update parse-ui-test.py
* Update parse-ui-test.py
* Update parse-ui-test.py
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2022-01-28 21:07:34 +00:00
Aaron Train
d2944ccdd7
[fenix] No issue: Add shared docs/team links to parse-ui-test.py
2022-01-07 15:59:37 +00:00
AndiAJ
8722950d3b
[fenix] Improve homeThreeDotMenuItemsTest UI test coverage
2021-11-16 13:44:32 +00:00
Aaron Train
214d88f7c2
[fenix] Closes https://github.com/mozilla-mobile/fenix/issues/21340 : Disable auto Google login in Flank config ( https://github.com/mozilla-mobile/fenix/pull/21341 )
2021-09-16 17:30:30 -04:00
Aaron Train
f2fe9ae61d
[fenix] Filter out test target packages in Flank-x86 ( https://github.com/mozilla-mobile/fenix/pull/20841 )
...
* Filter out test target packages in Flank-x86
* Ignore verifyRunBlockingAndStrictModeSuppresionCount
2021-08-13 15:00:10 -04:00
Stefan Arentz
1480a5292b
[fenix] Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main ( https://github.com/mozilla-mobile/fenix/pull/20457 )
...
* Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main (Automation/TC)
* Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main (GitHub Workflows)
* Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main (GitHub Workflows)
* Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main (GitHub Issue Templates)
* Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main (Jenkins)
* Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main (README & Documentation)
* Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main (Jenkins)
* Fixes https://github.com/mozilla-mobile/fenix/issues/11427 - Rename master branch to main (Random)
2021-07-28 08:20:14 -04:00
Aaron Train
ba24312a8e
[fenix] No issue: Update Flank to v21.07.1 ( https://github.com/mozilla-mobile/fenix/pull/20456 )
...
* Update Flank to v21.07.1
* Update approach to downloading Flank
* Update parse-ui-test.py
2021-07-21 14:10:14 -04:00
Aaron Train
4e7c93e6f6
[fenix] Test full-junit-result in Flank config ( https://github.com/mozilla-mobile/fenix/pull/19897 )
2021-06-09 10:55:39 -04:00
Aaron Train
17689b2d5d
[fenix] Add matrix outcome details to parse-ui-test.py ( https://github.com/mozilla-mobile/fenix/pull/19900 )
2021-06-09 10:55:08 -04:00
Sebastian Kaspari
3a4b0e5ac7
[fenix] update_android_components.sh: Watch different component.
...
`browser-engine-gecko-nightly` doesn't exist anymore. Let's watch `browser-engine-gecko` instead.
2021-04-21 19:35:34 +02:00
Aaron Train
4b5f161e30
[fenix] No issue: test one shard per UI test on FTL ( https://github.com/mozilla-mobile/fenix/pull/18998 )
2021-04-19 12:22:01 -04:00
Oana Horvath
bde6bb8f56
[fenix] Added UI smoke tests to run on Beta builds.
2021-04-08 11:07:36 +03:00
Oana Horvath
a862baeda2
[fenix] Add first set of UI tests to Nightly
2021-03-16 11:12:53 +02:00
isabelrios
4523d2bfae
[fenix] Taskgraph changes to allow running UI tests on nightly builds ( https://github.com/mozilla-mobile/fenix/pull/18191 )
...
* Modify taskgraph to allow running UI tests on Nightly builds
* adding try_task_config file
* remove try_task_config file
2021-03-10 11:31:55 +01:00
Mugurell
22ec6af4a3
[fenix] For https://github.com/mozilla-mobile/fenix/issues/17195 - Don't try setting an idle resource if the View is already off screen
...
Speculative fix based on the Firebase logs which shows that on a second check
of R.id.tab_wrapper it is not found the screen.
It may be because after `advanceToHalfExpandedState` and before getting a
reference to it in `waitForTabTrayBehaviorToIdle` it was already animated off
the screen.
With this in mind I've added a null check for the view reference before trying
to register an idling resource on it's Behavior.
Also added and used a way to click at a specific location in a View, not just
in the default middle in the View.
It was observed from the Firebase videos that a "click" on the topBar actually
selected the private tabs section. This would leave us to believe that the
"click" was caught by that other View which was placed above the x,y middle of
the topBar.
2021-02-16 16:26:17 +02:00
Mugurell
e16ef0b3c6
[fenix] For https://github.com/mozilla-mobile/fenix/issues/17195 - Test a potential fix for the test
2021-02-16 16:26:17 +02:00
isabelrios
0b3f9aec8a
[fenix] Revert "Add UI tests nightly build ( https://github.com/mozilla-mobile/fenix/pull/17948 )" ( https://github.com/mozilla-mobile/fenix/pull/17960 )
...
This reverts commit 02c08b3f6cba7d7c05322a91d31f887d39ba0160.
2021-02-11 10:24:41 +01:00
isabelrios
b81a83b815
[fenix] Add UI tests nightly build ( https://github.com/mozilla-mobile/fenix/pull/17948 )
...
* Try adding UI Tests to Nightly build
* adding try_config file
* remove try_task_config
2021-02-11 09:58:41 +01:00
isabelrios
a35b7e900b
[fenix] Revert "Run UI tests nightly def ( https://github.com/mozilla-mobile/fenix/pull/17513 )" ( https://github.com/mozilla-mobile/fenix/pull/17761 )
...
This reverts commit 00d442ee4ab944cbeab0f357a5f7b69e29fd9237.
2021-02-02 08:39:51 -08:00
isabelrios
e4ff93f889
[fenix] Run UI tests nightly def ( https://github.com/mozilla-mobile/fenix/pull/17513 )
...
* run-ui-test-nightly
* Run ui tests on nightly build
* set correct number of shard according to tests running
* fix typo
* removing testing file
Co-authored-by: isabel rios <isabelrios@MBP-de-isabel-2.home>
2021-02-02 14:39:07 +01:00
isabelrios
0f6e44f7bc
[fenix] Changes to run tests on beta builds ( https://github.com/mozilla-mobile/fenix/pull/16786 )
...
* Changes to run tests on beta builds
* remove dontoptime and fix bookmarks tests
* fix ktlint and smokeTest
* add variable for package name
* rebase and fix conflicts
* add yml files and modify script to run tests
* fix yml file indentation
* changes in kind file and add try_task
* fix error kind file
* fix error kind file 2
* fix error kind file 3
* fix reviewer comments
* remove mockwebserver implementation as per reviewer comment
* run beta tests only on releases branches
* reg exp for master branch
* reg exp for master branch2
* modify try_task with release branch
* remove try file
* let's start by running only one test
* address latest reviewers comments
* double check correct tasks for release branch
* remove try file after confirming beta build run
Co-authored-by: isabel rios <isabelrios@MBP-de-isabel-2.home>
2021-01-14 15:47:36 +01:00
Kainalu Hagiwara
5fe4feda53
[fenix] For https://github.com/mozilla-mobile/fenix/issues/13066 - Translate locale codes to Android specific variants before filtering
2020-07-29 14:51:08 -07:00
Kainalu Hagiwara
0d977a5e2d
[fenix] Move release locales to a separate config file.
...
We should leave l10n.toml untouched unless the l10n team wants to
change it.
2020-07-21 10:20:21 -07:00
Kainalu Hagiwara
703edac9c5
[fenix] For https://github.com/mozilla-mobile/fenix/issues/12759 - Keep a separate list of release locales.
2020-07-20 22:05:46 -07:00
isabelrios
18b3fb95b4
[fenix] cron-job-ui-screenshots ( https://github.com/mozilla-mobile/fenix/pull/12423 )
...
Co-authored-by: isabel rios <isabelrios@MacBook-Pro-de-isabel-2.local>
2020-07-16 16:08:00 +02:00
Tiger Oakes
64e1a079ea
[fenix] For https://github.com/mozilla-mobile/fenix/issues/11886 - Re-enable codecov ( https://github.com/mozilla-mobile/fenix/pull/12258 )
...
* Re-enable codecov
* Use local script
* Revert to old codecov script
2020-07-13 16:22:17 -07:00
Richard Pappalardo
ffba3b3570
[fenix] Fixes https://github.com/mozilla-mobile/fenix/issues/11050 - Remove Nimbledroid
2020-06-04 14:42:47 -07:00
Aaron Train
d4c5bdaee9
[fenix] Closes https://github.com/mozilla-mobile/fenix/issues/10611 - Fix exit status of Flank ( https://github.com/mozilla-mobile/fenix/pull/10612 )
2020-05-14 10:27:56 -04:00
Aaron Train
6c58867065
[fenix] No issue: remove listing directory contents on UI test results ( https://github.com/mozilla-mobile/fenix/pull/10354 )
2020-05-04 10:34:06 -04:00
Alessio Placitelli
970516c468
[fenix] Trigger UI test
2020-05-04 10:37:44 +03:00
Richard Pappalardo
2593abc7b1
[fenix] Fixes https://github.com/mozilla-mobile/fenix/issues/6760 - Show UI test results in TC task ( https://github.com/mozilla-mobile/fenix/pull/10089 )
2020-04-30 17:01:35 -04:00
Aaron Train
789ee895a6
[fenix] No issue: Set all Flank templates to one AVD ( https://github.com/mozilla-mobile/fenix/pull/9745 )
2020-04-06 12:19:26 -07:00
Aaron Train
ff77588851
[fenix] No issue: Restore num-flaky-test-attempts in flank-x86.yml ( https://github.com/mozilla-mobile/fenix/pull/9675 )
2020-04-03 12:37:16 -04:00
Aaron Train
fc410e973e
[fenix] No issue: remove num-flaky-test-attempts from all Flank templates ( https://github.com/mozilla-mobile/fenix/pull/9635 )
2020-04-02 17:02:22 -07:00
Aaron Train
b6f578da39
[fenix] Closes https://github.com/mozilla-mobile/fenix/issues/9433 : Update Flank version in ui-tests Dockerfile ( https://github.com/mozilla-mobile/fenix/pull/9466 )
...
fix: flank_snapshot requires direct shard value
-1 shards -> 50 shards
fix: adjust flank-x86.yml shard value
try old results generator in flank-x86.yml
fix: legacy-junit-report -> legacy-junit-result
revert to modern reporting
2020-04-01 15:43:45 -07:00
Richard Pappalardo
23e57053da
[fenix] Closes https://github.com/mozilla-mobile/fenix/issues/9469 - Change UI test failure output
2020-03-27 22:43:57 -07:00
Johan Lorenzo
357e8c6488
[fenix] Bug 1620190 - Run android-components bumps once a day ( https://github.com/mozilla-mobile/fenix/pull/9251 )
2020-03-20 10:26:44 +01:00
Aaron Train
5aad0aaf8c
[fenix] No issue: Swap AVD (x86) Nexus 6 (API 25) with a Nexus6P (API 27) ( https://github.com/mozilla-mobile/fenix/pull/9259 )
...
The Nexus 6 (x86 AVD) on API 25 is causing too many instablility issues. Let’s see what happens with a Nexus 6P on API 27.
2020-03-19 17:30:27 -04:00
Johan Lorenzo
93f2c58d76
[fenix] Bug 1608103 - Fix dummy secrets generation ( https://github.com/mozilla-mobile/fenix/pull/8855 )
2020-03-03 17:22:48 +01:00
Johan Lorenzo
82cebdbb33
[fenix] Make nimbledroid not depend on a real token on staging releases ( https://github.com/mozilla-mobile/fenix/pull/7570 )
2020-02-20 11:36:03 +01:00