Aaron Train
4125023a64
Bug 1825279 - Remove dreamlte device in legacy test configuration
2023-04-05 02:23:13 +00:00
AndiAJ
f784c2edc7
Bug 1825548 - Revert removal of dreamlte in legacy test configuration
2023-03-30 18:42:30 +00:00
Aaron Train
89afac341e
Bug 1825015 - Remove dreamlte in legacy test configuration
2023-03-29 14:57:10 +00:00
Aaron Train
11db8a0b9d
Bug 1820036 - Add Matrix labeling on Firebase Test Lab
2023-03-07 21:32:09 +00:00
Aaron Train
a3b65617a6
Bug 1817250 - Add/Enable Robo Test on Firebase Test Lab
2023-02-24 17:39:34 +00:00
Aaron Train
0824a0f4d0
Bug 1817003 - Remove low capacity ARM device on FTL
2023-02-16 19:36:19 +00:00
Aaron Train
b9e1ecc33d
[fenix] Bug 1813628 - Adjust shard count for debug UI tests
2023-01-31 14:43:10 +00:00
Aaron Train
83046224d0
[fenix] No issue: Update flank-arm-legacy-api-tests.yml
...
Removes org.mozilla.fenix.ui.HomeScreenTest#homeScreenItemsTest for recently failing
2023-01-27 19:38:25 +00:00
AndiAJ
a8df7dfe3c
[fenix] Bug 1812255 - Reduce UI tests max timeouts
2023-01-26 09:12:33 +00:00
Aaron Train
b0b2bc5dc9
[fenix] Bug 1811045 - Expand device and scheduling for legacy Android testing cron
2023-01-20 15:28:39 +00:00
Aaron Train
d57dc82a73
[fenix] Bug 1810204 - Schedule legacy Android API Cron for test coverage
2023-01-16 21:13:23 +00:00
Aaron Train
aa6fa50e18
[fenix] No issue: Fix for None key-pair in Flank client-details
...
Remove URL construction
2022-10-19 14:32:20 +00:00
Aaron Train
c311d23760
[fenix] No issue: Add source commit pair to Flank client-details flag
2022-10-18 13:29:16 +00:00
sv-ohorvath
169d4c944f
[fenix] No issue: remove sdk suppression tests tags for API28 and unschedule cron job
2022-09-30 07:35:40 +00:00
Aaron Train
382fb20cb5
[fenix] No issue: Adjust shard count in legacy/nightly/beta UI test jobs
2022-09-16 14:41:38 +00:00
Aaron Train
95e632c11f
[fenix] For https://github.com/mozilla-mobile/fenix/issues/26792 - Change active Firebase Test Lab emulator from x86 to ARM ( https://github.com/mozilla-mobile/fenix/pull/26793 )
...
* For https://github.com/mozilla-mobile/fenix/issues/26792 - Change active Firebase Test Lab emulator from x86 to ARM
Update startup-test kind.yml Jobs for ARM
Update ui-test kind.yml Jobs for ARM
Cleans up and renames Flank configurations for ARM
Updates ui-test.sh for ARM
* Fix BookmarksTest.kt and HomeScreenTest.kt
* Fix intent matcher for SettingsAboutTest
Adds a helper function for Play Store intent
* Fix SettingsSearchTest.kt
* ktlint fix TestHelper.kt and SettingsRobot.kt
2022-09-14 16:42:25 +02:00
sv-ohorvath
48135af917
[fenix] No issue: increase flaky tests attempts on Nightly tests
2022-08-23 21:01:20 +00:00
sv-ohorvath
7d442af6d6
[fenix] Issue https://github.com/mozilla-mobile/fenix/issues/25972 , https://github.com/mozilla-mobile/fenix/issues/25971 : reduce test failures with more retries on legacy-api-tests
2022-07-20 07:27:48 +00:00
Aaron Train
b7b938f96f
[fenix] No issue: Add new cron target task for legacy API UI tests
...
Setups up a new daily cron task to run select UI tests on API 28 (we’ll call it legacy). We don’t necessarily want to invoke Flank twice (serial) with a different configuration (FTL APIs dont support API splitting per test-target) on event CI but we do want them running elsewhere (cron).
2022-07-06 21:19:08 +00:00
sv-ohorvath
51a694869d
[fenix] Move collections tests to CollectionTest class
2022-06-06 12:21:22 +00:00
Aaron Train
0aa4769862
[fenix] Upgrade AndroidX Espresso Deps and support API 30 ( https://github.com/mozilla-mobile/fenix/pull/23904 )
2022-04-27 10:53:45 -04:00
Oana Horvath
bb4a179078
[fenix] Re-organize existing tests to their own SettingsSearchTest class
2022-02-07 10:11:01 +00:00
Aaron Train
4d0237797d
[fenix] No issue: Update references and doc in parse-ui-test.py ( https://github.com/mozilla-mobile/fenix/pull/23354 )
...
* No issue: Update references and doc in parse-ui-test.py
* Update parse-ui-test.py
* Clean up device data
* Revert device output
* Update parse-ui-test.py
* Update parse-ui-test.py
* Update parse-ui-test.py
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2022-01-28 21:07:34 +00:00
Aaron Train
d2944ccdd7
[fenix] No issue: Add shared docs/team links to parse-ui-test.py
2022-01-07 15:59:37 +00:00
AndiAJ
8722950d3b
[fenix] Improve homeThreeDotMenuItemsTest UI test coverage
2021-11-16 13:44:32 +00:00
Aaron Train
214d88f7c2
[fenix] Closes https://github.com/mozilla-mobile/fenix/issues/21340 : Disable auto Google login in Flank config ( https://github.com/mozilla-mobile/fenix/pull/21341 )
2021-09-16 17:30:30 -04:00
Aaron Train
f2fe9ae61d
[fenix] Filter out test target packages in Flank-x86 ( https://github.com/mozilla-mobile/fenix/pull/20841 )
...
* Filter out test target packages in Flank-x86
* Ignore verifyRunBlockingAndStrictModeSuppresionCount
2021-08-13 15:00:10 -04:00
Aaron Train
ba24312a8e
[fenix] No issue: Update Flank to v21.07.1 ( https://github.com/mozilla-mobile/fenix/pull/20456 )
...
* Update Flank to v21.07.1
* Update approach to downloading Flank
* Update parse-ui-test.py
2021-07-21 14:10:14 -04:00
Aaron Train
4e7c93e6f6
[fenix] Test full-junit-result in Flank config ( https://github.com/mozilla-mobile/fenix/pull/19897 )
2021-06-09 10:55:39 -04:00
Aaron Train
17689b2d5d
[fenix] Add matrix outcome details to parse-ui-test.py ( https://github.com/mozilla-mobile/fenix/pull/19900 )
2021-06-09 10:55:08 -04:00
Aaron Train
4b5f161e30
[fenix] No issue: test one shard per UI test on FTL ( https://github.com/mozilla-mobile/fenix/pull/18998 )
2021-04-19 12:22:01 -04:00
Oana Horvath
bde6bb8f56
[fenix] Added UI smoke tests to run on Beta builds.
2021-04-08 11:07:36 +03:00
Oana Horvath
a862baeda2
[fenix] Add first set of UI tests to Nightly
2021-03-16 11:12:53 +02:00
isabelrios
4523d2bfae
[fenix] Taskgraph changes to allow running UI tests on nightly builds ( https://github.com/mozilla-mobile/fenix/pull/18191 )
...
* Modify taskgraph to allow running UI tests on Nightly builds
* adding try_task_config file
* remove try_task_config file
2021-03-10 11:31:55 +01:00
Mugurell
22ec6af4a3
[fenix] For https://github.com/mozilla-mobile/fenix/issues/17195 - Don't try setting an idle resource if the View is already off screen
...
Speculative fix based on the Firebase logs which shows that on a second check
of R.id.tab_wrapper it is not found the screen.
It may be because after `advanceToHalfExpandedState` and before getting a
reference to it in `waitForTabTrayBehaviorToIdle` it was already animated off
the screen.
With this in mind I've added a null check for the view reference before trying
to register an idling resource on it's Behavior.
Also added and used a way to click at a specific location in a View, not just
in the default middle in the View.
It was observed from the Firebase videos that a "click" on the topBar actually
selected the private tabs section. This would leave us to believe that the
"click" was caught by that other View which was placed above the x,y middle of
the topBar.
2021-02-16 16:26:17 +02:00
Mugurell
e16ef0b3c6
[fenix] For https://github.com/mozilla-mobile/fenix/issues/17195 - Test a potential fix for the test
2021-02-16 16:26:17 +02:00
isabelrios
0b3f9aec8a
[fenix] Revert "Add UI tests nightly build ( https://github.com/mozilla-mobile/fenix/pull/17948 )" ( https://github.com/mozilla-mobile/fenix/pull/17960 )
...
This reverts commit 02c08b3f6cba7d7c05322a91d31f887d39ba0160.
2021-02-11 10:24:41 +01:00
isabelrios
b81a83b815
[fenix] Add UI tests nightly build ( https://github.com/mozilla-mobile/fenix/pull/17948 )
...
* Try adding UI Tests to Nightly build
* adding try_config file
* remove try_task_config
2021-02-11 09:58:41 +01:00
isabelrios
a35b7e900b
[fenix] Revert "Run UI tests nightly def ( https://github.com/mozilla-mobile/fenix/pull/17513 )" ( https://github.com/mozilla-mobile/fenix/pull/17761 )
...
This reverts commit 00d442ee4ab944cbeab0f357a5f7b69e29fd9237.
2021-02-02 08:39:51 -08:00
isabelrios
e4ff93f889
[fenix] Run UI tests nightly def ( https://github.com/mozilla-mobile/fenix/pull/17513 )
...
* run-ui-test-nightly
* Run ui tests on nightly build
* set correct number of shard according to tests running
* fix typo
* removing testing file
Co-authored-by: isabel rios <isabelrios@MBP-de-isabel-2.home>
2021-02-02 14:39:07 +01:00
isabelrios
0f6e44f7bc
[fenix] Changes to run tests on beta builds ( https://github.com/mozilla-mobile/fenix/pull/16786 )
...
* Changes to run tests on beta builds
* remove dontoptime and fix bookmarks tests
* fix ktlint and smokeTest
* add variable for package name
* rebase and fix conflicts
* add yml files and modify script to run tests
* fix yml file indentation
* changes in kind file and add try_task
* fix error kind file
* fix error kind file 2
* fix error kind file 3
* fix reviewer comments
* remove mockwebserver implementation as per reviewer comment
* run beta tests only on releases branches
* reg exp for master branch
* reg exp for master branch2
* modify try_task with release branch
* remove try file
* let's start by running only one test
* address latest reviewers comments
* double check correct tasks for release branch
* remove try file after confirming beta build run
Co-authored-by: isabel rios <isabelrios@MBP-de-isabel-2.home>
2021-01-14 15:47:36 +01:00
isabelrios
18b3fb95b4
[fenix] cron-job-ui-screenshots ( https://github.com/mozilla-mobile/fenix/pull/12423 )
...
Co-authored-by: isabel rios <isabelrios@MacBook-Pro-de-isabel-2.local>
2020-07-16 16:08:00 +02:00
Aaron Train
d4c5bdaee9
[fenix] Closes https://github.com/mozilla-mobile/fenix/issues/10611 - Fix exit status of Flank ( https://github.com/mozilla-mobile/fenix/pull/10612 )
2020-05-14 10:27:56 -04:00
Aaron Train
6c58867065
[fenix] No issue: remove listing directory contents on UI test results ( https://github.com/mozilla-mobile/fenix/pull/10354 )
2020-05-04 10:34:06 -04:00
Alessio Placitelli
970516c468
[fenix] Trigger UI test
2020-05-04 10:37:44 +03:00
Richard Pappalardo
2593abc7b1
[fenix] Fixes https://github.com/mozilla-mobile/fenix/issues/6760 - Show UI test results in TC task ( https://github.com/mozilla-mobile/fenix/pull/10089 )
2020-04-30 17:01:35 -04:00
Aaron Train
789ee895a6
[fenix] No issue: Set all Flank templates to one AVD ( https://github.com/mozilla-mobile/fenix/pull/9745 )
2020-04-06 12:19:26 -07:00
Aaron Train
ff77588851
[fenix] No issue: Restore num-flaky-test-attempts in flank-x86.yml ( https://github.com/mozilla-mobile/fenix/pull/9675 )
2020-04-03 12:37:16 -04:00
Aaron Train
fc410e973e
[fenix] No issue: remove num-flaky-test-attempts from all Flank templates ( https://github.com/mozilla-mobile/fenix/pull/9635 )
2020-04-02 17:02:22 -07:00
Aaron Train
b6f578da39
[fenix] Closes https://github.com/mozilla-mobile/fenix/issues/9433 : Update Flank version in ui-tests Dockerfile ( https://github.com/mozilla-mobile/fenix/pull/9466 )
...
fix: flank_snapshot requires direct shard value
-1 shards -> 50 shards
fix: adjust flank-x86.yml shard value
try old results generator in flank-x86.yml
fix: legacy-junit-report -> legacy-junit-result
revert to modern reporting
2020-04-01 15:43:45 -07:00