sv-ohorvath
fd4ea5ae58
No issue: increase flaky tests attempts on Nightly tests
2 years ago
Julien Cristau
6d7ecb5dbb
Let relbot update A-C on trunk ( #26553 )
...
* Let relbot update A-C on trunk
We already use relbot for this on fenix release branches and on all
branches for focus-android, so might as well avoid the duplication.
* Update mergify rules to auto-merge AC bumps from relbot on the main branch
2 years ago
Julien Cristau
8c0945db3b
update_android_components: don't create an empty PR if we couldn't push
2 years ago
sv-ohorvath
f3ef15800c
Issue #25972 , #25971 : reduce test failures with more retries on legacy-api-tests
2 years ago
Aaron Train
8c1476e3f7
No issue: Add new cron target task for legacy API UI tests
...
Setups up a new daily cron task to run select UI tests on API 28 (we’ll call it legacy). We don’t necessarily want to invoke Flank twice (serial) with a different configuration (FTL APIs dont support API splitting per test-target) on event CI but we do want them running elsewhere (cron).
2 years ago
sv-ohorvath
9b35c6fd45
Move collections tests to CollectionTest class
2 years ago
Aaron Train
04daad863f
Upgrade AndroidX Espresso Deps and support API 30 ( #23904 )
2 years ago
Oana Horvath
886b4049cb
Re-organize existing tests to their own SettingsSearchTest class
3 years ago
Aaron Train
d1d846a60b
No issue: Update references and doc in parse-ui-test.py ( #23354 )
...
* No issue: Update references and doc in parse-ui-test.py
* Update parse-ui-test.py
* Clean up device data
* Revert device output
* Update parse-ui-test.py
* Update parse-ui-test.py
* Update parse-ui-test.py
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
3 years ago
Aaron Train
4263ccf937
No issue: Add shared docs/team links to parse-ui-test.py
3 years ago
AndiAJ
f91285881d
Improve homeThreeDotMenuItemsTest UI test coverage
3 years ago
Aaron Train
6fbeff1ca1
Closes #21340 : Disable auto Google login in Flank config ( #21341 )
3 years ago
Aaron Train
5ff2c21849
Filter out test target packages in Flank-x86 ( #20841 )
...
* Filter out test target packages in Flank-x86
* Ignore verifyRunBlockingAndStrictModeSuppresionCount
3 years ago
Stefan Arentz
6a3adb5aeb
Fixes #11427 - Rename master branch to main ( #20457 )
...
* Fixes #11427 - Rename master branch to main (Automation/TC)
* Fixes #11427 - Rename master branch to main (GitHub Workflows)
* Fixes #11427 - Rename master branch to main (GitHub Workflows)
* Fixes #11427 - Rename master branch to main (GitHub Issue Templates)
* Fixes #11427 - Rename master branch to main (Jenkins)
* Fixes #11427 - Rename master branch to main (README & Documentation)
* Fixes #11427 - Rename master branch to main (Jenkins)
* Fixes #11427 - Rename master branch to main (Random)
3 years ago
Aaron Train
a516bb6681
No issue: Update Flank to v21.07.1 ( #20456 )
...
* Update Flank to v21.07.1
* Update approach to downloading Flank
* Update parse-ui-test.py
3 years ago
Aaron Train
3b6434d7f6
Test full-junit-result in Flank config ( #19897 )
3 years ago
Aaron Train
e6e7b1ab92
Add matrix outcome details to parse-ui-test.py ( #19900 )
3 years ago
Sebastian Kaspari
0ad7677309
update_android_components.sh: Watch different component.
...
`browser-engine-gecko-nightly` doesn't exist anymore. Let's watch `browser-engine-gecko` instead.
3 years ago
Aaron Train
83b04f8b64
No issue: test one shard per UI test on FTL ( #18998 )
3 years ago
Oana Horvath
b43a11e9f6
Added UI smoke tests to run on Beta builds.
3 years ago
Oana Horvath
be86061a11
Add first set of UI tests to Nightly
4 years ago
isabelrios
6002f944e8
Taskgraph changes to allow running UI tests on nightly builds ( #18191 )
...
* Modify taskgraph to allow running UI tests on Nightly builds
* adding try_task_config file
* remove try_task_config file
4 years ago
Mugurell
611ff8f25b
For #17195 - Don't try setting an idle resource if the View is already off screen
...
Speculative fix based on the Firebase logs which shows that on a second check
of R.id.tab_wrapper it is not found the screen.
It may be because after `advanceToHalfExpandedState` and before getting a
reference to it in `waitForTabTrayBehaviorToIdle` it was already animated off
the screen.
With this in mind I've added a null check for the view reference before trying
to register an idling resource on it's Behavior.
Also added and used a way to click at a specific location in a View, not just
in the default middle in the View.
It was observed from the Firebase videos that a "click" on the topBar actually
selected the private tabs section. This would leave us to believe that the
"click" was caught by that other View which was placed above the x,y middle of
the topBar.
4 years ago
Mugurell
32493491fa
For #17195 - Test a potential fix for the test
4 years ago
isabelrios
243080ab7c
Revert "Add UI tests nightly build ( #17948 )" ( #17960 )
...
This reverts commit 032879991e
.
4 years ago
isabelrios
032879991e
Add UI tests nightly build ( #17948 )
...
* Try adding UI Tests to Nightly build
* adding try_config file
* remove try_task_config
4 years ago
isabelrios
47d7476f9c
Revert "Run UI tests nightly def ( #17513 )" ( #17761 )
...
This reverts commit 06c1734aa5
.
4 years ago
isabelrios
06c1734aa5
Run UI tests nightly def ( #17513 )
...
* run-ui-test-nightly
* Run ui tests on nightly build
* set correct number of shard according to tests running
* fix typo
* removing testing file
Co-authored-by: isabel rios <isabelrios@MBP-de-isabel-2.home>
4 years ago
isabelrios
d8584ed632
Changes to run tests on beta builds ( #16786 )
...
* Changes to run tests on beta builds
* remove dontoptime and fix bookmarks tests
* fix ktlint and smokeTest
* add variable for package name
* rebase and fix conflicts
* add yml files and modify script to run tests
* fix yml file indentation
* changes in kind file and add try_task
* fix error kind file
* fix error kind file 2
* fix error kind file 3
* fix reviewer comments
* remove mockwebserver implementation as per reviewer comment
* run beta tests only on releases branches
* reg exp for master branch
* reg exp for master branch2
* modify try_task with release branch
* remove try file
* let's start by running only one test
* address latest reviewers comments
* double check correct tasks for release branch
* remove try file after confirming beta build run
Co-authored-by: isabel rios <isabelrios@MBP-de-isabel-2.home>
4 years ago
Sebastian Kaspari
c93a29f89a
Simplify build variants to just: debug, nightly, beta and release.
...
Co-authored-by: Johan Lorenzo <jlorenzo@mozilla.com>
4 years ago
Kainalu Hagiwara
a8fd37740d
For #13066 - Translate locale codes to Android specific variants before filtering
4 years ago
Kainalu Hagiwara
6b8eca0700
Move release locales to a separate config file.
...
We should leave l10n.toml untouched unless the l10n team wants to
change it.
4 years ago
Kainalu Hagiwara
98d5ae6b89
For #12759 - Keep a separate list of release locales.
4 years ago
isabelrios
5b61b44f1a
cron-job-ui-screenshots ( #12423 )
...
Co-authored-by: isabel rios <isabelrios@MacBook-Pro-de-isabel-2.local>
4 years ago
Tiger Oakes
67758ab19d
For #11886 - Re-enable codecov ( #12258 )
...
* Re-enable codecov
* Use local script
* Revert to old codecov script
4 years ago
Richard Pappalardo
f40e0acf96
Fixes #11050 - Remove Nimbledroid
4 years ago
Aaron Train
ea9d6897db
Closes #10611 - Fix exit status of Flank ( #10612 )
4 years ago
Aaron Train
378cf2eff9
No issue: remove listing directory contents on UI test results ( #10354 )
4 years ago
Alessio Placitelli
824dedb195
Trigger UI test
4 years ago
Richard Pappalardo
3de789d51a
Fixes #6760 - Show UI test results in TC task ( #10089 )
4 years ago
Aaron Train
39791a9f42
No issue: Set all Flank templates to one AVD ( #9745 )
4 years ago
Aaron Train
72582d9c8f
No issue: Restore num-flaky-test-attempts in flank-x86.yml ( #9675 )
4 years ago
Aaron Train
943d3837b2
No issue: remove num-flaky-test-attempts from all Flank templates ( #9635 )
4 years ago
Aaron Train
8b34f372b0
Closes #9433 : Update Flank version in ui-tests Dockerfile ( #9466 )
...
fix: flank_snapshot requires direct shard value
-1 shards -> 50 shards
fix: adjust flank-x86.yml shard value
try old results generator in flank-x86.yml
fix: legacy-junit-report -> legacy-junit-result
revert to modern reporting
4 years ago
Richard Pappalardo
a4740e0828
Closes #9469 - Change UI test failure output
5 years ago
Johan Lorenzo
699d5b7b15
Bug 1620190 - Run android-components bumps once a day ( #9251 )
5 years ago
Aaron Train
3ea8023a27
No issue: Swap AVD (x86) Nexus 6 (API 25) with a Nexus6P (API 27) ( #9259 )
...
The Nexus 6 (x86 AVD) on API 25 is causing too many instablility issues. Let’s see what happens with a Nexus 6P on API 27.
5 years ago
Johan Lorenzo
d390baefaf
Bug 1608103 - Fix dummy secrets generation ( #8855 )
5 years ago
Johan Lorenzo
cb7791d7ed
Make nimbledroid not depend on a real token on staging releases ( #7570 )
5 years ago
Severin Rudie
d146e75682
3088 filter locales 2nd try ( #7839 )
...
* For #3088 : filter incomplete locales in release builds
* For 3088: update locale filtering to not error on nightly builds
5 years ago