Commit Graph

210 Commits (649d1a144de332c87c7e2dd3de78e28968472b56)

Author SHA1 Message Date
Markus Heiser 6579d6d558 [fix] qwant - API error::locale must be one ..
The request function should not request a language (aka locale) that is not
supported by qwant. Select a locale like zh-TW ends in qwant's API error:

  ERROR searx.engines.qwant news: exception : \
  API error::locale must be one of the following values: \
    en_gb, en_ie, en_us, en_ca, en_my, en_au, en_nz, de_de, de_ch, de_at, fr_fr, \
    fr_be, fr_ch, fr_ca, fr_ad, fc_ca, co_fr, es_es, es_ar, es_cl, es_co, es_mx, \
    es_pe, es_ad, ca_es, ca_ad, ca_fr, eu_es, eu_fr, it_it, it_ch, pt_pt, pt_ad, \
    nl_be, nl_nl

The existing searx.utils.match_language function is unsuitable for this purpose,
it is replaced by function searx.locales.get_engine_locale that is based on the
methods from the babel package.

The quant's _fetch_supported_languages function has been revised to filter out
languages 8aka locales) not supported by qwant.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2 years ago
Markus Heiser 73ffa0c070 Update searx.data - update_engine_descriptions.py
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2 years ago
Markus Heiser 14085cc0a7
Merge pull request #1580 from searxng/update_data_update_engine_descriptions.py
Update searx.data - update_engine_descriptions.py
2 years ago
Markus Heiser 7602c23d71
Merge pull request #1579 from searxng/update_data_update_currencies.py
Update searx.data - update_currencies.py
2 years ago
Markus Heiser 0bad4fb931
Merge pull request #1578 from searxng/update_data_update_firefox_version.py
Update searx.data - update_firefox_version.py
2 years ago
Markus Heiser 7dd75ae080
Merge pull request #1576 from searxng/update_data_update_languages.py
Update searx.data - update_languages.py
2 years ago
dalf 2bdb367e8c Update searx.data - update_engine_descriptions.py 2 years ago
dalf fc019fb296 Update searx.data - update_currencies.py 2 years ago
dalf c2662ec3c8 Update searx.data - update_firefox_version.py 2 years ago
dalf 385542e6c5 Update searx.data - update_ahmia_blacklist.py 2 years ago
dalf 90068b3d0b Update searx.data - update_languages.py 2 years ago
Markus Heiser 445cba7c02 Update searx.data - update_engine_descriptions.py
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2 years ago
Markus Heiser 81e8c7370f Update searx.data - update_engine_descriptions.py
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2 years ago
Markus Heiser 1416559f22 Update searx.data - update_engine_descriptions.py
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2 years ago
Markus Heiser 2bf800a4b1 Update searx.data - update_currencies.py
./manage pyenv.cmd python ./searxng_extra/update/update_currencies.py

Closes: https://github.com/searxng/searxng/pull/1375
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2 years ago
Markus Heiser eb3123e164
Merge pull request #1379 from searxng/update_data_update_ahmia_blacklist.py
Update searx.data - update_ahmia_blacklist.py
2 years ago
dalf a89fca9d08 Update searx.data - update_ahmia_blacklist.py 2 years ago
Markus Heiser 3a75d3c1cc
Merge pull request #1376 from searxng/update_data_update_firefox_version.py
Update searx.data - update_firefox_version.py
2 years ago
dalf 11def5155e Update searx.data - update_wikidata_units.py 2 years ago
dalf 21ab024469 Update searx.data - update_firefox_version.py 2 years ago
Markus Heiser e568da2314
Merge pull request #1266 from searxng/update_data_update_firefox_version.py
Update searx.data - update_firefox_version.py
2 years ago
Markus Heiser 84a5e48a90
Merge pull request #1265 from searxng/update_data_update_ahmia_blacklist.py
Update searx.data - update_ahmia_blacklist.py
2 years ago
Markus Heiser 78968843a8
Merge pull request #1267 from searxng/update_data_update_currencies.py
Update searx.data - update_currencies.py
2 years ago
Markus Heiser a9251cfeb4
Merge pull request #1268 from searxng/update_data_update_engine_descriptions.py
Update searx.data - update_engine_descriptions.py
2 years ago
Markus Heiser 61ee915064
Merge pull request #1264 from searxng/update_data_update_languages.py
Update searx.data - update_languages.py
2 years ago
dalf fda176144e Update searx.data - update_engine_descriptions.py 2 years ago
dalf f37b9978cb Update searx.data - update_currencies.py 2 years ago
dalf a93170725f Update searx.data - update_firefox_version.py 2 years ago
dalf 8d6d32bf6e Update searx.data - update_ahmia_blacklist.py 2 years ago
dalf 012d7fcaa0 Update searx.data - update_languages.py 2 years ago
dalf ab9616c2cc Update searx.data - update_wikidata_units.py 2 years ago
Markus Heiser 8a79eb4d7b
Merge pull request #1158 from searxng/update_data_update_currencies.py
Update searx.data - update_currencies.py
3 years ago
Markus Heiser 6bd6e09e14
Merge pull request #1159 from searxng/update_data_update_engine_descriptions.py
Update searx.data - update_engine_descriptions.py
3 years ago
Markus Heiser 9c7e9bf1d9
Merge pull request #1157 from searxng/update_data_update_wikidata_units.py
Update searx.data - update_wikidata_units.py
3 years ago
Markus Heiser 9e6000407a
Merge pull request #1156 from searxng/update_data_update_ahmia_blacklist.py
Update searx.data - update_ahmia_blacklist.py
3 years ago
dalf 6f0a717dce Update searx.data - update_engine_descriptions.py 3 years ago
dalf bdfbc0ec02 Update searx.data - update_currencies.py 3 years ago
dalf 6cb08a568a Update searx.data - update_wikidata_units.py 3 years ago
dalf 10023344a5 Update searx.data - update_ahmia_blacklist.py 3 years ago
dalf e36d7067a9 Update searx.data - update_firefox_version.py 3 years ago
Markus Heiser 62982c8812 [fix] add back missing languages & regions (followup of PR #1071)
In PR #1071 the language catalog of dailymotion has been cleaned up, before
there had been over 7000 "languages" in the catalog.

As a side effect of this clean-up the language & region catalog in SearXNG has
been reduced [1].

This patch reduce the ``min_engines_per_lang`` from 13 to 12 to get the missed
languages back in language & region catalog of SearXNG.

[1] 3bb62823ec (diff-f3f00db0f87f95b882624a192e0aac21525638af0b18c9514e765fcf1991678d)

Requested-by: @tiekoetter in a Matrix chat
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
3 years ago
Alexandre Flament 7bf9e12db9 Update searx.data - update_engine_descriptions.py 3 years ago
Markus Heiser 3bb62823ec [fix] dailymotion engine: filter by language & country
- fix the issue of fetching more the 7000 *languages*
- improve the request function and filter by language & country
- implement time_range_support & safesearch
- add more fields to the response from dailymotion (allow_embed, length)
- better clean up of HTML tags in the 'content' field.

This is more or less a complete rework based on the '/videos' API from [1].
This patch cleans up the language list in SearXNG that has been polluted by the
ISO-639-3 2 and 3 letter codes from dailymotion languages which have never been
used.

[1] https://developers.dailymotion.com/tools/

Closes: https://github.com/searxng/searxng/issues/1065
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
3 years ago
Alexandre Flament 765504ceca
Merge pull request #1031 from dalf/fix-bing-_fetch_supported_languages
Fix bing  fetch supported languages
3 years ago
Markus Heiser 099840f4d6
Merge pull request #1035 from searxng/update_data_update_wikidata_units.py
Update searx.data - update_wikidata_units.py
3 years ago
Markus Heiser b853ab717e
Merge pull request #1034 from searxng/update_data_update_ahmia_blacklist.py
Update searx.data - update_ahmia_blacklist.py
3 years ago
Markus Heiser c2de356497
Merge pull request #1033 from searxng/update_data_update_currencies.py
Update searx.data - update_currencies.py
3 years ago
dalf 086517d269 Update searx.data - update_wikidata_units.py 3 years ago
dalf d245ca97ca Update searx.data - update_ahmia_blacklist.py 3 years ago
dalf 084d9ab4e4 Update searx.data - update_currencies.py 3 years ago