You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
searxng/searx/engines
Markus Heiser 27369ebec2 [fix] searxng_extra/update/update_engine_descriptions.py (part 1)
Follow up of #2269

The script to update the descriptions of the engines does no longer work since
PR #2269 has been merged.

searx/engines/wikipedia.py
==========================

1. There was a misusage of zh-classical.wikipedia.org:

   - `zh-classical` is dedicate to classical Chinese [1] which is not
     traditional Chinese [2].

   - zh.wikipedia.org has LanguageConverter enabled [3] and is going to
     dynamically show simplified or traditional Chinese according to the
     HTTP Accept-Language header.

2. The update_engine_descriptions.py needs a list of all wikipedias.  The
   implementation from #2269 included only a reduced list:

   - https://meta.wikimedia.org/wiki/Wikipedia_article_depth
   - https://meta.wikimedia.org/wiki/List_of_Wikipedias

searxng_extra/update/update_engine_descriptions.py
==================================================

Before PR #2269 there was a match_language() function that did an approximation
using various methods.  With PR #2269 there are only the types in the data model
of the languages, which can be recognized by babel.  The approximation methods,
which are needed (only here) in the determination of the descriptions, must be
replaced by other methods.

[1] https://en.wikipedia.org/wiki/Classical_Chinese
[2] https://en.wikipedia.org/wiki/Traditional_Chinese_characters
[3] https://www.mediawiki.org/wiki/Writing_systems#LanguageConverter

Closes: https://github.com/searxng/searxng/issues/2330
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
..
9gag.py get the not cropped version of the thumbnail when the image height is not too important 2 years ago
1337x.py [format.python] initial formatting of the python code 3 years ago
__init__.py [mod] clarify the difference of the default category and subgrouping 1 year ago
ahmia.py [format.python] initial formatting of the python code 3 years ago
apkmirror.py rollback test 2 years ago
apple_app_store.py remove thumbnail from results 2 years ago
apple_maps.py add poi's website and phone number, doesn't crash when there is no `displayMapRegion`, query the token on the first request 2 years ago
archlinux.py [mod] Archlinux Wiki: improved request API & upgrade to data_type: traits_v1 1 year ago
artic.py [format.python] initial formatting of the python code 3 years ago
arxiv.py Science category: update the engines 2 years ago
bandcamp.py [mod] bandcamp & genius: in result set img_src instead thumbnail 3 years ago
base.py [format.python] initial formatting of the python code 3 years ago
bing.py [fix] Bing-WEB: use <span class='algoSlug_icon'> for the description 1 year ago
bing_images.py [mod] bing_images: use async API & upgrade to data_type: traits_v1 1 year ago
bing_news.py [mod] bing_news: use async API & upgrade to data_type: traits_v1 1 year ago
bing_videos.py [mod] bing_videos: use async API & upgrade to data_type: traits_v1 1 year ago
btdigg.py [format.python] initial formatting of the python code 3 years ago
command.py [format.python] initial formatting of the python code 3 years ago
core.py [fix] doc of the paper.html template (isbn, issn) 2 years ago
crossref.py [mod] make python code pylint 2.16.1 compliant 2 years ago
currency_convert.py [pylint] engines/currency_convert.py 3 years ago
dailymotion.py [mod] Dailymotion: improved request API & upgrade to data_type: traits_v1 1 year ago
deepl.py [mod] add deepl translation engine 2 years ago
deezer.py [mod] templates: rename field for <iframe> URL to iframe_src 3 years ago
demo_offline.py [mod] replace engines_languages.json by engines_traits.json 1 year ago
demo_online.py [mod] add 'Accept-Language' HTTP header to online processores 2 years ago
deviantart.py [format.python] initial formatting of the python code 3 years ago
dictzone.py [format.python] initial formatting of the python code 3 years ago
digbt.py [format.python] initial formatting of the python code 3 years ago
docker_hub.py [mod] make python code pylint 2.16.1 compliant 2 years ago
doku.py [fix] issues reported by pylint 3 years ago
duckduckgo.py [fix] engine ddg: quote !bangs in a request send to ddg 1 year ago
duckduckgo_definitions.py [mod] DuckDuckGo: reversed engineered & upgrade to data_type: traits_v1 1 year ago
duckduckgo_images.py [mod] DuckDuckGo: reversed engineered & upgrade to data_type: traits_v1 1 year ago
duckduckgo_weather.py [mod] clarify the difference of the default category and subgrouping 1 year ago
duden.py [fix] engine duden - don't raise exception on empty result list 2 years ago
dummy-offline.py [format.python] initial formatting of the python code 3 years ago
dummy.py [enh] engines: add about variable 4 years ago
ebay.py [mod] Pass desired ebay domain in settings 2 years ago
elasticsearch.py [format.python] initial formatting of the python code 3 years ago
emojipedia.py [fix] emojipedia - update XPath to be relative 2 years ago
fdroid.py [enh] add more categories 3 years ago
flickr.py [format.python] initial formatting of the python code 3 years ago
flickr_noapi.py [fix] engine flickr: adapt to the new data model from flicker's response 1 year ago
framalibre.py [format.python] initial formatting of the python code 3 years ago
freesound.py [mod] result_templates/default.html replace embedded HTML by data_src audio_src 3 years ago
frinkiac.py [format.python] initial formatting of the python code 3 years ago
genius.py [mod] bandcamp & genius: in result set img_src instead thumbnail 3 years ago
gentoo.py [mod] remove obsolete EngineTraits.supported_languages 1 year ago
github.py [fix] typos / reported by @kianmeng in searx PR-3366 2 years ago
google.py [fix] engine: google has changed the layout of its response 1 year ago
google_images.py [mod] Google: reversed engineered & upgrade to data_type: traits_v1 1 year ago
google_news.py [fix] engine google-News: fix decoding of URLs (part 2) 1 year ago
google_play_apps.py [mod] add 'Accept-Language' HTTP header to online processores 2 years ago
google_scholar.py [mod] Google: reversed engineered & upgrade to data_type: traits_v1 1 year ago
google_videos.py [mod] Google: reversed engineered & upgrade to data_type: traits_v1 1 year ago
imdb.py [enh] move dictionaries, Erowid & IMDb out of general category 3 years ago
ina.py [fix] ina engine 3 years ago
invidious.py [mod] templates: rename field for <iframe> URL to iframe_src 3 years ago
jisho.py [format.python] based on bugfix in 9ed626130 2 years ago
json_engine.py [enh] Initial no paging support for Yep.com 2 years ago
kickass.py [format.python] initial formatting of the python code 3 years ago
lingva.py [mod] Adds Lingva translate engine 2 years ago
loc.py [format.python] initial formatting of the python code 3 years ago
mediathekviewweb.py [fix] engine mediathekviewweb: replace http links by https 3 years ago
mediawiki.py [format.python] initial formatting of the python code 3 years ago
meilisearch.py [pylint] engines: drop no longer needed 'missing-function-docstring' 3 years ago
metacpan.py Add MetaCPAN engine 2 years ago
mixcloud.py [mod] add artwork to mixcloud & soundcloud engines 3 years ago
mongodb.py [fix] pyright repported errors 2 years ago
mysql_server.py [fix] pyright repported errors 2 years ago
nyaa.py [format.python] initial formatting of the python code 3 years ago
opensemantic.py [enh] engines: add about variable 4 years ago
openstreetmap.py [mod] add 'Accept-Language' HTTP header to online processores 2 years ago
openverse.py [fix] ccengine engine - avoid unwanted redirects 3 years ago
pdbe.py [format.python] initial formatting of the python code 3 years ago
peertube.py [mod] Peertube: re-engineered & upgrade to data_type: traits_v1 1 year ago
petal_images.py [enh] Initial Petalsearch Images support 2 years ago
photon.py [fix] typos / reported by @kianmeng in searx PR-3366 2 years ago
piratebay.py [format.python] initial formatting of the python code 3 years ago
postgresql.py [fix] pyright repported errors 2 years ago
pubmed.py Science category: update the engines 2 years ago
qwant.py [mod] qwant: fetch engine traits (data_type: traits_v1) 1 year ago
recoll.py [format.python] initial formatting of the python code 3 years ago
reddit.py [format.python] initial formatting of the python code 3 years ago
redis_server.py [format.python] initial formatting of the python code 3 years ago
rumble.py [format.python] initial formatting of the python code 3 years ago
scanr_structures.py [format.python] initial formatting of the python code 3 years ago
searchcode_code.py [format.python] initial formatting of the python code 3 years ago
searx_engine.py reference docs.searxng.org 3 years ago
semantic_scholar.py [mod] science category: various update of about PR 1705 2 years ago
sepiasearch.py [mod] SepiaSearch: re-engineered & upgrade to data_type: traits_v1 1 year ago
seznam.py [fix] engine seznam: fix issues reported by black & pylint 1 year ago
sjp.py [fix] sjp engine - convert enginename to a latin1 compliance name 2 years ago
solidtorrents.py [fix] solidtorrents engine: store random bas_url in param 3 years ago
solr.py [format.python] initial formatting of the python code 3 years ago
soundcloud.py [mod] add artwork to mixcloud & soundcloud engines 3 years ago
spotify.py [mod] templates: rename field for <iframe> URL to iframe_src 3 years ago
springer.py [fix] springer: unsupported operand type(s) for +: 'NoneType' and 'str' 2 years ago
sqlite.py [format.python] initial formatting of the python code 3 years ago
stackexchange.py [format.python] initial formatting of the python code 3 years ago
startpage.py [mod] Startpage: reversed engineered & upgrade to data_type: traits_v1 1 year ago
tineye.py [fix] engine tineye: handle 422 response of not supported img format 2 years ago
tokyotoshokan.py [format.python] initial formatting of the python code 3 years ago
torznab.py [format.python] initial formatting of the python code 3 years ago
translated.py [enh] move dictionaries, Erowid & IMDb out of general category 3 years ago
twitter.py add explanation of token 2 years ago
unsplash.py [format.python] initial formatting of the python code 3 years ago
vimeo.py [mod] templates: rename field for <iframe> URL to iframe_src 3 years ago
wikidata.py [fix] searxng_extra/update/update_engine_descriptions.py (part 1) 1 year ago
wikipedia.py [fix] searxng_extra/update/update_engine_descriptions.py (part 1) 1 year ago
wolframalpha_api.py [fix] typos / reported by @kianmeng in searx PR-3366 2 years ago
wolframalpha_noapi.py [format.python] initial formatting of the python code 3 years ago
wordnik.py [format.python] initial formatting of the python code 3 years ago
wttr.py [mod] clarify the difference of the default category and subgrouping 1 year ago
www1x.py [fix] 1x engine 3 years ago
xpath.py [fix] typos / reported by @kianmeng in searx PR-3366 2 years ago
yacy.py [format.python] initial formatting of the python code 3 years ago
yahoo.py [mod] yahoo: fetch engine traits (data_type: traits_v1) 1 year ago
yahoo_news.py [fix] issues reported by pylint 3 years ago
youtube_api.py [mod] templates: rename field for <iframe> URL to iframe_src 3 years ago
youtube_noapi.py [fix] google & youtube - set EU consent cookie 2 years ago
zlibrary.py [fix] engine z-zlibrary https URL 2 years ago