blob42
/
searxng
forked from Archives/searxng
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
6,927 Commits
10 Branches
17 Tags
41 MiB
whitelist-ratelimiter
mine
gh-pages
master
dependabot/pip/master/flask-babel-3.0.0
translations
dependabot/pip/master/mock-5.0.1
dependabot/pip/master/yamllint-1.29.0
dependabot/pip/master/pylint-2.15.10
dependabot/pip/master/sphinx-6.1.3
v1.0.0
v0.18.0
v0.17.0
v0.16.0
v0.15.0
v0.14.0
v0.13.1
v0.13.0
v0.12.0
v0.11.0
v0.10.0
v0.9.0
v0.8.1
v0.8.0
v0.7.0
v0.6.0
1.0.0
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'master'
${ noResults }
Commit Graph

36 Commits (master)

Author SHA1 Message Date
Markus Heiser 62982c8812 [fix] add back missing languages & regions (followup of PR #1071) 
In PR #1071 the language catalog of dailymotion has been cleaned up, before
there had been over 7000 "languages" in the catalog.

As a side effect of this clean-up the language & region catalog in SearXNG has
been reduced [1].

This patch reduce the ``min_engines_per_lang`` from 13 to 12 to get the missed
languages back in language & region catalog of SearXNG.

[1] 3bb62823ec (diff-f3f00db0f87f95b882624a192e0aac21525638af0b18c9514e765fcf1991678d)

Requested-by: @tiekoetter in a Matrix chat
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2 years ago
Markus Heiser 3bb62823ec [fix] dailymotion engine: filter by language & country 
- fix the issue of fetching more the 7000 *languages*
- improve the request function and filter by language & country
- implement time_range_support & safesearch
- add more fields to the response from dailymotion (allow_embed, length)
- better clean up of HTML tags in the 'content' field.

This is more or less a complete rework based on the '/videos' API from [1].
This patch cleans up the language list in SearXNG that has been polluted by the
ISO-639-3 2 and 3 letter codes from dailymotion languages which have never been
used.

[1] https://developers.dailymotion.com/tools/

Closes: https://github.com/searxng/searxng/issues/1065
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2 years ago
Markus Heiser effcde3d0e [fix] add missing territory (country) name 
Related-to: https://github.com/searxng/searxng/pull/1029#issuecomment-1086824911
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2 years ago
Alexandre FLAMENT 7d31b2c0af Update languages 2 years ago
Markus Heiser 2e4557f3f3 [fix] languages: show country name even if there is only one country 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2 years ago
Markus Heiser a25e3767d4 [fix] don't show flags for languages without region identifier 
SearXNG shows two different things:

region:
  "de-CH" is the equivalent of "Schweiz (de)" in DDG.

languages:
  "en" doesn't say anything about the location. It is up the engines to do their
  best to select English results without a region.

Suggested-by: @dalf https://github.com/searxng/searxng/pull/967#issuecomment-1072979693
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2 years ago
Markus Heiser 2841abaf55 [mod] add flags to the languages filter 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2 years ago
Markus Heiser 3cdf2d6570 Update searx.data - update_languages.py 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2 years ago
Markus Heiser 3d96a9839a [format.python] initial formatting of the python code 
This patch was generated by black [1]::

    make format.python

[1] https://github.com/psf/black

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2 years ago
Alexandre Flament 828088fa5a [mod] update_languages: min_engines_per_country=7 
a (language,country) tuple is included if 7 engines have it, was 10 before.

close #432
 3 years ago
dalf db51a64390 Update searx.data - update_languages.py 3 years ago
Markus Heiser 274edd523c [fix] get common used languages back (min_engines_per_lang = 13) 
In commit 4d3f2f48d common used languages has been droped.  By reducing the
number of `min_engines_per_lang` from 15 to 13 we get theses languages back.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 3 years ago
dalf 4d3f2f48d2 Update searx.data - update_languages.py 3 years ago
dalf d9dc3376d0 Update searx.data - update_languages.py 3 years ago
Markus Heiser ff6804e545 [data] make engines.languages 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 3 years ago
Marc Abonce Seguin ecf5899153 fetch google's search langs rather than ui langs 4 years ago
Marc Abonce Seguin c86504b47a fix utils/fetch_languages to work with new languages 4 years ago
Dalf 1022228d95 Drop Python 2 (1/n): remove unicode string and url_utils 4 years ago
Markus Heiser 79412828cd update languages: engines_languages.json languages.py 
build by Makefile target:

    make project

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 4 years ago
Marc Abonce Seguin d1eae9359f fix fetch_langauges to be more accurate 
Add languages supported by either all default general engines or 10 engines.
 6 years ago
marc 44085e31d0 update engines_languages.json and languages.py 
Also, fix fetch_languages.py so it can run on python3.
 7 years ago
marc fd65c12921 make search language handling less strict 
languages.py can change, so users may query on a language that is not
on the list anymore, even if it is still recognized by a few engines.

also made no and nb the same because they seem to return the same,
though most engines will only support one or the other.
 7 years ago
marc 805fb02ed1 add language support for qwant 
closes issue #863
 7 years ago
marc 1175b3906f change language list to only include languages with a minimum of engines 
that support them.
users can still query lesser supported through the :lang_code bang.
 7 years ago
marc 4a1ff56389 minor fixes in utils/fetch_languages.py 8 years ago
marc af35eee10b tests for _fetch_supported_languages in engines 
and refactor method to make it testable without making requests
 8 years ago
marc f62ce21f50 [mod] fetch supported languages for several engines 
utils/fetch_languages.py gets languages supported by each engine and
generates engines_languages.json with each engine's supported language.
 8 years ago
marc 92c6e88ad3 small fixes 8 years ago
marc 922d51bf0c Add country names in language list. 8 years ago
marc a11948c71b Add language support for more engines. 8 years ago
marc c677aee58a filter langauges 8 years ago
marc 149802c569 [enh] add supported_languages on engines and auto-generate languages.py 8 years ago
Noemi Vanyi 1805cfd20a sort languages properly 8 years ago
Adam Tauber 2b0605d723 [enh] add occitan search language - example query: ":oc !wp south" - closes #445 8 years ago
Thomas Pointhuber 7da4b3dc82 add comments to languages.py 
* add comments
* add licence-header
 10 years ago
asciimoo 2a788c8f29 [enh] search language support init 10 years ago