You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
searxng/searx
Markus Heiser ed901ab18e [mod] improve 'Autodetect search language' plugin
- Add documentation to the plugin
- Harmonize FastText language model with SearXNG's language model

Reosurces::

    import fasttext                                    # --> +10 MB
    fasttext.load_model(str(data_dir / 'lid.176.ftz')) # --> +4MB

Suggested-by: @dalf

- To speed up and simplify the deployment use fasttext-wheel instead of fasttext
- Building numpy on the Alpine Linux of docker-images takes ages --> install
  py3-numpy from Alpines package manager (apk)
- Alpine Linux on docker-images (musl libc) do not support fasttext-wheel (gnu
  libc) --> patch Dockerfile and build from fastetxt:

     sed -i s/fasttext-wheel/fasttext/ requirements.txt

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2 years ago
..
answerers [fix] issue reported by pylint 22.1.0 2 years ago
data [mod] new plugin: Autodetect search language 2 years ago
engines Fix: don't crash when engine or name is missing in settings.yml 2 years ago
infopage Donation link: default value to searxng.org, can be hidden or custom 2 years ago
metrics [fix] prepare for pylint 2.14.0 2 years ago
network Update network.py 2 years ago
plugins [mod] improve 'Autodetect search language' plugin 2 years ago
search Initialize Redis in searx/webapp.py 2 years ago
shared Copy client connection kwargs before mutating 2 years ago
static [build] /static 2 years ago
templates/simple [fix] typos / reported by @kianmeng in searx PR-3366 2 years ago
translations [translations] update from Weblate 2 years ago
__init__.py [format.python] initial formatting of the python code 3 years ago
autocomplete.py remove the print statement 2 years ago
babel_extract.py [mod] move category and names of constants to searx/searxng.msg 2 years ago
compat.py [fix] pyright repported errors 2 years ago
exceptions.py [pyright:strict] searx.search.checker.background 2 years ago
external_bang.py External bang: bug fix: URL encode the query so "!!g 1+1" works as intended 2 years ago
external_urls.py [fix] typos / reported by @kianmeng in searx PR-3366 2 years ago
flaskfix.py [format.python] initial formatting of the python code 3 years ago
languages.py [fix] add back missing languages & regions (followup of PR #1071) 2 years ago
locales.py searx.locale: add Dhivehi language 2 years ago
preferences.py [fix] typos / reported by @kianmeng in searx PR-3366 2 years ago
query.py [fix] typos / reported by @kianmeng in searx PR-3366 2 years ago
redislib.py [mod] redislib - optimize LUA script registration. 2 years ago
results.py [fix] typos / reported by @kianmeng in searx PR-3366 2 years ago
searxng.msg Science category: update the engines 2 years ago
settings.yml [mod] improve 'Autodetect search language' plugin 2 years ago
settings_defaults.py Initialize Redis in searx/webapp.py 2 years ago
settings_loader.py [fix] typos / reported by @kianmeng in searx PR-3366 2 years ago
unixthreadname.py [format.python] initial formatting of the python code 3 years ago
utils.py [fix] typos / reported by @kianmeng in searx PR-3366 2 years ago
version.py [fix] pyright repported errors 2 years ago
webadapter.py [fix] typos / reported by @kianmeng in searx PR-3366 2 years ago
webapp.py The checker requires Redis 2 years ago
webutils.py [fix] typos / reported by @kianmeng in searx PR-3366 2 years ago