Markus Heiser
e62733fcf3
Merge pull request #571 from searxng/update_data_update_languages.py
...
Update searx.data - update_languages.py
3 years ago
Markus Heiser
24d04f2854
Merge pull request #570 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
3 years ago
Markus Heiser
a3fc1304cc
Merge pull request #569 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
3 years ago
dalf
c74b465ece
Update searx.data - update_languages.py
3 years ago
dalf
56e653011f
Update searx.data - update_firefox_version.py
3 years ago
dalf
b833e08fc3
Update searx.data - update_currencies.py
3 years ago
dalf
5fdf8f04b7
Update searx.data - update_ahmia_blacklist.py
3 years ago
Markus Heiser
07f849cd56
Merge pull request #468 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
3 years ago
Markus Heiser
853a144bb4
Merge pull request #467 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
3 years ago
Markus Heiser
82a0dfab61
Merge pull request #466 from searxng/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
3 years ago
dalf
f3dfdad1d1
Update searx.data - update_ahmia_blacklist.py
3 years ago
dalf
2be4c35f76
Update searx.data - update_firefox_version.py
3 years ago
dalf
073d3edc0c
Update searx.data - update_wikidata_units.py
3 years ago
dalf
3d9be86519
Update searx.data - update_currencies.py
3 years ago
Markus Heiser
f63ffbb22b
[fix] engine - yahoo: rewrite and fix issues
...
Languages are supported by mapping the language to a domain. If domain is not
found in :py:obj:`lang2domain` URL ``<lang>.search.yahoo.com`` is used.
BTW: fix issue reported at https://github.com/searx/searx/issues/3020
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
3 years ago
Alexandre Flament
1bb82a6b54
SearXNG: searxng_extra
3 years ago
Markus Heiser
fda5609a17
Merge pull request #360 from return42/ddg-lite
...
Implement a DuckDuckGo Lite engine
3 years ago
Markus Heiser
97419a770d
[upd] make data.languages
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
3 years ago
Markus Heiser
c74f45b1df
Merge pull request #365 from searxng/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
3 years ago
Markus Heiser
62ea3c7074
Merge pull request #366 from searxng/update_data_update_languages.py
...
Update searx.data - update_languages.py
3 years ago
Markus Heiser
d814f1182f
Merge pull request #364 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
3 years ago
Markus Heiser
8479a83411
Merge pull request #363 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
3 years ago
dalf
db51a64390
Update searx.data - update_languages.py
3 years ago
dalf
a582e55af0
Update searx.data - update_wikidata_units.py
3 years ago
dalf
56c68beb42
Update searx.data - update_firefox_version.py
3 years ago
dalf
453114fbe4
Update searx.data - update_ahmia_blacklist.py
3 years ago
dalf
0c24a03f05
Update searx.data - update_currencies.py
3 years ago
Alexandre Flament
bfd24d1226
[mod] add /engine_descriptions.json endpoint
...
returns engine descriptions (JSON):
* key: engine name
* value: description in the user locale, use English description as a fallback
3 years ago
Markus Heiser
065b4dab56
Merge pull request #278 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
3 years ago
Markus Heiser
a7a879181d
Merge pull request #279 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
3 years ago
Markus Heiser
00a51fa17f
Merge pull request #280 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
3 years ago
dalf
9e3113865d
Update searx.data - update_firefox_version.py
3 years ago
dalf
a45fc66e83
Update searx.data - update_currencies.py
3 years ago
dalf
44f7e1fcaa
Update searx.data - update_ahmia_blacklist.py
3 years ago
dalf
a556d0c1aa
Update searx.data - update_wikidata_units.py
3 years ago
Markus Heiser
e0ca749ff5
Merge pull request #242 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
3 years ago
Alexandre Flament
b6711ba0ad
Merge pull request #241 from searxng/update_data_update_languages.py
...
Update searx.data - update_languages.py
3 years ago
Markus Heiser
0fc1dcbfa5
Merge pull request #243 from searxng/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
3 years ago
dalf
7fae5647d3
Update searx.data - update_wikidata_units.py
3 years ago
dalf
2963c83daa
Update searx.data - update_currencies.py
3 years ago
dalf
4d3f2f48d2
Update searx.data - update_languages.py
3 years ago
dalf
f5389fd722
Update searx.data - update_firefox_version.py
3 years ago
Markus Heiser
ef6e1bd6b9
[fix] Qwant engines - implement API v3 and add 'quant videos'
...
The implementation uses the Qwant API (https://api.qwant.com/v3 ). The API is
undocumented but can be reverse engineered by reading the network log of
https://www.qwant.com/ queries.
This implementation is used by different qwant engines in the settings.yml::
- name: qwant
categories: general
...
- name: qwant news
categories: news
...
- name: qwant images
categories: images
...
- name: qwant videos
categories: videos
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
3 years ago
Alexandre Flament
961dd287a1
Merge pull request #185 from searxng/update_data_update_external_bangs.py
...
Update searx.data - update_external_bangs.py
3 years ago
Alexandre Flament
508195a850
Merge pull request #186 from searxng/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
3 years ago
Alexandre Flament
89a27f4f96
Merge pull request #187 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
3 years ago
dalf
973d507410
Update searx.data - update_ahmia_blacklist.py
3 years ago
dalf
f6a8a5d017
Update searx.data - update_firefox_version.py
3 years ago
dalf
77a432cc95
Update searx.data - update_wikidata_units.py
3 years ago
dalf
726ad776a3
Update searx.data - update_external_bangs.py
3 years ago
Markus Heiser
5cf1ae2672
[pylint] searx/data/__init__.py
...
BTW: add doc strings and moved __all__ to the top [1]
[1] https://www.python.org/dev/peps/pep-0008/#module-level-dunder-names
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
3 years ago
Alexandre Flament
2e5d823162
[fix] searx/data/__init__.py: rename __init__ as __all__
3 years ago
Alexandre Flament
c75425655f
[enh] openstreetmap / map template: improve results
...
implements ideas described in #69
* update the engine
* use wikidata
* update map.html template
3 years ago
Alexandre Flament
cf2b549967
Update engines_languages.json
3 years ago
Alexandre Flament
925c21ce42
Merge pull request #122 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
3 years ago
Alexandre Flament
3266738e7a
Merge pull request #121 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
3 years ago
Alexandre Flament
54ae95b95b
Merge pull request #120 from searxng/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
3 years ago
dalf
43d06e8224
Update searx.data - update_ahmia_blacklist.py
3 years ago
dalf
e53ed4742c
Update searx.data - update_currencies.py
3 years ago
dalf
666a25314a
Update searx.data - update_wikidata_units.py
3 years ago
dalf
9f3a455777
Update searx.data - update_firefox_version.py
3 years ago
Marc Abonce Seguin
448bfe6005
fix Qwant's fetch_languages function
4 years ago
Alexandre Flament
2756e170ce
Merge pull request #49 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
4 years ago
Alexandre Flament
a3a7be90ff
Merge pull request #50 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
4 years ago
Alexandre Flament
4558c0c027
Merge pull request #48 from searxng/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
4 years ago
dalf
dd8a5a00dc
Update searx.data - update_currencies.py
4 years ago
dalf
de54209f9e
Update searx.data - update_ahmia_blacklist.py
4 years ago
dalf
982a5a7d2e
Update searx.data - update_wikidata_units.py
4 years ago
dalf
c004712eef
Update searx.data - update_firefox_version.py
4 years ago
Noémi Ványi
7612e5d9fd
Merge pull request #2712 from searx/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
4 years ago
Noémi Ványi
985e8b28fe
Merge pull request #2710 from searx/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
4 years ago
Noémi Ványi
feb2d81874
Merge pull request #2709 from searx/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
4 years ago
Noémi Ványi
9a962c5369
Merge pull request #2711 from searx/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
4 years ago
dalf
c0668d248e
Update searx.data - update_languages.py
4 years ago
dalf
ad74c42aa1
Update searx.data - update_firefox_version.py
4 years ago
dalf
23dc7ef6d1
Update searx.data - update_wikidata_units.py
4 years ago
dalf
eb5cd7a543
Update searx.data - update_ahmia_blacklist.py
4 years ago
dalf
f804f54ca3
Update searx.data - update_currencies.py
4 years ago
Alexandre Flament
87f4cc4a9e
Merge pull request #2631 from searx/update_data_update_languages.py
...
Update searx.data - update_languages.py
4 years ago
Alexandre Flament
0165e14a7f
Merge pull request #2632 from searx/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
4 years ago
Alexandre Flament
152f6fc1da
Merge pull request #2630 from searx/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
4 years ago
dalf
1e8b846954
Update searx.data - update_currencies.py
4 years ago
dalf
2f8a708481
Update searx.data - update_wikidata_units.py
4 years ago
dalf
d9dc3376d0
Update searx.data - update_languages.py
4 years ago
dalf
2857473553
Update searx.data - update_ahmia_blacklist.py
4 years ago
Markus Heiser
d48e2e7b0b
[enh] google scholar - python implementation of the engine
...
The old xpath configuration for google scholar did not work and is replaced by a
python implementation.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
4 years ago
Alexandre Flament
0c663e25fc
Merge pull request #2604 from searx/update_data_firefox_version
...
Update searx.data - firefox_version
4 years ago
Alexandre Flament
b05f4d0664
Merge pull request #2605 from searx/update_data_currencies
...
Update searx.data - currencies
4 years ago
Alexandre Flament
aec5188b51
Merge pull request #2606 from searx/update_data_wikidata_units
...
Update searx.data - wikidata_units
4 years ago
dalf
893b6e4901
Update searx.data - ahmia_blacklist
4 years ago
dalf
7b9005df31
Update searx.data - wikidata_units
4 years ago
dalf
4c8ae5b7ed
Update searx.data - firefox_version
4 years ago
dalf
d2778b5efe
Update searx.data - currencies
4 years ago
Alexandre Flament
7c1847d5f2
[mod] add utils/fetch_external_bangs.py
...
Based on duckduckgo bangs
Store bangs on a trie to allow autocomplete (not in this commit)
4 years ago
Alexandre Flament
5f4a085fc4
Merge pull request #2595 from dalf/update-wikidata-units
...
[mod] update wikidata_units.json and fetch_wikidata_units.py
4 years ago
Alexandre Flament
46ca32c3cc
[mod] update currencies.json and fetch_currencies.py
...
use a sparql request on wikidata to get the list of currencies.
currencies.json contains the translation for all supported searx languages.
Supersede #993
4 years ago
Alexandre Flament
93d1da4906
[mod] update wikidata_units.json and fetch_wikidata_units.py
...
The fetch_wikidata_units.py result won't change randomly.
See comments in the script.
4 years ago
Markus Heiser
ff6804e545
[data] make engines.languages
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
4 years ago
Alexandre Flament
f5c3cb7afa
[mod] drop Python 3.5 support
4 years ago
Markus Heiser
4de276e364
[upd] make SEARX_DEBUG=1 useragents.update
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
4 years ago
Alexandre Flament
ed6696e6bf
[mod] add external_urls.json and wikidata_units.json
4 years ago
Alexandre Flament
5e7060053c
[mod] ahmia_filter.py: minor changes
...
- use result['parsed_url']
- load ahmia_blacklist.txt in searx.datae
4 years ago
Marc Abonce Seguin
32957cdf49
add Ahmia filter plugin for onion results
4 years ago
Alexandre Flament
a9dc54bebc
[mod] Add searx.data module
...
Instead of loading the data/*.json in different location,
load these files in the new searx.data module.
4 years ago
Marc Abonce Seguin
ecf5899153
fetch google's search langs rather than ui langs
4 years ago
Marc Abonce Seguin
c86504b47a
fix utils/fetch_languages to work with new languages
4 years ago
Michael Ilsaas
a1ce141c99
add peertube engine ( #2109 )
4 years ago
Dalf
b339b8b6d6
[mod] bangs.json: remove the favicons
...
fix #2076
4 years ago
Lukas van den Berk
4829a76aae
Created new plugin type custom_results. Added new plugin bang_redirect ( #2027 )
...
* Made first attempt at the bangs redirects plugin.
* It redirects. But in a messy way via javascript.
* First version with custom plugin
* Added a help page and a operator to see all the bangs available.
* Changed to .format because of support
* Changed to .format because of support
* Removed : in params
* Fixed path to json file and changed bang operator
* Changed bang operator back to &
* Made first attempt at the bangs redirects plugin.
* It redirects. But in a messy way via javascript.
* First version with custom plugin
* Added a help page and a operator to see all the bangs available.
* Changed to .format because of support
* Changed to .format because of support
* Removed : in params
* Fixed path to json file and changed bang operator
* Changed bang operator back to &
* Refactored getting search query. Also changed bang operator to ! and is now working.
* Removed prints
* Removed temporary bangs_redirect.js file. Updated plugin documentation
* Added unit test for the bangs plugin
* Fixed a unit test and added 2 more for bangs plugin
* Changed back to default settings.yml
* Added myself to AUTHORS.rst
* Refacored working of custom plugin.
* Refactored _get_bangs_data from list to dict to improve search speed.
* Decoupled bangs plugin from webserver with redirect_url
* Refactored bangs unit tests
* Fixed unit test bangs. Removed dubbel parsing in bangs.py
* Removed a dumb print statement
* Refactored bangs plugin to core engine.
* Removed bangs plugin.
* Refactored external bangs unit tests from plugin to core.
* Removed custom_results/bangs documentation from plugins.rst
* Added newline in settings.yml so the PR stays clean.
* Changed searx/plugins/__init__.py back to the old file
* Removed newline search.py
* Refactored get_external_bang_operator from utils to external_bang.py
* Removed unnecessary import form test_plugins.py
* Removed _parseExternalBang and _isExternalBang from query.py
* Removed get_external_bang_operator since it was not necessary
* Simplified external_bang.py
* Simplified external_bang.py
* Moved external_bangs unit tests to test_webapp.py. Fixed return in search with external_bang
* Refactored query parsing to unicode to support python2
* Refactored query parsing to unicode to support python2
* Refactored bangs plugin to core engine.
* Refactored search parameter to search_query in external_bang.py
4 years ago
Émilien Devos
7a50522a82
Update default user agents
5 years ago
Markus Heiser
809e6f7933
make project: re-build generic files of the searx project
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
5 years ago
Markus Heiser
79412828cd
update languages: engines_languages.json languages.py
...
build by Makefile target:
make project
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
5 years ago
Markus Heiser
40843fe95a
searx/data/engines_languages.json: sort json file (no content change)
...
To get meaningfull diffs, the json file has to be sorted. Before applying any
further content patch, the json file needs a inital sort (without changing any
content).
Sorted by::
import sys, json
with open('engines_languages.json') as f:
j = json.load(f)
with open('engines_languages.json', 'w') as f:
json.dump(j, f, indent=2, sort_keys=True)
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
5 years ago
Marc Abonce Seguin
d0d91fa331
update user agents
5 years ago
Marc Abonce Seguin
94ca30de1b
add a shortcut for utils/fetch_firefox_version.py in manage.sh
5 years ago
Marc Abonce Seguin
0169b63e84
[fix] fetch google's supported languages
6 years ago
Ivan Skytte Jørgensen
0b7f0bde62
Use a more human-friendly format in searx/data/engines_languages.json ( #1399 )
...
Instead of a single line with 500000 characters use nicely formatted JSON.
Sort the lists in engine_languages.py so when updating it is possible to
more easily see the differences (search engines do change the order their
languages are listed in)
6 years ago
Alex
50c836864a
fetch_firefox_version.py : compatible with Python 3 and minor fixes.
6 years ago
Alexandre Flament
066bd916bf
[mod] fetch firefox versions in a standalone script
6 years ago
rinpatch
a305dae9d8
switched currency convert to duckduckgo and added Bitcoin to currency list
7 years ago
Marc Abonce Seguin
772c048d01
refactor engine's search language handling
...
Add match_language function in utils to match any user given
language code with a list of engine's supported languages.
Also add language_aliases dict on each engine to translate
standard language codes into the custom codes used by the engine.
7 years ago
Marc Abonce Seguin
d1eae9359f
fix fetch_langauges to be more accurate
...
Add languages supported by either all default general engines or 10 engines.
7 years ago
marc
44085e31d0
update engines_languages.json and languages.py
...
Also, fix fetch_languages.py so it can run on python3.
7 years ago
marc
405e5c8f24
[fix] duckduckgo images doesn't fail with countryless language
7 years ago
marc
fd65c12921
make search language handling less strict
...
languages.py can change, so users may query on a language that is not
on the list anymore, even if it is still recognized by a few engines.
also made no and nb the same because they seem to return the same,
though most engines will only support one or the other.
8 years ago
marc
805fb02ed1
add language support for qwant
...
closes issue #863
8 years ago
marc
1175b3906f
change language list to only include languages with a minimum of engines
...
that support them.
users can still query lesser supported through the :lang_code bang.
8 years ago
marc
4a1ff56389
minor fixes in utils/fetch_languages.py
8 years ago
marc
af35eee10b
tests for _fetch_supported_languages in engines
...
and refactor method to make it testable without making requests
8 years ago
marc
f62ce21f50
[mod] fetch supported languages for several engines
...
utils/fetch_languages.py gets languages supported by each engine and
generates engines_languages.json with each engine's supported language.
8 years ago
Alexandre Flament
5525625dae
[enh] currency_convert engine: user can write "1 dollars in euros" instead of "1 USD in EUR".
...
The currency names are fetched wikidata and store into a static file : searx/data/currencies.json
This file is loaded when the currency_converter is loaded.
A database is perhaps more appropiated.
10 years ago