searxng

Commit Graph

Author	SHA1	Message	Date
Kyle Anthony Williams	4d3c399ee9	[feat] add bandcamp engine	3 years ago
Alexandre Flament	d14994dc73	[httpx] replace searx.poolrequests by searx.network settings.yml: * outgoing.networks: * can contains network definition * propertiers: enable_http, verify, http2, max_connections, max_keepalive_connections, keepalive_expiry, local_addresses, support_ipv4, support_ipv6, proxies, max_redirects, retries * retries: 0 by default, number of times searx retries to send the HTTP request (using different IP & proxy each time) * local_addresses can be "192.168.0.1/24" (it supports IPv6) * support_ipv4 & support_ipv6: both True by default see https://github.com/searx/searx/pull/1034 * each engine can define a "network" section: * either a full network description * either reference an existing network * all HTTP requests of engine use the same HTTP configuration (it was not the case before, see proxy configuration in master)	3 years ago
Markus Heiser	c4793afadc	[fix] https-scheme missing in preferences-page This patch is an addition to PR #2656 which removed all usage of `base_url` from the templates, except one was forgotten in the cookie URL of the preferences. closes: 2740 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	3 years ago
Markus Heiser	2bf297b19f	[fix] redirect when saving preferences Erroneously commit `87e4c4762` droped the 302 redirect. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	3 years ago
Robin Schneider	dfc66ff0f0	Fix grammar mistake in debug log output	3 years ago
Alexandre Flament	eaa694fb7d	[enh] replace requests by httpx	3 years ago
Plague Doctor	599ff39ddf	Fix conflicts	3 years ago
Noémi Ványi	cc359345a8	Merge pull request #2735 from plague-doctor/wordnik Add new engine: Wordnik.com	3 years ago
Plague Doctor	6631f11305	Add new engine: SJP	3 years ago
Plague Doctor	7035bed4ee	Add new engine: Wordnik.com	3 years ago
Alexandre Flament	c09ff4faf2	[fix] fix PR 2656 SCRIPT_NAME remove trailing slash to avoid infinite redirect	3 years ago
Noémi Ványi	07f5edce3d	Add Meilisearch engine Website: https://www.meilisearch.com/	3 years ago
Noémi Ványi	a477a3a687	Merge pull request #2728 from return42/fix-loader [fix] settings_loader.py - use update_dict only for mapping types	3 years ago
3nprob	2ca0aa4f29	Remove hubsbpot tracking URL params More information here: https://knowledge.hubspot.com/settings/how-do-i-create-a-tracking-url https://knowledge.hubspot.com/ads/ad-tracking-in-hubspot https://knowledge.hubspot.com/ctas/calls-to-action-frequently-asked-questions https://meta.stackexchange.com/questions/263392/what-are-these-very-long-parameters-in-so-careers-feedback-always-welcome-url	3 years ago
Markus Heiser	9c10b15096	[fix] settings_loader.py - use update_dict only for mapping types I can't set `default_doi_resolver` in `settings.yml` if I'm using `use_default_settings`. Searx seems to try to interpret all settings at root level in `settings.yml` as dict, which is correct except for `default_doi_resolver` which is at root level and a string:: File "/usr/lib/python3.9/site-packages/searx/settings_loader.py", line 125, in load_settings update_settings(default_settings, user_settings) File "/usr/lib/python3.9/site-packages/searx/settings_loader.py", line 61, in update_settings update_dict(default_settings[k], v) File "/usr/lib/python3.9/site-packages/searx/settings_loader.py", line 48, in update_dict for k, v in user_dict.items(): AttributeError: 'str' object has no attribute 'items' Signed-off-by: Markus Heiser <markus@darmarit.de> Suggested-by: @0xhtml https://github.com/searx/searx/issues/2722#issuecomment-813391659	3 years ago
Alexandre Flament	7089526723	Merge pull request #2656 from return42/fix-url_for [fix] url_for(..., _external=True) in templates	3 years ago
Markus Heiser	87e4c47621	[fix] url_for(..., _external=True) in templates The `url_for` function in the template context is not the one from Flask, it is the one from `webapp`. The `webapp.url_for_theme` is different from its namesake of Flask and has it quirks, when called with argument `_external=True`. The `webapp.url_for_theme` can't handle absolute URLs since it pokes a leading '/', here is the snippet of the old code:: url = url_for(endpoint, *values) if settings['server']['base_url']: if url.startswith('/'): url = url[1:] url = urljoin(settings['server']['base_url'], url) Next drawback of (Flask's) `_external=True` is, that it will not return the HTTP scheme when searx (the Flask app) listens on http and is proxied by a https server. To get the right scheme `HTTP_X_SCHEME` is needed by Flask (werkzeug). Since this is not provided in every environment (e.g. behind Apache mod_wsgi or the HTTP header is not fully set for some other reasons) it is recommended to get script_name, server* and scheme from the configured `base_url`. If `base_url` is specified, then these values from are given preference over any Flask's generics. BTW this patch normalize to use `url_for` in the `opensearch.xml` and drop the need of `host` and `urljoin` in template's context. Signed-off-by: Markus Heiser <markus@darmarit.de>	3 years ago
Alexandre Flament	7a0fbdecc4	[enh] oscar: image thumbnail layout Adjust thumbnail sizes to fill the container width	3 years ago
Noémi Ványi	ba90c5a2e0	Merge pull request #2718 from return42/fix-publishedDate [fix] publishedDate: don't try to get date from empty string or None	3 years ago
Markus Heiser	ebfd0eb2b7	[fix] default_doi_resolver in preferences Instead of a hard-coded `oadoi.org` default, use the default value from `settings.yml`. Fix an issue in the themes: The replacement 'current_doi_resolver' contains the doi_resolver_url, not the name of the DOI resolver. Compare return value of:: searx.plugins.oa_doi_rewrite.get_doi_resolver(...) Fix a typo in `get_doi_resolver(..)`: suggested by @kvch: L32 should set doi_resolver not doi_resolvers Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	3 years ago
Markus Heiser	c12826c6d5	[fix] publishedDate: don't try to get date from empty string or None Signed-off-by: Markus Heiser <markus@darmarit.de>	3 years ago
Noémi Ványi	7612e5d9fd	Merge pull request #2712 from searx/update_data_update_firefox_version.py Update searx.data - update_firefox_version.py	3 years ago
Noémi Ványi	985e8b28fe	Merge pull request #2710 from searx/update_data_update_ahmia_blacklist.py Update searx.data - update_ahmia_blacklist.py	3 years ago
Noémi Ványi	feb2d81874	Merge pull request #2709 from searx/update_data_update_currencies.py Update searx.data - update_currencies.py	3 years ago
Noémi Ványi	9a962c5369	Merge pull request #2711 from searx/update_data_update_wikidata_units.py Update searx.data - update_wikidata_units.py	3 years ago
Noémi Ványi	5ca34ac571	Merge pull request #2713 from searx/update_data_update_languages.py Update searx.data - update_languages.py	3 years ago
Markus Heiser	169438137f	[fix] url bar autocomplete (opensearch suggestions) Since #2593 is merged the OpenSearch-Format is buggy. The loop in [1] will change raw_text_query object and this will change also the value of `raw_text_query.query` on every `raw_text_query.changeQuery(result)`. This patch fixes this issue by storing the initial query value in `sug_prefix`. [1] `ac0fdc3b96/searx/webapp.py (L804-L806)` OpenSearch-Format:: [ "<query>", [ "<term 1>", "<term 2>", ... "<term n>" ], [ "<content 1>", "<content 2>", ..., "<content n>" ], [ "<url 1>", "<url 2>", ..., "<url n>" ] ] - https://www.google.com/support/enterprise/static/gsa/docs/admin/current/gsa_doc_set/xml_reference/query_suggestion.html#1080002 - https://developer.mozilla.org/en-US/docs/Archive/Add-ons/Supporting_search_suggestions_in_search_plugins#implementing_search_suggestion_support_on_the_server Legacy-Format:: [ "<term 1>", "<term 2>", ..., "<term n>" ] - https://www.google.com/support/enterprise/static/gsa/docs/admin/current/gsa_doc_set/xml_reference/query_suggestion.html#1081079 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	3 years ago
dalf	c0668d248e	Update searx.data - update_languages.py	3 years ago
dalf	ad74c42aa1	Update searx.data - update_firefox_version.py	3 years ago
dalf	23dc7ef6d1	Update searx.data - update_wikidata_units.py	3 years ago
dalf	eb5cd7a543	Update searx.data - update_ahmia_blacklist.py	3 years ago
dalf	f804f54ca3	Update searx.data - update_currencies.py	3 years ago
Marc Abonce Seguin	419b907a0b	fix dark "expand" button from infobox	3 years ago
Adam Tauber	ae122ea943	[enh] release v1.0.0	3 years ago
Adam Tauber	15f2385a7b	[enh] update translations from transifex	3 years ago
Alexandre Flament	bb316d2698	Merge pull request #2682 from dalf/fix-checker [fix] checker: various bug fixes	3 years ago
Alexandre Flament	725a69616b	Merge pull request #2681 from dalf/fix-wikipedia-title [fix] wikipedia: remove HTML from the title	3 years ago
Noémi Ványi	9bb312c505	Remove duplicated key from dict in Semantic Scholar	3 years ago
Noémi Ványi	f596f5767b	fix Semantic Scholar engine	3 years ago
Adam Tauber	28286cf3f2	[fix] update seznam engine to be compatible with the new website	3 years ago
Alexandre Flament	0b45afd4d7	[fix] checker: various bug fixes * initialize engine_data (youtube engine) * don't crash if an engine don't set result['url']	3 years ago
Alexandre Flament	fcfcf662ff	[fix] wikipedia: remove HTML from the title fr.wikipedia.org (and it seems not other wikipedia websites), adds HTML to api_result['displayTitle']. (Search for '!wp :fr Braid' for example) The commit uses api_result['title']	3 years ago
Adam Tauber	06b754ad67	[mod] increase lobste.rs engine timeout to avoid timeouts most of the time	3 years ago
Adam Tauber	0ba71c3644	[fix] make ina engine compatible with the new response json	3 years ago
Adam Tauber	6255b33c9d	[fix] rewrite hoogle to use html/xpath instead of json the json response has been changed and it contains html chunks which is not compatible with our json engine, so we have to switch to html/xpath parsing	3 years ago
Adam Tauber	45f0e1a859	[fix] update geektimes.ru url - it redirects to habr.com	3 years ago
Adam Tauber	50ba2b9e87	[fix] update google play movies xpath	3 years ago
Adam Tauber	88657fe9c2	[fix] update google play apps xpath	3 years ago
Adam Tauber	5f450fda74	[enh] add year filter to duckduckgo	3 years ago
Adam Tauber	fd737dc9d8	[fix] remove debug code	3 years ago
Alexandre Flament	d648001688	[mod] preferences: a tooltip is shown when the mouse is over the engine names	3 years ago
Alexandre Flament	6bd01bf81f	[mod] oscar: fix the sourcemap URL in .min.css Close https://github.com/searx/searx/issues/2670 Note: clean-css contains a bug: a multiline comment or URL adds "$stdin" to the sourcemap (see src/less/logicodev/search.less) * in this case when the user opens the devtools, the browser fails to load this "https://.../$stdin" URL * it is not a problem and the error appears only when the user actively tries to debug the CSS. * seems related to https://github.com/jakubpawlowicz/clean-css/issues/593	3 years ago
Alexandre Flament	a48ec0b4bd	Merge pull request #2671 from searx/update-soundcloud [mod] soundcloud: faster initialization	3 years ago
Alexandre Flament	30c950a2c7	Merge pull request #2660 from dalf/upd-translations [mod] replace /translations.js with an embedded JSON	3 years ago
Alexandre Flament	38c210d746	[mod] soundcloud: faster initialization The get_cliend_id() function: * fetches https://soundcloud.com * then fetches each referenced javascript URL to get the client id. This commit fetches the javascript URLs in the reverse order: the client id is in the last javascript URL.	3 years ago
James Higginbotham	ce6eb81a71	Update settings.yml to enable HTTP for yacy Added a line to the yacy entry to enable HTTP if the local yacy instance isn't using HTTPS. Otherwise, an error will be thrown in the logs: "No connection adapters were found for 'http://localhost:8090/yacysearch.json...'". This is likely related to ticket #2641 that forces HTTPS by default.	3 years ago
Alexandre Flament	2b0dd96bd3	[mod] oscar: remove space * reduce by 15% the uncompressed output (on average) * dos2unix searx/templates/oscar/result_templates/files.html	3 years ago
Dr. Rolf Jansen	7a9dc63d74	Merge branch 'master' into conditional-sigusr1	3 years ago
Alexandre Flament	6553c79029	[mod] replace /translations.js by embedded JSON In webapp.py, there is a new function "get_translations" lists available translations Close #2064	3 years ago
Alexandre Flament	32cd0d31b3	[mod] upgrade pygments add searx_extra/update/update_pygments.py to update the css style of the oscar and simple themes.	3 years ago
Dr. Rolf Jansen	2a6dbeb6a5	Merge branch 'master' into conditional-sigusr1	3 years ago
Adam Tauber	4c631ac6d0	[fix] remove debug code	3 years ago
Dr. Rolf Jansen	4a27dabcf7	Merge branch 'master' into conditional-sigusr1	3 years ago
Noémi Ványi	8158d8654a	fix Microsoft Academic engine	3 years ago
Adam Tauber	f97b4ff7b6	[fix] update youtube_noapi paging	3 years ago
Adam Tauber	dd34ac396c	Merge pull request #2652 from kvch/solr-engine Add Apache Solr engine	3 years ago
Alexandre Flament	1664258061	Merge pull request #2655 from return42/fix-imports [fix] remove unused import from yahoo-news engine	3 years ago
Alexandre Flament	5b176b3496	Merge pull request #2659 from MarcAbonce/onions-http-fix Fix HTTP error in onion engines	3 years ago
Marc Abonce Seguin	f4a0a4d756	fix HTTP error in onion engines regression from https://github.com/searx/searx/pull/2641 most onion websites only serve HTTP, so it must be enabled	3 years ago
Rolf	80025c3244	Windows does not support SIGUSR1, so don't use it unconditionally.	3 years ago
Markus Heiser	6e1f1085ef	[fix] remove unused import from yahoo-news engine Signed-off-by: Markus Heiser <markus@darmarit.de>	3 years ago
Markus Heiser	3703ebb22a	[drop] Acgsou engine - www.acgsou.com no longer exists - https://www.acgsou.com/ acgsou.com is redirected to 36dm.club - @rinpatch do not plan on maintaining the engine [1] [1] https://github.com/searx/searx/pull/1283#issuecomment-798783585 Signed-off-by: Markus Heiser <markus@darmarit.de>	3 years ago
Noémi Ványi	ff527e2681	Add Solr engine	3 years ago
Alexandre Flament	9292571304	Merge pull request #2346 from dalf/upgrade-oscar [mod] oscar: upgrade dependencies	3 years ago
Alexandre Flament	92dd5e245e	Merge pull request #2626 from mikeri/solidtorrents Add Solid Torrents engine	3 years ago
Alexandre Flament	a1a492baed	Merge pull request #2641 from dalf/disable_http_by_default [mod] by default allow only HTTPS, not HTTP	3 years ago
Alexandre Flament	cb04d42806	[mod] oscar: update README.rst	3 years ago
Alexandre Flament	86912e2272	[mod] oscar: get bootstrap and typeahead from NPM	3 years ago
Alexandre Flament	44407353ef	[mod] oscar: get leaflet and jquery from NPM easy to upgrade (package.json)	3 years ago
Alexandre Flament	c7133efb12	[mod] oscar: move compiled files to the src directory	3 years ago
Alexandre Flament	eda3b513ac	[mod] oscar: remove polyfills for Internet Explorer	3 years ago
Alexandre Flament	1268910274	[mod] oscar: remove unused images	3 years ago
Alexandre Flament	bdb41bea7b	[mod] theme: remove require-2.1.15.min.js See https://github.com/requirejs/requirejs/issues/1816 requirejs loads one file: leaflet. This commit: * removes requirejs * load leaflet using <script src...> HTML tag in searx/templates/oscar/base.html	3 years ago
Alexandre Flament	2f3d5ec2af	[mod] oscar: upgrade npm dependencies	3 years ago
Markus Heiser	96422e5c9f	[fix] APKMirror engine - update xpath selectors and fix img_src BTW: make the code slightly more readable Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	3 years ago
Markus Heiser	d2faea423a	[fix] rewrite Yahoo-News engine Many things have been changed since last review of this engine. This patch fix xpath selectors, implements suggestion and is a complete review / rewrite of the engine. Signed-off-by: Markus Heiser <markus@darmarit.de>	3 years ago
Alexandre Flament	99e0651cea	[mod] by default allow only HTTPS, not HTTP Related to https://github.com/searx/searx/pull/2373	3 years ago
Michael Ilsaas	5549d58de3	Add Solid Torrents engine	3 years ago
Adam Tauber	44f4a9d49a	[enh] add ability to send engine data to subsequent requests	3 years ago
Alexandre Flament	87f4cc4a9e	Merge pull request #2631 from searx/update_data_update_languages.py Update searx.data - update_languages.py	3 years ago
Markus Heiser	4845183128	[mod] don't dump traceback of SearxEngineResponseException on init When initing engines a "SearxEngineResponseException" is logged very verbose, including full traceback information: ERROR:searx.engines:yggtorrent engine: Fail to initialize Traceback (most recent call last): File "share/searx/searx/engines/__init__.py", line 293, in engine_init init_fn(get_engine_from_settings(engine_name)) File "share/searx/searx/engines/yggtorrent.py", line 42, in init resp = http_get(url, allow_redirects=False) File "share/searx/searx/poolrequests.py", line 197, in get return request('get', url, *kwargs) File "share/searx/searx/poolrequests.py", line 190, in request raise_for_httperror(response) File "share/searx/searx/raise_for_httperror.py", line 60, in raise_for_httperror raise_for_captcha(resp) File "share/searx/searx/raise_for_httperror.py", line 43, in raise_for_captcha raise_for_cloudflare_captcha(resp) File "share/searx/searx/raise_for_httperror.py", line 30, in raise_for_cloudflare_captcha raise SearxEngineCaptchaException(message='Cloudflare CAPTCHA', suspended_time=3600 24 * 15) searx.exceptions.SearxEngineCaptchaException: Cloudflare CAPTCHA, suspended_time=1296000 For SearxEngineResponseException this is not needed. Those types of exceptions can be a normal use case. E.g. for CAPTCHA errors like shown in the example above. It should be enough to log a warning for such issues: WARNING:searx.engines:yggtorrent engine: Fail to initialize // Cloudflare CAPTCHA, suspended_time=1296000 closes: #2612 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	3 years ago
Alexandre Flament	0165e14a7f	Merge pull request #2632 from searx/update_data_update_wikidata_units.py Update searx.data - update_wikidata_units.py	3 years ago
Alexandre Flament	152f6fc1da	Merge pull request #2630 from searx/update_data_update_ahmia_blacklist.py Update searx.data - update_ahmia_blacklist.py	3 years ago
dalf	1e8b846954	Update searx.data - update_currencies.py	3 years ago
dalf	2f8a708481	Update searx.data - update_wikidata_units.py	3 years ago
dalf	d9dc3376d0	Update searx.data - update_languages.py	3 years ago
dalf	2857473553	Update searx.data - update_ahmia_blacklist.py	3 years ago
Alexandre Flament	aac37f288f	Merge pull request #2593 from dalf/update-autocomplete Update autocomplete	3 years ago
Alexandre Flament	63f17d2e4c	[enh] autocomplete refactoring, autocomplete on external bangs	3 years ago
Markus Heiser	d48e2e7b0b	[enh] google scholar - python implementation of the engine The old xpath configuration for google scholar did not work and is replaced by a python implementation. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	3 years ago
Alexandre Flament	4fa1290c11	[fix] answers: don't crash when the query is an empty string	3 years ago
Alexandre Flament	e2fb500892	Merge pull request #2608 from return42/unittest2 [py2to3] use unittest from py3, remove unittest2 from py2	3 years ago
Alexandre Flament	0c663e25fc	Merge pull request #2604 from searx/update_data_firefox_version Update searx.data - firefox_version	3 years ago
Alexandre Flament	f77983e174	Merge pull request #2602 from MarcAbonce/fix-bing-fetch-languages Fix fetch_languages for Bing	3 years ago
GazoilKerozen	5f6ac3afa2	Add Freesound engine (#2596 ) Add freesound engine with player. Co-authored-by: Gazoil <maildeguzel@gmail.com>	3 years ago
Markus Heiser	3bae35940a	[py2to3] use unittest from py3, remove unittest2 from py2 - unittest2 is a backport of the new features added to the unittest testing framework in Python 2.7 - unittest2 was only needed in py2 and can be dropped now Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	3 years ago
Alexandre Flament	b05f4d0664	Merge pull request #2605 from searx/update_data_currencies Update searx.data - currencies	3 years ago
Alexandre Flament	aec5188b51	Merge pull request #2606 from searx/update_data_wikidata_units Update searx.data - wikidata_units	3 years ago
dalf	893b6e4901	Update searx.data - ahmia_blacklist	3 years ago
dalf	7b9005df31	Update searx.data - wikidata_units	3 years ago
dalf	4c8ae5b7ed	Update searx.data - firefox_version	3 years ago
dalf	d2778b5efe	Update searx.data - currencies	3 years ago
Marc Abonce Seguin	d6681fd33b	remove articles number from engines_languages.json	3 years ago
Marc Abonce Seguin	9b6ffed061	fix fetch_languages for bing Bing has a list of regions that it supports and some of these regions may have more than one possible language. In some cases, like Switzerland, these languages are always shown as options, so there is no issue. But in other cases, like Andorra, Bing will only show one language at the time, either the region's default or the request's language if the latter is supported by that region. For example, if the HTTP request is in French, Andorra will appear as fr-AD but if the same page is requested in any other language Andorra will appear as ca-AD. This is specially a problem when Bing assumes that the request is in English because it overrides enough language codes to make several major languages like Arabic dissappear from the languages.py file. To avoid that issue, I set the Accept-Language header to a language that's only supported in one region to hopefully avoid these overrides.	3 years ago
Alexandre Flament	7c1847d5f2	[mod] add utils/fetch_external_bangs.py Based on duckduckgo bangs Store bangs on a trie to allow autocomplete (not in this commit)	3 years ago
Alexandre Flament	5f4a085fc4	Merge pull request #2595 from dalf/update-wikidata-units [mod] update wikidata_units.json and fetch_wikidata_units.py	3 years ago
Alexandre Flament	46ca32c3cc	[mod] update currencies.json and fetch_currencies.py use a sparql request on wikidata to get the list of currencies. currencies.json contains the translation for all supported searx languages. Supersede #993	3 years ago
Alexandre Flament	93d1da4906	[mod] update wikidata_units.json and fetch_wikidata_units.py The fetch_wikidata_units.py result won't change randomly. See comments in the script.	3 years ago
Noémi Ványi	1be6ab2a91	Fix paging of Bing Images	3 years ago
datagram1	1d0a32a2c5	Added rumble.com video search engine. TODO video embedding. Update rumble.py some lines too long. Disable Rumble engine disabled : True PEP8 fix change line spacing	3 years ago
Alexandre Flament	44a6593c13	Merge pull request #2573 from unixfox/yggtorrent update yggtorrent url + add it back	3 years ago
Emilien Devos	4b37e10dd9	fix yggtorrent url + add it back	3 years ago
Thorben Günther	fbbd4cc21f	Improve peertube searching At the moment videos without a description are not shown - setting default content to "" fixes this. Another current bug is that thumbnails are not displayed. This is caused by a double slash in the url. For this every trailing slash is now stripped (for backwards compatibility) and the API response is correctly parsed.	3 years ago
Alexandre Flament	45027765e3	Merge pull request #2566 from dalf/remove-yandex [remove] yandex engine	3 years ago
Alexandre Flament	c22d4c764c	[fix] duckduckgo engine: "!ddg !g" do not redirect to google * searx understand "!ddg !g time" as : send "!g time" to DDG * !g a DDG bang for Google: DDG return a HTTP redirect to Google This commit adds a the allows_redirect param not to follow HTTP redirect. The DDG engine returns a empty result as before without HTTP redirect.	3 years ago
Alexandre Flament	d76660463b	Merge pull request #2562 from dalf/mod-json-engine [mod] json_engine: add content_html_to_text and title_html_to_text	3 years ago
Alexandre Flament	7dcf67a47a	Merge pull request #2565 from dalf/upd-wikipedia [upd] wikipedia engine: return an empty result on query with illegal characters	3 years ago
Alexandre Flament	2b60d0d243	Merge pull request #2564 from dalf/fix-seznam [fix] fix seznam engine	3 years ago
Alexandre Flament	7e83818879	Merge pull request #2560 from dalf/fix-duckduckgo Fix duckduckgo	3 years ago
Alexandre Flament	63d6ccfbc2	Merge pull request #2557 from dalf/fix-raise_for_httperror Fix: activate raise_for_error by default	3 years ago
Alexandre Flament	74c8b5606f	Merge pull request #2541 from return42/mediathekviewweb [enh] add engine MediathekViewWeb (API)	3 years ago
Alexandre Flament	5d9db6c2f7	[remove] yandex engine	3 years ago
Alexandre Flament	35dd069402	[fix] fix seznam engine no paging support	3 years ago
Alexandre Flament	7d6e69e2f9	[upd] wikipedia engine: return an empty result on query with illegal characters on some queries (like an IT error message), wikipedia returns an HTTP error 400. this commit returns an empty result instead of showing an error to the user.	3 years ago
Alexandre Flament	ff84a1af35	[mod] json_engine: add content_html_to_text and title_html_to_text Some JSON API returns HTML in either in the HTML or the content. This commit adds two new parameters to the json_engine: content_html_to_text and title_html_to_text, False by default. If True, then the searx.utils.html_to_text removes the HTML tags. Update crossref, openairedatasets and openairepublications engines	3 years ago
Alexandre Flament	436d366448	Merge pull request #2544 from mrwormo/congresslibrary [Engine] Add Library of Congress engine	3 years ago
Alexandre Flament	eafd27f42a	Merge pull request #2556 from dalf/fix-apk-mirror [fix] fix apk_mirror engine	3 years ago
Alexandre Flament	d2dac11392	[mod] duckduckgo engine: better support of the language preference After the main request, send a second to https://duckduckgo.com/t/sl_h See https://github.com/searx/searx/issues/2259	3 years ago
Alexandre Flament	74d56f6cfb	[mod] poolrequests: for one (user request, engine) always use the same HTTPAdapter The duckduckgo engine requires an additional request after the results have been sent. This commit makes sure that the second request uses the same HTTPAdapter = the same IP address, and the same proxy.	3 years ago
Markus Heiser	bc1be3f0e9	[enh] add engine MediathekViewWeb (API) Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	3 years ago
mrwormo	051da88328	Add Library of Congress engine	3 years ago
Alexandre Flament	9211cdfe9b	[upd] remove google_play_music engine Google Play Music has been replaced by Youtube music.	3 years ago
Alexandre Flament	aedf03c0f7	Fix: activate raise_for_error by default Fix commit `d703119d3a` : Some engines need to parse the HTTP error but raise_for_error is always set to False in the "request" function.	3 years ago
Alexandre Flament	5e055b069b	[fix) fix apk_mirror engine	3 years ago
Alexandre Flament	e4cc7f13a3	Merge pull request #2542 from kvch/fix-naver-engine Fix XPATHs in Naver engine	3 years ago
Alexandre Flament	bec9e30fe7	Merge pull request #2554 from MarcAbonce/zh-variants-in-wikipedia Add support for Chinese variants in Wikipedia	3 years ago
Daniel Hones	138f32471c	Updated webutils.highlight_content to ignore double-quotes when highlighting query parts	3 years ago
Marc Abonce Seguin	64e81794fe	add support for Chinese variants in Wikipedia	3 years ago
Noémi Ványi	ac309f5b8d	Fix naver engine Closes #2540	3 years ago
Markus Heiser	41c03cf011	[drop] metager - xpath engine won't work anymore The new version of MetaGer needs to reload the reults (into a iframe) with a unique tag (see HTML response below). Implementing a dedicated metager-engine for searx makes no sense to me. The great days of MetaGer seems to be ended. I remember the good old days this project started in the 90's of the last century. But in the last few years it becomes more and more crap. As the name suggested, MetaGer was made for germans in the first place. They have added a english and spain translation but the i18n is very poor compared to what searx offers. It's a pity, lets drop MetaGer. This is the first response, the id (b82679980656899ba5a17ffd02a56846) is unique for each query: $ curl "https://metager.org/meta/meta.ger3?eingabe=foo&submit-query=&focus=web" <!DOCTYPE html> <html lang="en"> <head> <meta charset="UTF-8"> <link rel="stylesheet" href="/index.css?id=b82679980656899ba5a17ffd02a56846"> <script src="/index.js?id=b82679980656899ba5a17ffd02a56846"></script> <title>foo - MetaGer</title> <meta name="viewport" content="width=device-width, initial-scale=1, maximum-scale=1" /> </head> <body> <iframe id="mg-framed" src="https://metager.org/meta/meta.ger3?eingabe=foo&submit-query=&focus=web&mgv=b82679980656899ba5a17ffd02a56846" autofocus="true" onload="this.contentWindow.focus();"></iframe> </body> Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	3 years ago
Hermógenes Oliveira	514faa9162	[feat] recoll: paged json support	3 years ago
Marc Abonce Seguin	c937a9e85f	[fix] get correct locale with country from browser Some of our interface locales include uppercase country codes, which are separated by `_` instead of the more common `-`. Also, a browser's `Accept-Language` header could be in lowercase. This commit attempts to normalize those cases so a browser's language+country codes can better match with our locales. This solution assumes that our UI locales have nothing more than language and optionally country. If we ever add a script specific locale like `zh-Hant-TW` this would have to change to accomodate that, but the idea would be pretty much the same as this fix.	3 years ago
mrwormo	c4c1636b18	Add Creative Commons search engine	3 years ago
Alexandre Flament	ca93a01844	[mod] dynamically set language_support variable The language_support variable is set to True by default, and set to False in only 5 engines. Except the documentation and the /config URL, this variable is not used. This commit remove the variable definition in the engines, and set value according to supported_languages length: False when the length is 0, True otherwise. Close #2485	3 years ago
Markus Heiser	7f505bdc6f	[fix] google: avoid unnecessary SearxEngineXPathException errors Avoid SearxEngineXPathException errors when parsing non valid results:: .//div[@class="yuRUbf"]//a/@href index 0 not found Traceback (most recent call last): File "./searx/engines/google.py", line 274, in response url = eval_xpath_getindex(result, href_xpath, 0) File "./searx/searx/utils.py", line 608, in eval_xpath_getindex raise SearxEngineXPathException(xpath_spec, 'index ' + str(index) + ' not found') searx.exceptions.SearxEngineXPathException: .//div[@class="yuRUbf"]//a/@href index 0 not found Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	3 years ago
Markus Heiser	e436287385	[mod] checker: add some additional tests BTW: fix indentation by 2 spaces The additional tests has been commented out in the google engines to not release any CAPTCHA issues. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	3 years ago
Markus Heiser	b1fefec40d	[fix] normalize the language & region aspects of all google engines BTW: make the engines ready for search.checker: - replace eval_xpath by eval_xpath_getindex and eval_xpath_list - google_images: remove outer try/except block Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	3 years ago
Markus Heiser	ff6804e545	[data] make engines.languages Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	3 years ago
Markus Heiser	8cdad5d85d	[fix] google-videos: parse values for 'length' & 'author' The 'video.html' template from the 'oscar' design supports replacement for author and length. Google-videos does not have an author, alternatively the publisher info from is used for the author. Hint: these replacements are not supported by the 'simple' design. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	3 years ago
Markus Heiser	89b3050b5c	[fix] revise of the google-Video engine This revise is based on the methods developed in the revise of the google engine (see commit `410c2f9`). Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	3 years ago
Alexandre Flament	8c46b767d0	[fix] google_news: avoid one HTTP redirect except for the English results also add params['soft_max_redirects'] = 1 to avoid false error reporting in /stats/errors	3 years ago
Markus Heiser	5f92dfcdbe	[fix] google-news: query uses locale without country tag Wthout country-region tag google will redirect to correct the contry tag [1]: SEARX_DEBUG=1 searx-checker -v "google news" ... https://news.google.com:443 "GET /search?q=computer&hl=en... HTTP/1.1" 302 0 https://news.google.com:443 "GET /search?q=computer&hl=en-US&.... HTTP/1.1" 200 None ... [1] https://github.com/searx/searx/pull/2483#issuecomment-765600849 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	3 years ago
Markus Heiser	baec54c492	[fix] revise of the google-news engine This revise is based on the methods developed in the revise of the google engine (see commit `410c2f9`). Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	3 years ago
Alexandre Flament	73c86f9bf2	[mod] checker: disable by default	3 years ago
Alexandre Flament	3b7b852aa8	[fix] checker: minor fix about language detection	3 years ago
Alexandre Flament	aa887eb375	[mod] checker : replace pycld3 by langdetect pycld3 requires the native library cld3 langdetect is a pure python package	3 years ago
Alexandre Flament	67a1aab0d5	[fix] /stats/checker : remove the timestamp field when the checker is disabled	3 years ago
Alexandre Flament	d473407ec9	[fix] checker: fix engine statistics Without this commit, the URL /stats/errors shows percentage above 100% after the checker has run.	3 years ago
Alexandre Flament	ca76f3119a	[fix] error_recorder: record code and lineno about the engine since the PR #2225 , code and lineno were sometimes meaningless see /stats/errors	3 years ago
Alexandre Flament	80d7411f2c	Merge pull request #2452 from kvch/add-wilby-engine Add wiby.me engine	4 years ago
Alexandre Flament	b405646749	Merge pull request #2451 from mrwormo/invidious-engine [Fix] Invidious Engine	4 years ago
Alexandre Flament	a4dcfa025c	[enh] engines: add about variable move meta information from comment to the about variable so the preferences, the documentation can show these information	4 years ago
mrwormo	2dff3887f0	[fix] Invidious engine by enabling requests by randomly picking amongst working instances	4 years ago
Alexandre Flament	912c7e975c	[fix] checker: don't run the checker when uwsgi is not properly configured Before this commit, even with the scheduler disabled, the checker was running at least once for each uwsgi worker.	4 years ago
Alexandre Flament	7f0c508598	[fix] checker: fix typo unknown instead of unknow	4 years ago
Alexandre Flament	a0c8b413a6	[mod] searx.shared: minor tweaks searx.shared.shared_abstract.SharedDict inherit from abc.ABC searx.shared.shared_uwsgi.schedule can schedule multiple functions without issue	4 years ago
Alexandre Flament	87bafbc32b	[mod] checker: add status and timestamp to the result for each engine: replace status by success	4 years ago
Alexandre Flament	f3e1bd308f	[mod] checker: minor adjustements on the default tests the query "time" is convinient because most of the search engine will return some results, but some engines in the general category will return documentation about the HTML tags <time> or <input type="time">	4 years ago
Alexandre Flament	45bfab77d0	\|mod] checker: improve searx-checker command line * output is unbuffered * verbose mode describe more precisly the errrors	4 years ago
Alexandre Flament	3a9f513521	[enh] checker: background check See settings.yml for the options SIGUSR1 signal starts the checker. The result is available at /stats/checker	4 years ago
Alexandre Flament	6e2872f436	[enh] add searx.shared shared dictionary between the workers (UWSGI or werkzeug) scheduler: run a task once every x seconds (UWSGI or werkzeug)	4 years ago
Markus Heiser	9c581466e1	[fix] do not colorize output on dumb terminals Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	4 years ago
Alexandre Flament	ca0889d488	[enh] checker: wikidata & ddd: add specific tests	4 years ago
Alexandre Flament	16a889dd8f	[enh] checker: add rosebud test	4 years ago
Alexandre Flament	8cbc9f2d58	[enh] add checker	4 years ago
Alexandre Flament	f7e11fd722	Merge pull request #2459 from dalf/update-python Update python	4 years ago
Alexandre Flament	9c55d772e9	Merge pull request #2408 from return42/rm-brand-make [mod] move brand options from Makefile to settings.yml	4 years ago
Alexandre Flament	f5c3cb7afa	[mod] drop Python 3.5 support	4 years ago
Alexandre Flament	8d0312d014	Merge pull request #2458 from MarcAbonce/hide-links-mobile2 Hide links panel in mobile screens	4 years ago
Marc Abonce Seguin	635c6516a4	hide links panel in mobile screens	4 years ago
Alexandre Flament	424e6abc7e	[mod] settings.yml: move brand settings to a dedicated section	4 years ago
Markus Heiser	d0338cb504	[fix] add missing brand.CONTACT_URL to /config API endpoint Suggested-by: @dalf / https://github.com/searx/searx-stats2/issues/59#issuecomment-747961582 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	4 years ago
Markus Heiser	9e53470b4c	[mod] get rid of searx/brand.py Removes module searx/brand.py and creates a namespace at searx.brand. This patch is a first 'proof of concept'. Later we can decide to remove the brand namespace entirely or not. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	4 years ago
Markus Heiser	9485179064	[mod] move brand options from Makefile to settings.yml Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	4 years ago
Alexandre Flament	c2646df496	Merge pull request #2454 from MarcAbonce/fix-empty-lang-bang Fix empty colon in query from selecting Chinese	4 years ago
Marc Abonce Seguin	571ce9ff07	fix empty colon in query from selecting Chinese	4 years ago
Noémi Ványi	a6dd1de4a8	Add wiby.me engine Closes #2339	4 years ago
Markus Heiser	b0bb0a3a0f	[fix] Library Genesis links shifted by 1 #1998 Fixes: #1998 Suggested-by: @linuxmue Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	4 years ago
Émilien Devos	fc6cfc3b58	Remove voat due to its shutdown Voat shutted down on December 25th, 2020 at 12 noon PST: https://voat.co/host/voat/static/inactive.min.html?ReturnUrl=/	4 years ago
Alexandre Flament	54e69d0367	[upd] update dependencies minor change in the oscar theme becase the last version of jinja2 respect more carefully the spaces in the templates	4 years ago
Alexandre Flament	568b9465e9	[mod] check secret_key when searx.webapp is imported Without this commit the module searx checks the secret_key value. With this commit, make docs, utils/standalone_searx.py, utils/fetch_firefox_version.py works without SEARX_DEBUG=1 For reference see https://github.com/searx/searx/pull/2386	4 years ago
Alexandre Flament	1956ab4b50	Merge pull request #2412 from dalf/update-buildenv [fix] update buildenv	4 years ago
Markus Heiser	4de276e364	[upd] make SEARX_DEBUG=1 useragents.update Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	4 years ago
Alexandre Flament	db5b060455	[fix] update buildenv CONTACT_URL is unset in Makefile, but searx/brand.py and utils/brand.env are not updated. This commit fixes this issue.	4 years ago
Alexandre Flament	3f8ebf70b1	[fix] pylint: use "raise ... from ..."	4 years ago
Alexandre Flament	eb33ae6893	[fix] Python 3.9: use html.unescape instead of HTMLParser.unescape	4 years ago
Alexandre Flament	04447f8c1a	Merge pull request #2398 from dalf/mod-search-query Mod search query	4 years ago
Alexandre Flament	f4983e7415	[mod] remove emojis from source code	4 years ago
Alexandre Flament	eda8934f15	[mod] searx.search.EngineRef: remove from_bang parameter from_bang is True when the user query contains a bang. In this case the category is also set to 'none'. from_bang only usage was in searx.webadapter.parse_specific : if from_bang is True, then the EngineRef category is ignored and force to 'none'. This commit also removes the searx.webadapter.parse_sepecific function.	4 years ago
Alexandre Flament	995ba2f406	[mod] searx.search.SearchQuery: remove categories parameter The categories parameter is useless in the constructor: it is always the categories from the EngineRef. The categories becomes a property.	4 years ago
Alexandre Flament	14c7cc0e11	[mod] Makefile: make CONTACT_URL optional	4 years ago
BBaoVanC	19fce74443	Add link to contact instance maintainer to footer of each page (#2391 )	4 years ago
Alexandre Flament	5c6a5407a0	[fix] fix of PR #2225	4 years ago
Alexandre Flament	02fc4147ce	[mod] dictzone, translated, currency_convert: use engine_type online_curency and online_dictionnary	4 years ago
Alexandre Flament	7ec8bc3ea7	[mod] split searx.search into different processors see searx.search.processors.abstract.EngineProcessor First the method searx call the get_params method. If the return value is not None, then the searx call the method search.	4 years ago
Alexandre Flament	c0cc01e936	[mod] searx.search: search_multiple_requests is a method of Search class	4 years ago
Alexandre Flament	3b87efb3db	[mod] move seax/search.py to searx/search/__init__.py	4 years ago
Alexandre Flament	9bc1856e2b	[mod] themes: remove legacy, courgette and pix-art themes	4 years ago
Alexandre Flament	88660fde90	Merge pull request #2396 from lucky13820/patch-1 Fix the StartPage result title is showing the url	4 years ago
lucky13820	fea8958e99	Fix the StartPage result title is showing the url Fix the issue 2395 where StartPage result title is showing the url. https://github.com/searx/searx/issues/2395	4 years ago
Markus Heiser	9db7d6357b	[themes] add hyperlink to searx instances list in error message closes: #2383 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	4 years ago
Alexandre Flament	39ac81478c	prepare release 0.18.0	4 years ago
Alexandre Flament	292b73a3fc	Merge pull request #2385 from joshu9h/patch-1 [Fix] Startpage	4 years ago
Alexandre Flament	36600118fb	Merge pull request #2372 from dalf/remove-broken-engines [remove] remove searchcode_doc and twitter	4 years ago
joshu9h	8260435c8b	[Fix] Startpage	4 years ago
Alexandre Flament	3c4a9c1188	Merge pull request #2358 from dalf/fix-command [fix] command engine: SearchQuery.query is str not bytes	4 years ago
Alexandre Flament	d703119d3a	[enh] add raise_for_httperror check HTTP response: * detect some comme CAPTCHA challenge (no solving). In this case the engine is suspended for long a time. * otherwise raise HTTPError as before the check is done in poolrequests.py (was before in search.py). update qwant, wikipedia, wikidata to use raise_for_httperror instead of raise_for_status	4 years ago
Alexandre Flament	033f39bff7	Merge pull request #2376 from dalf/fix-mojeek Fix mojeek	4 years ago
Alexandre Flament	6bc6d5e9fd	Merge pull request #2371 from dalf/mod-genius [mod) genious: return valid results even if contents are empty	4 years ago
Alexandre Flament	0ba74cd812	[mod] results: don't crash when an engine don't have a category According to `820b468bfe/searx/engines/__init__.py (L87-L88)` an engine can have no category at all. Without this commit, searx raise an exception in searx/results.py Note: in this case, the engine is not shown in the preferences.	4 years ago
Alexandre Flament	d41cafd5f3	[fix] xpath, mojeek: fix commit `58d72f2692` before commit `58d72f2`, category was not set in xpath.py, so searx/engines/__init__py was setting the category to ['general'] the commit `58d72f2` set the category to [] which is not replaced by searx/engines/__init__.py consequence: the mojeek engine is hidden in the preferences. this commit revert the xpath.py change. close #2368	4 years ago
Noémi Ványi	3a63dfbdd7	display if an engine does not support https Closes #302	4 years ago
Alexandre Flament	1c9e7cef50	[remove] remove searchcode_doc and twitter * twitter: the API has changed. the engine needs to rewritten. * searchcode_doc: the API about documentation doesn't exist anymore.	4 years ago
Alexandre Flament	fa73f10f11	[mod) genious: return valid results even if contents are empty	4 years ago
Alexandre Flament	42a194898b	Merge pull request #2360 from dalf/update-libgen [mod] libgen: update the URL to http://libgen.rs/	4 years ago
Alexandre Flament	a77d8c8227	Merge pull request #2359 from dalf/update-duden [mod] duden engine	4 years ago
Alexandre Flament	bd4869ecd0	Merge pull request #2366 from dalf/remove-seedpeer [remove] seedpeer engine	4 years ago
Alexandre Flament	56c64d6b64	[remove] seedpeer engine the website is offline.	4 years ago
Alexandre Flament	c1a9732268	Merge pull request #2364 from dalf/fix-youtube-noapi [fix] youtube_noapi engine	4 years ago
Alexandre Flament	13d3004703	Merge pull request #2365 from dalf/fix-soundcloud [fix] soundclound: accept result without content	4 years ago
Alexandre Flament	62073c0e1d	Merge pull request #2361 from dalf/fix-1x [fix] 1x engine	4 years ago
Alexandre Flament	923bc02c17	Merge pull request #2363 from dalf/fix-wikipedia-minor [fix] wikipedia: minor fix: return no result instead of crash in some very few cases.	4 years ago
Alexandre Flament	deb1bde20d	[fix] soundclound: accept result without content	4 years ago
Alexandre Flament	34df0f7910	[fix] youtube_noapi engine	4 years ago
Alexandre Flament	58d51e082d	[fix] wikipedia: minor fix: return no result instead of crash in some very few cases. In few cases, the JSON results doesn't contains the key 'type'.	4 years ago
Alexandre Flament	4ec810749b	[fix] 1x engine	4 years ago
Alexandre Flament	1e781863fa	[fix] command engine: SearchQuery.query is str not bytes see `c225db45c8`	4 years ago
Alexandre Flament	9bf594cbcf	[mod] duden engine * add params['soft_max_redirects'] = 1 (when there is spelling suggestion) * avoid try..except * use eval_xpath_* functions	4 years ago
Alexandre Flament	b3032cf953	[mod] libgen: update the URL to http://libgen.rs/ https://libgen.is actually redirect to http://libgen.rs/ It seems there is no HTTPS version: * https://www.wikidata.org/wiki/Q22017206 * https://librarygenesis.net/	4 years ago
Alexandre Flament	a458451d20	Merge pull request #2356 from dalf/fix-ddd [fix] duckduckgo_definitions: fix relative image URL	4 years ago

... 3 4 5 6 7 ...

2950 Commits (dca3bcca9e1917dd3874ba9e40e1055e32caba34)