Archives
/
searxng
mirror of https://github.com/searxng/searxng
2
0
Fork 1
Code Issues Packages Projects Releases Wiki Activity
4,234 Commits
6 Branches
17 Tags
95 MiB
gh-pages
master
dependabot/pip/master/sphinx-autobuild-2024.9.3
translations
dependabot/npm_and_yarn/searx/static/themes/simple/master/grunt-eslint-25.0.0
update_js_ariable_to_python
v1.0.0
v0.18.0
v0.17.0
v0.16.0
v0.15.0
v0.14.0
v0.13.1
v0.13.0
v0.12.0
v0.11.0
v0.10.0
v0.9.0
v0.8.1
v0.8.0
v0.7.0
v0.6.0
1.0.0
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'e6deddbc70'
${ noResults }
Commit Graph

2791 Commits (e6deddbc70647afe71002206ca3bb049d779c732)

Author SHA1 Message Date
Plague Doctor 7035bed4ee Add new engine: Wordnik.com 3 years ago
Alexandre Flament c09ff4faf2 [fix] fix PR 2656 
SCRIPT_NAME remove trailing slash to avoid infinite redirect
 3 years ago
Noémi Ványi 07f5edce3d Add Meilisearch engine 
Website: https://www.meilisearch.com/
 3 years ago
Noémi Ványi a477a3a687
Merge pull request #2728 from return42/fix-loader 
[fix] settings_loader.py - use update_dict only for mapping types
 3 years ago
3nprob 2ca0aa4f29 Remove hubsbpot tracking URL params 
More information here:
https://knowledge.hubspot.com/settings/how-do-i-create-a-tracking-url
https://knowledge.hubspot.com/ads/ad-tracking-in-hubspot
https://knowledge.hubspot.com/ctas/calls-to-action-frequently-asked-questions
https://meta.stackexchange.com/questions/263392/what-are-these-very-long-parameters-in-so-careers-feedback-always-welcome-url
 3 years ago
Markus Heiser 9c10b15096 [fix] settings_loader.py - use update_dict only for mapping types 
I can't set `default_doi_resolver` in `settings.yml` if I'm using
`use_default_settings`.  Searx seems to try to interpret all settings at root
level in `settings.yml` as dict, which is correct except for
`default_doi_resolver` which is at root level and a string::

    File "/usr/lib/python3.9/site-packages/searx/settings_loader.py", line 125, in load_settings
        update_settings(default_settings, user_settings)
    File "/usr/lib/python3.9/site-packages/searx/settings_loader.py", line 61, in update_settings
        update_dict(default_settings[k], v)
    File "/usr/lib/python3.9/site-packages/searx/settings_loader.py", line 48, in update_dict
        for k, v in user_dict.items():
    AttributeError: 'str' object has no attribute 'items'

Signed-off-by: Markus Heiser <markus@darmarit.de>
Suggested-by:  @0xhtml https://github.com/searx/searx/issues/2722#issuecomment-813391659
 3 years ago
Alexandre Flament 7089526723
Merge pull request #2656 from return42/fix-url_for 
[fix] url_for(..., _external=True) in templates
 3 years ago
Markus Heiser 87e4c47621 [fix] url_for(..., _external=True) in templates 
The `url_for` function in the template context is not the one from Flask, it is
the one from `webapp`.  The `webapp.url_for_theme` is different from its
namesake of Flask and has it quirks, when called with argument `_external=True`.

The `webapp.url_for_theme` can't handle absolute URLs since it pokes a leading
'/', here is the snippet of the old code::

    url = url_for(endpoint, **values)
    if settings['server']['base_url']:
        if url.startswith('/'):
            url = url[1:]
        url = urljoin(settings['server']['base_url'], url)

Next drawback of (Flask's) `_external=True` is, that it will not return the HTTP
scheme when searx (the Flask app) listens on http and is proxied by a https
server.

To get the right scheme `HTTP_X_SCHEME` is needed by Flask (werkzeug).  Since
this is not provided in every environment (e.g. behind Apache mod_wsgi or the
HTTP header is not fully set for some other reasons) it is recommended to
get *script_name*, *server* and *scheme* from the configured `base_url`.  If
`base_url` is specified, then these values from are given preference over any
Flask's generics.

BTW this patch normalize to use `url_for` in the `opensearch.xml` and drop the
need of `host` and `urljoin` in template's context.

Signed-off-by: Markus Heiser <markus@darmarit.de>
 3 years ago
Alexandre Flament 7a0fbdecc4 [enh] oscar: image thumbnail layout 
Adjust thumbnail sizes to fill the container width
 3 years ago
Noémi Ványi ba90c5a2e0
Merge pull request #2718 from return42/fix-publishedDate 
[fix] publishedDate: don't try to get date from empty string or None
 3 years ago
Markus Heiser ebfd0eb2b7 [fix] default_doi_resolver in preferences 
Instead of a hard-coded `oadoi.org` default, use the default value from
`settings.yml`.

Fix an issue in the themes: The replacement 'current_doi_resolver' contains the
doi_resolver_url, not the name of the DOI resolver.  Compare return value of::

    searx.plugins.oa_doi_rewrite.get_doi_resolver(...)

Fix a typo in `get_doi_resolver(..)`:  suggested by @kvch:

  *L32 should set doi_resolver not doi_resolvers*

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 3 years ago
Markus Heiser c12826c6d5 [fix] publishedDate: don't try to get date from empty string or None 
Signed-off-by: Markus Heiser <markus@darmarit.de>
 3 years ago
Noémi Ványi 7612e5d9fd
Merge pull request #2712 from searx/update_data_update_firefox_version.py 
Update searx.data - update_firefox_version.py
 3 years ago
Noémi Ványi 985e8b28fe
Merge pull request #2710 from searx/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 3 years ago
Noémi Ványi feb2d81874
Merge pull request #2709 from searx/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 3 years ago
Noémi Ványi 9a962c5369
Merge pull request #2711 from searx/update_data_update_wikidata_units.py 
Update searx.data - update_wikidata_units.py
 3 years ago
Noémi Ványi 5ca34ac571
Merge pull request #2713 from searx/update_data_update_languages.py 
Update searx.data - update_languages.py
 3 years ago
Markus Heiser 169438137f [fix] url bar autocomplete (opensearch suggestions) 
Since #2593 is merged the OpenSearch-Format is buggy.  The loop in [1] will
change raw_text_query object and this will change also the value of
`raw_text_query.query` on every `raw_text_query.changeQuery(result)`.

This patch fixes this issue by storing the initial query value in `sug_prefix`.

[1] ac0fdc3b96/searx/webapp.py (L804-L806)

OpenSearch-Format::

    [ "<query>",
      [ "<term 1>", "<term 2>", ... "<term n>" ],
      [ "<content 1>", "<content 2>", ..., "<content n>" ],
      [ "<url 1>", "<url 2>", ..., "<url n>" ]
    ]

- https://www.google.com/support/enterprise/static/gsa/docs/admin/current/gsa_doc_set/xml_reference/query_suggestion.html#1080002
- https://developer.mozilla.org/en-US/docs/Archive/Add-ons/Supporting_search_suggestions_in_search_plugins#implementing_search_suggestion_support_on_the_server

Legacy-Format::

    [ "<term 1>", "<term 2>", ..., "<term n>" ]

- https://www.google.com/support/enterprise/static/gsa/docs/admin/current/gsa_doc_set/xml_reference/query_suggestion.html#1081079

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 3 years ago
dalf c0668d248e Update searx.data - update_languages.py 4 years ago
dalf ad74c42aa1 Update searx.data - update_firefox_version.py 4 years ago
dalf 23dc7ef6d1 Update searx.data - update_wikidata_units.py 4 years ago
dalf eb5cd7a543 Update searx.data - update_ahmia_blacklist.py 4 years ago
dalf f804f54ca3 Update searx.data - update_currencies.py 4 years ago
Marc Abonce Seguin 419b907a0b fix dark "expand" button from infobox 4 years ago
Adam Tauber ae122ea943 [enh] release v1.0.0 4 years ago
Adam Tauber 15f2385a7b [enh] update translations from transifex 4 years ago
Alexandre Flament bb316d2698
Merge pull request #2682 from dalf/fix-checker 
[fix] checker: various bug fixes
 4 years ago
Alexandre Flament 725a69616b
Merge pull request #2681 from dalf/fix-wikipedia-title 
[fix] wikipedia: remove HTML from the title
 4 years ago
Noémi Ványi 9bb312c505 Remove duplicated key from dict in Semantic Scholar 4 years ago
Noémi Ványi f596f5767b fix Semantic Scholar engine 4 years ago
Adam Tauber 28286cf3f2 [fix] update seznam engine to be compatible with the new website 4 years ago
Alexandre Flament 0b45afd4d7 [fix] checker: various bug fixes 
* initialize engine_data (youtube engine)
* don't crash if an engine don't set result['url']
 4 years ago
Alexandre Flament fcfcf662ff [fix] wikipedia: remove HTML from the title 
fr.wikipedia.org (and it seems not other wikipedia websites),
adds HTML to api_result['displayTitle'].
(Search for '!wp :fr Braid' for example)

The commit uses api_result['title']
 4 years ago
Adam Tauber 06b754ad67 [mod] increase lobste.rs engine timeout to avoid timeouts most of the time 4 years ago
Adam Tauber 0ba71c3644 [fix] make ina engine compatible with the new response json 4 years ago
Adam Tauber 6255b33c9d [fix] rewrite hoogle to use html/xpath instead of json 
the json response has been changed and it contains html chunks which is
not compatible with our json engine, so we have to switch to html/xpath
parsing
 4 years ago
Adam Tauber 45f0e1a859 [fix] update geektimes.ru url - it redirects to habr.com 4 years ago
Adam Tauber 50ba2b9e87 [fix] update google play movies xpath 4 years ago
Adam Tauber 88657fe9c2 [fix] update google play apps xpath 4 years ago
Adam Tauber 5f450fda74 [enh] add year filter to duckduckgo 4 years ago
Adam Tauber fd737dc9d8 [fix] remove debug code 4 years ago
Alexandre Flament d648001688 [mod] preferences: a tooltip is shown when the mouse is over the engine names 4 years ago
Alexandre Flament 6bd01bf81f [mod] oscar: fix the sourcemap URL in *.min.css 
Close https://github.com/searx/searx/issues/2670

Note: clean-css contains a bug:
* a multiline comment or URL adds "$stdin" to the sourcemap (see src/less/logicodev/search.less)
* in this case when the user opens the devtools, the browser fails to load this "https://.../$stdin" URL
* it is not a problem and the error appears only when the user actively tries to debug the CSS.
* seems related to https://github.com/jakubpawlowicz/clean-css/issues/593
 4 years ago
Alexandre Flament a48ec0b4bd
Merge pull request #2671 from searx/update-soundcloud 
[mod] soundcloud: faster initialization
 4 years ago
Alexandre Flament 30c950a2c7
Merge pull request #2660 from dalf/upd-translations 
[mod] replace /translations.js with an embedded JSON
 4 years ago
Alexandre Flament 38c210d746
[mod] soundcloud: faster initialization 
The get_cliend_id() function:
* fetches https://soundcloud.com
* then fetches each referenced javascript URL to get the client id.

This commit fetches the javascript URLs in the reverse order: the client id is in the last javascript URL.
 4 years ago
James Higginbotham ce6eb81a71
Update settings.yml to enable HTTP for yacy 
Added a line to the yacy entry to enable HTTP if the local yacy instance isn't using HTTPS. Otherwise, an error will be thrown in the logs: "No connection adapters were found for 'http://localhost:8090/yacysearch.json...'". This is likely related to ticket #2641 that forces HTTPS by default.
 4 years ago
Alexandre Flament 2b0dd96bd3 [mod] oscar: remove space 
* reduce by 15% the uncompressed output (on average)
* dos2unix searx/templates/oscar/result_templates/files.html
 4 years ago
Dr. Rolf Jansen 7a9dc63d74
Merge branch 'master' into conditional-sigusr1 4 years ago
Alexandre Flament 6553c79029 [mod] replace /translations.js by embedded JSON 
In webapp.py, there is a new function "get_translations" lists available translations

Close #2064
 4 years ago
Alexandre Flament 32cd0d31b3 [mod] upgrade pygments 
add searx_extra/update/update_pygments.py to update the css style of the oscar and simple themes.
 4 years ago
Dr. Rolf Jansen 2a6dbeb6a5
Merge branch 'master' into conditional-sigusr1 4 years ago
Adam Tauber 4c631ac6d0 [fix] remove debug code 4 years ago
Dr. Rolf Jansen 4a27dabcf7
Merge branch 'master' into conditional-sigusr1 4 years ago
Noémi Ványi 8158d8654a fix Microsoft Academic engine 4 years ago
Adam Tauber f97b4ff7b6 [fix] update youtube_noapi paging 4 years ago
Adam Tauber dd34ac396c
Merge pull request #2652 from kvch/solr-engine 
Add Apache Solr engine
 4 years ago
Alexandre Flament 1664258061
Merge pull request #2655 from return42/fix-imports 
[fix] remove unused import from yahoo-news engine
 4 years ago
Alexandre Flament 5b176b3496
Merge pull request #2659 from MarcAbonce/onions-http-fix 
Fix HTTP error in onion engines
 4 years ago
Marc Abonce Seguin f4a0a4d756 fix HTTP error in onion engines 
regression from https://github.com/searx/searx/pull/2641
most onion websites only serve HTTP, so it must be enabled
 4 years ago
Rolf 80025c3244 Windows does not support SIGUSR1, so don't use it unconditionally. 4 years ago
Markus Heiser 6e1f1085ef [fix] remove unused import from yahoo-news engine 
Signed-off-by: Markus Heiser <markus@darmarit.de>
 4 years ago
Markus Heiser 3703ebb22a [drop] Acgsou engine - www.acgsou.com no longer exists 
- https://www.acgsou.com/ acgsou.com is redirected to 36dm.club
- @rinpatch do not plan on maintaining the engine [1]

[1] https://github.com/searx/searx/pull/1283#issuecomment-798783585

Signed-off-by: Markus Heiser <markus@darmarit.de>
 4 years ago
Noémi Ványi ff527e2681 Add Solr engine 4 years ago
Alexandre Flament 9292571304
Merge pull request #2346 from dalf/upgrade-oscar 
[mod] oscar: upgrade dependencies
 4 years ago
Alexandre Flament 92dd5e245e
Merge pull request #2626 from mikeri/solidtorrents 
Add Solid Torrents engine
 4 years ago
Alexandre Flament a1a492baed
Merge pull request #2641 from dalf/disable_http_by_default 
[mod] by default allow only HTTPS, not HTTP
 4 years ago
Alexandre Flament cb04d42806 [mod] oscar: update README.rst 4 years ago
Alexandre Flament 86912e2272 [mod] oscar: get bootstrap and typeahead from NPM 4 years ago
Alexandre Flament 44407353ef [mod] oscar: get leaflet and jquery from NPM 
easy to upgrade (package.json)
 4 years ago
Alexandre Flament c7133efb12 [mod] oscar: move compiled files to the src directory 4 years ago
Alexandre Flament eda3b513ac [mod] oscar: remove polyfills for Internet Explorer 4 years ago
Alexandre Flament 1268910274 [mod] oscar: remove unused images 4 years ago
Alexandre Flament bdb41bea7b [mod] theme: remove require-2.1.15.min.js 
See https://github.com/requirejs/requirejs/issues/1816

requirejs loads one file: leaflet.

This commit:
* removes requirejs
* load leaflet using <script src...> HTML tag in searx/templates/oscar/base.html
 4 years ago
Alexandre Flament 2f3d5ec2af [mod] oscar: upgrade npm dependencies 4 years ago
Markus Heiser 96422e5c9f [fix] APKMirror engine - update xpath selectors and fix img_src 
BTW: make the code slightly more readable

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 4 years ago
Markus Heiser d2faea423a [fix] rewrite Yahoo-News engine 
Many things have been changed since last review of this engine.  This patch fix
xpath selectors, implements suggestion and is a complete review / rewrite of the
engine.

Signed-off-by: Markus Heiser <markus@darmarit.de>
 4 years ago
Alexandre Flament 99e0651cea [mod] by default allow only HTTPS, not HTTP 
Related to https://github.com/searx/searx/pull/2373
 4 years ago
Michael Ilsaas 5549d58de3 Add Solid Torrents engine 4 years ago
Adam Tauber 44f4a9d49a [enh] add ability to send engine data to subsequent requests 4 years ago
Alexandre Flament 87f4cc4a9e
Merge pull request #2631 from searx/update_data_update_languages.py 
Update searx.data - update_languages.py
 4 years ago
Markus Heiser 4845183128 [mod] don't dump traceback of SearxEngineResponseException on init 
When initing engines a "SearxEngineResponseException" is logged very verbose,
including full traceback information:

    ERROR:searx.engines:yggtorrent engine: Fail to initialize
    Traceback (most recent call last):
      File "share/searx/searx/engines/__init__.py", line 293, in engine_init
        init_fn(get_engine_from_settings(engine_name))
      File "share/searx/searx/engines/yggtorrent.py", line 42, in init
        resp = http_get(url, allow_redirects=False)
      File "share/searx/searx/poolrequests.py", line 197, in get
        return request('get', url, **kwargs)
      File "share/searx/searx/poolrequests.py", line 190, in request
        raise_for_httperror(response)
      File "share/searx/searx/raise_for_httperror.py", line 60, in raise_for_httperror
        raise_for_captcha(resp)
      File "share/searx/searx/raise_for_httperror.py", line 43, in raise_for_captcha
        raise_for_cloudflare_captcha(resp)
      File "share/searx/searx/raise_for_httperror.py", line 30, in raise_for_cloudflare_captcha
        raise SearxEngineCaptchaException(message='Cloudflare CAPTCHA', suspended_time=3600 * 24 * 15)
    searx.exceptions.SearxEngineCaptchaException: Cloudflare CAPTCHA, suspended_time=1296000

For SearxEngineResponseException this is not needed.  Those types of exceptions
can be a normal use case.  E.g. for CAPTCHA errors like shown in the example
above. It should be enough to log a warning for such issues:

    WARNING:searx.engines:yggtorrent engine: Fail to initialize // Cloudflare CAPTCHA, suspended_time=1296000

closes: #2612

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 4 years ago
Alexandre Flament 0165e14a7f
Merge pull request #2632 from searx/update_data_update_wikidata_units.py 
Update searx.data - update_wikidata_units.py
 4 years ago
Alexandre Flament 152f6fc1da
Merge pull request #2630 from searx/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 4 years ago
dalf 1e8b846954 Update searx.data - update_currencies.py 4 years ago
dalf 2f8a708481 Update searx.data - update_wikidata_units.py 4 years ago
dalf d9dc3376d0 Update searx.data - update_languages.py 4 years ago
dalf 2857473553 Update searx.data - update_ahmia_blacklist.py 4 years ago
Alexandre Flament aac37f288f
Merge pull request #2593 from dalf/update-autocomplete 
Update autocomplete
 4 years ago
Alexandre Flament 63f17d2e4c [enh] autocomplete refactoring, autocomplete on external bangs 4 years ago
Markus Heiser d48e2e7b0b [enh] google scholar - python implementation of the engine 
The old xpath configuration for google scholar did not work and is replaced by a
python implementation.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 4 years ago
Alexandre Flament 4fa1290c11 [fix] answers: don't crash when the query is an empty string 4 years ago
Alexandre Flament e2fb500892
Merge pull request #2608 from return42/unittest2 
[py2to3] use unittest from py3, remove unittest2 from py2
 4 years ago
Alexandre Flament 0c663e25fc
Merge pull request #2604 from searx/update_data_firefox_version 
Update searx.data - firefox_version
 4 years ago
Alexandre Flament f77983e174
Merge pull request #2602 from MarcAbonce/fix-bing-fetch-languages 
Fix fetch_languages for Bing
 4 years ago
GazoilKerozen 5f6ac3afa2
Add Freesound engine (#2596) 
Add freesound engine with player.

Co-authored-by: Gazoil <maildeguzel@gmail.com>
 4 years ago
Markus Heiser 3bae35940a [py2to3] use unittest from py3, remove unittest2 from py2 
- unittest2 is a backport of the new features added to the unittest testing
  framework in Python 2.7

- unittest2 was only needed in py2 and can be dropped now

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 4 years ago
Alexandre Flament b05f4d0664
Merge pull request #2605 from searx/update_data_currencies 
Update searx.data - currencies
 4 years ago
Alexandre Flament aec5188b51
Merge pull request #2606 from searx/update_data_wikidata_units 
Update searx.data - wikidata_units
 4 years ago
dalf 893b6e4901 Update searx.data - ahmia_blacklist 4 years ago