Archives
/
searxng
mirror of https://github.com/searxng/searxng
2
0
Fork 1
Code Issues Packages Projects Releases Wiki Activity
4,006 Commits
6 Branches
17 Tags
95 MiB
gh-pages
master
dependabot/pip/master/sphinx-autobuild-2024.9.3
translations
dependabot/npm_and_yarn/searx/static/themes/simple/master/grunt-eslint-25.0.0
update_js_ariable_to_python
v1.0.0
v0.18.0
v0.17.0
v0.16.0
v0.15.0
v0.14.0
v0.13.1
v0.13.0
v0.12.0
v0.11.0
v0.10.0
v0.9.0
v0.8.1
v0.8.0
v0.7.0
v0.6.0
1.0.0
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '4845183128'
${ noResults }
Commit Graph

2659 Commits (48451831286037cd5e2610c756cff2f1abeb9411)

Author SHA1 Message Date
Alexandre Flament 9211cdfe9b [upd] remove google_play_music engine 
Google Play Music has been replaced by Youtube music.
 4 years ago
Alexandre Flament aedf03c0f7 Fix: activate raise_for_error by default 
Fix commit d703119d3a :
Some engines need to parse the HTTP error but
raise_for_error is always set to False in the "request" function.
 4 years ago
Alexandre Flament 5e055b069b [fix) fix apk_mirror engine 4 years ago
Alexandre Flament e4cc7f13a3
Merge pull request #2542 from kvch/fix-naver-engine 
Fix XPATHs in Naver engine
 4 years ago
Alexandre Flament bec9e30fe7
Merge pull request #2554 from MarcAbonce/zh-variants-in-wikipedia 
Add support for Chinese variants in Wikipedia
 4 years ago
Daniel Hones 138f32471c Updated webutils.highlight_content to ignore double-quotes when highlighting query parts 4 years ago
Marc Abonce Seguin 64e81794fe add support for Chinese variants in Wikipedia 4 years ago
Noémi Ványi ac309f5b8d Fix naver engine 
Closes #2540
 4 years ago
Markus Heiser 41c03cf011 [drop] metager - xpath engine won't work anymore 
The new version of MetaGer needs to reload the reults (into a iframe) with a
unique tag (see HTML response below).

Implementing a dedicated metager-engine for searx makes no sense to me. The
great days of MetaGer seems to be ended.  I remember the good old days this
project started in the 90's of the last century.  But in the last few years it
becomes more and more crap.  As the name suggested, MetaGer was made for
germans in the first place.  They have added a english and spain translation but
the i18n is very poor compared to what searx offers.

It's a pity, lets drop MetaGer.

This is the first response, the id (b82679980656899ba5a17ffd02a56846) is unique
for each query:

    $ curl "https://metager.org/meta/meta.ger3?eingabe=foo&submit-query=&focus=web"
    <!DOCTYPE html>
    <html lang="en">
    <head>
        <meta charset="UTF-8">
        <link rel="stylesheet" href="/index.css?id=b82679980656899ba5a17ffd02a56846">
        <script src="/index.js?id=b82679980656899ba5a17ffd02a56846"></script>
    <title>foo - MetaGer</title>
    <meta name="viewport" content="width=device-width, initial-scale=1, maximum-scale=1" />
    </head>
    <body>
        <iframe id="mg-framed" src="https://metager.org/meta/meta.ger3?eingabe=foo&amp;submit-query=&amp;focus=web&amp;mgv=b82679980656899ba5a17ffd02a56846" autofocus="true" onload="this.contentWindow.focus();"></iframe>
     </body>

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 4 years ago
Hermógenes Oliveira 514faa9162 [feat] recoll: paged json support 4 years ago
Marc Abonce Seguin c937a9e85f [fix] get correct locale with country from browser 
Some of our interface locales include uppercase country codes,
which are separated by `_` instead of the more common `-`.
Also, a browser's `Accept-Language` header could be in lowercase.

This commit attempts to normalize those cases so a browser's
language+country codes can better match with our locales.

This solution assumes that our UI locales have nothing more than
language and optionally country. If we ever add a script specific
locale like `zh-Hant-TW` this would have to change to accomodate
that, but the idea would be pretty much the same as this fix.
 4 years ago
mrwormo c4c1636b18 Add Creative Commons search engine 4 years ago
Alexandre Flament ca93a01844 [mod] dynamically set language_support variable 
The language_support variable is set to True by default,
and set to False in only 5 engines.

Except the documentation and the /config URL, this variable is not used.

This commit remove the variable definition in the engines, and
set value according to supported_languages length: False when the length is 0,
True otherwise.

Close #2485
 4 years ago
Markus Heiser 7f505bdc6f [fix] google: avoid unnecessary SearxEngineXPathException errors 
Avoid SearxEngineXPathException errors when parsing non valid results::

    .//div[@class="yuRUbf"]//a/@href index 0 not found
    Traceback (most recent call last):
      File "./searx/engines/google.py", line 274, in response
        url = eval_xpath_getindex(result, href_xpath, 0)
      File "./searx/searx/utils.py", line 608, in eval_xpath_getindex
        raise SearxEngineXPathException(xpath_spec, 'index ' + str(index) + ' not found')
    searx.exceptions.SearxEngineXPathException: .//div[@class="yuRUbf"]//a/@href index 0 not found

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 4 years ago
Markus Heiser e436287385 [mod] checker: add some additional tests 
BTW: fix indentation by 2 spaces

The additional tests has been commented out in the google engines to not release
any CAPTCHA issues.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 4 years ago
Markus Heiser b1fefec40d [fix] normalize the language & region aspects of all google engines 
BTW: make the engines ready for search.checker:

- replace eval_xpath by eval_xpath_getindex and eval_xpath_list
- google_images: remove outer try/except block

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 4 years ago
Markus Heiser ff6804e545 [data] make engines.languages 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 4 years ago
Markus Heiser 8cdad5d85d [fix] google-videos: parse values for 'length' & 'author' 
The 'video.html' template from the 'oscar' design supports replacement
for *author* and *length*.  Google-videos does not have an author, alternatively
the publisher info from is used for the *author*.

Hint: these replacements are not supported by the 'simple' design.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 4 years ago
Markus Heiser 89b3050b5c [fix] revise of the google-Video engine 
This revise is based on the methods developed in the revise of the google engine
(see commit 410c2f9).

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 4 years ago
Alexandre Flament 8c46b767d0 [fix] google_news: avoid one HTTP redirect except for the English results 
also add
params['soft_max_redirects'] = 1
to avoid false error reporting in /stats/errors
 4 years ago
Markus Heiser 5f92dfcdbe [fix] google-news: query uses locale without country tag 
Wthout country-region tag google will redirect to correct the contry tag [1]:

    SEARX_DEBUG=1 searx-checker -v "google news"
    ...
    https://news.google.com:443 "GET /search?q=computer&hl=en...      HTTP/1.1" 302 0
    https://news.google.com:443 "GET /search?q=computer&hl=en-US&.... HTTP/1.1" 200 None
    ...

[1] https://github.com/searx/searx/pull/2483#issuecomment-765600849

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 4 years ago
Markus Heiser baec54c492 [fix] revise of the google-news engine 
This revise is based on the methods developed in the revise of the google engine
(see commit 410c2f9).

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 4 years ago
Alexandre Flament 73c86f9bf2 [mod] checker: disable by default 4 years ago
Alexandre Flament 3b7b852aa8 [fix] checker: minor fix about language detection 4 years ago
Alexandre Flament aa887eb375 [mod] checker : replace pycld3 by langdetect 
pycld3 requires the native library cld3
langdetect is a pure python package
 4 years ago
Alexandre Flament 67a1aab0d5 [fix] /stats/checker : remove the timestamp field when the checker is disabled 4 years ago
Alexandre Flament d473407ec9 [fix] checker: fix engine statistics 
Without this commit, the URL /stats/errors shows percentage above 100% after the checker has run.
 4 years ago
Alexandre Flament ca76f3119a [fix] error_recorder: record code and lineno about the engine 
since the PR #2225 , code and lineno were sometimes meaningless
see /stats/errors
 4 years ago
Alexandre Flament 80d7411f2c
Merge pull request #2452 from kvch/add-wilby-engine 
Add wiby.me engine
 4 years ago
Alexandre Flament b405646749
Merge pull request #2451 from mrwormo/invidious-engine 
[Fix] Invidious Engine
 4 years ago
Alexandre Flament a4dcfa025c [enh] engines: add about variable 
move meta information from comment to the about variable
so the preferences, the documentation can show these information
 4 years ago
mrwormo 2dff3887f0 [fix] Invidious engine by enabling requests by randomly picking amongst working instances 4 years ago
Alexandre Flament 912c7e975c [fix] checker: don't run the checker when uwsgi is not properly configured 
Before this commit, even with the scheduler disabled, the checker was running
at least once for each uwsgi worker.
 4 years ago
Alexandre Flament 7f0c508598 [fix] checker: fix typo unknown instead of unknow 4 years ago
Alexandre Flament a0c8b413a6 [mod] searx.shared: minor tweaks 
searx.shared.shared_abstract.SharedDict inherit from abc.ABC
searx.shared.shared_uwsgi.schedule can schedule multiple functions without issue
 4 years ago
Alexandre Flament 87bafbc32b [mod] checker: add status and timestamp to the result 
for each engine: replace status by success
 4 years ago
Alexandre Flament f3e1bd308f [mod] checker: minor adjustements on the default tests 
the query "time" is convinient because most of the search engine will return some results,
but some engines in the general category will return documentation about the HTML tags <time> or <input type="time">
 4 years ago
Alexandre Flament 45bfab77d0 |mod] checker: improve searx-checker command line 
* output is unbuffered
* verbose mode describe more precisly the errrors
 4 years ago
Alexandre Flament 3a9f513521 [enh] checker: background check 
See settings.yml for the options
SIGUSR1 signal starts the checker.
The result is available at /stats/checker
 4 years ago
Alexandre Flament 6e2872f436 [enh] add searx.shared 
shared dictionary between the workers (UWSGI or werkzeug)
scheduler: run a task once every x seconds (UWSGI or werkzeug)
 4 years ago
Markus Heiser 9c581466e1 [fix] do not colorize output on dumb terminals 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 4 years ago
Alexandre Flament ca0889d488 [enh] checker: wikidata & ddd: add specific tests 4 years ago
Alexandre Flament 16a889dd8f [enh] checker: add rosebud test 4 years ago
Alexandre Flament 8cbc9f2d58 [enh] add checker 4 years ago
Alexandre Flament f7e11fd722
Merge pull request #2459 from dalf/update-python 
Update python
 4 years ago
Alexandre Flament 9c55d772e9
Merge pull request #2408 from return42/rm-brand-make 
[mod] move brand options from Makefile to settings.yml
 4 years ago
Alexandre Flament f5c3cb7afa [mod] drop Python 3.5 support 4 years ago
Alexandre Flament 8d0312d014
Merge pull request #2458 from MarcAbonce/hide-links-mobile2 
Hide links panel in mobile screens
 4 years ago
Marc Abonce Seguin 635c6516a4 hide links panel in mobile screens 4 years ago
Alexandre Flament 424e6abc7e [mod] settings.yml: move brand settings to a dedicated section 4 years ago
Markus Heiser d0338cb504 [fix] add missing brand.CONTACT_URL to /config API endpoint 
Suggested-by: @dalf / https://github.com/searx/searx-stats2/issues/59#issuecomment-747961582
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 4 years ago
Markus Heiser 9e53470b4c [mod] get rid of searx/brand.py 
Removes module searx/brand.py and creates a namespace at searx.brand.

This patch is a first 'proof of concept'.  Later we can decide to remove the
brand namespace entirely or not.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 4 years ago
Markus Heiser 9485179064 [mod] move brand options from Makefile to settings.yml 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 4 years ago
Alexandre Flament c2646df496
Merge pull request #2454 from MarcAbonce/fix-empty-lang-bang 
Fix empty colon in query from selecting Chinese
 4 years ago
Marc Abonce Seguin 571ce9ff07 fix empty colon in query from selecting Chinese 4 years ago
Noémi Ványi a6dd1de4a8 Add wiby.me engine 
Closes #2339
 4 years ago
Markus Heiser b0bb0a3a0f [fix] Library Genesis links shifted by 1 #1998 
Fixes: #1998
Suggested-by: @linuxmue
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 4 years ago
Émilien Devos fc6cfc3b58
Remove voat due to its shutdown 
Voat shutted down on December 25th, 2020 at 12 noon PST: https://voat.co/host/voat/static/inactive.min.html?ReturnUrl=/
 4 years ago
Alexandre Flament 54e69d0367 [upd] update dependencies 
minor change in the oscar theme becase the last version of jinja2
respect more carefully the spaces in the templates
 4 years ago
Alexandre Flament 568b9465e9 [mod] check secret_key when searx.webapp is imported 
Without this commit the module searx checks the secret_key value.

With this commit, make docs, utils/standalone_searx.py,
utils/fetch_firefox_version.py works without SEARX_DEBUG=1

For reference see https://github.com/searx/searx/pull/2386
 4 years ago
Alexandre Flament 1956ab4b50
Merge pull request #2412 from dalf/update-buildenv 
[fix] update buildenv
 4 years ago
Markus Heiser 4de276e364 [upd] make SEARX_DEBUG=1 useragents.update 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 4 years ago
Alexandre Flament db5b060455 [fix] update buildenv 
CONTACT_URL is unset in Makefile, but searx/brand.py and
utils/brand.env are not updated.

This commit fixes this issue.
 4 years ago
Alexandre Flament 3f8ebf70b1 [fix] pylint: use "raise ... from ..." 4 years ago
Alexandre Flament eb33ae6893 [fix] Python 3.9: use html.unescape instead of HTMLParser.unescape 4 years ago
Alexandre Flament 04447f8c1a
Merge pull request #2398 from dalf/mod-search-query 
Mod search query
 4 years ago
Alexandre Flament f4983e7415 [mod] remove emojis from source code 4 years ago
Alexandre Flament eda8934f15 [mod] searx.search.EngineRef: remove from_bang parameter 
from_bang is True when the user query contains a bang.
In this case the category is also set to 'none'.

from_bang only usage was in searx.webadapter.parse_specific :
if from_bang is True, then the EngineRef category is ignored and force to 'none'.

This commit also removes the searx.webadapter.parse_sepecific function.
 4 years ago
Alexandre Flament 995ba2f406 [mod] searx.search.SearchQuery: remove categories parameter 
The categories parameter is useless in the constructor:
it is always the categories from the EngineRef.

The categories becomes a property.
 4 years ago
Alexandre Flament 14c7cc0e11 [mod] Makefile: make CONTACT_URL optional 4 years ago
BBaoVanC 19fce74443
Add link to contact instance maintainer to footer of each page (#2391) 4 years ago
Alexandre Flament 5c6a5407a0 [fix] fix of PR #2225 4 years ago
Alexandre Flament 02fc4147ce [mod] dictzone, translated, currency_convert: use engine_type online_curency and online_dictionnary 4 years ago
Alexandre Flament 7ec8bc3ea7 [mod] split searx.search into different processors 
see searx.search.processors.abstract.EngineProcessor

First the method searx call the get_params method.

If the return value is not None, then the searx call the method search.
 4 years ago
Alexandre Flament c0cc01e936 [mod] searx.search: search_multiple_requests is a method of Search class 4 years ago
Alexandre Flament 3b87efb3db [mod] move seax/search.py to searx/search/__init__.py 4 years ago
Alexandre Flament 9bc1856e2b [mod] themes: remove legacy, courgette and pix-art themes 4 years ago
Alexandre Flament 88660fde90
Merge pull request #2396 from lucky13820/patch-1 
Fix the StartPage result title is showing the url
 4 years ago
lucky13820 fea8958e99
Fix the StartPage result title is showing the url 
Fix the issue 2395 where StartPage result title is showing the url. https://github.com/searx/searx/issues/2395
 4 years ago
Markus Heiser 9db7d6357b [themes] add hyperlink to searx instances list in error message 
closes: #2383

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 4 years ago
Alexandre Flament 39ac81478c prepare release 0.18.0 4 years ago
Alexandre Flament 292b73a3fc
Merge pull request #2385 from joshu9h/patch-1 
[Fix] Startpage
 4 years ago
Alexandre Flament 36600118fb
Merge pull request #2372 from dalf/remove-broken-engines 
[remove] remove searchcode_doc and twitter
 4 years ago
joshu9h 8260435c8b
[Fix] Startpage 4 years ago
Alexandre Flament 3c4a9c1188
Merge pull request #2358 from dalf/fix-command 
[fix] command engine: SearchQuery.query is str not bytes
 4 years ago
Alexandre Flament d703119d3a [enh] add raise_for_httperror 
check HTTP response:
* detect some comme CAPTCHA challenge (no solving). In this case the engine is suspended for long a time.
* otherwise raise HTTPError as before

the check is done in poolrequests.py (was before in search.py).

update qwant, wikipedia, wikidata to use raise_for_httperror instead of raise_for_status
 4 years ago
Alexandre Flament 033f39bff7
Merge pull request #2376 from dalf/fix-mojeek 
Fix mojeek
 4 years ago
Alexandre Flament 6bc6d5e9fd
Merge pull request #2371 from dalf/mod-genius 
[mod) genious: return valid results even if contents are empty
 4 years ago
Alexandre Flament 0ba74cd812 [mod] results: don't crash when an engine don't have a category 
According to
820b468bfe/searx/engines/__init__.py (L87-L88)

an engine can have no category at all.

Without this commit, searx raise an exception in searx/results.py

Note: in this case, the engine is not shown in the preferences.
 4 years ago
Alexandre Flament d41cafd5f3 [fix] xpath, mojeek: fix commit 58d72f2692 
before commit 58d72f2, category was not set in xpath.py,
so searx/engines/__init__py was setting the category to ['general']

the commit 58d72f2 set the category to [] which is not replaced by searx/engines/__init__.py
consequence: the mojeek engine is hidden in the preferences.

this commit revert the xpath.py change.

close #2368
 4 years ago
Noémi Ványi 3a63dfbdd7 display if an engine does not support https 
Closes #302
 4 years ago
Alexandre Flament 1c9e7cef50 [remove] remove searchcode_doc and twitter 
* twitter: the API has changed. the engine needs to rewritten.
* searchcode_doc: the API about documentation doesn't exist anymore.
 4 years ago
Alexandre Flament fa73f10f11 [mod) genious: return valid results even if contents are empty 4 years ago
Alexandre Flament 42a194898b
Merge pull request #2360 from dalf/update-libgen 
[mod] libgen: update the URL to http://libgen.rs/
 4 years ago
Alexandre Flament a77d8c8227
Merge pull request #2359 from dalf/update-duden 
[mod] duden engine
 4 years ago
Alexandre Flament bd4869ecd0
Merge pull request #2366 from dalf/remove-seedpeer 
[remove] seedpeer engine
 4 years ago
Alexandre Flament 56c64d6b64 [remove] seedpeer engine 
the website is offline.
 4 years ago
Alexandre Flament c1a9732268
Merge pull request #2364 from dalf/fix-youtube-noapi 
[fix] youtube_noapi engine
 4 years ago
Alexandre Flament 13d3004703
Merge pull request #2365 from dalf/fix-soundcloud 
[fix] soundclound: accept result without content
 4 years ago
Alexandre Flament 62073c0e1d
Merge pull request #2361 from dalf/fix-1x 
[fix] 1x engine
 4 years ago