Archives
/
searxng
mirror of https://github.com/searxng/searxng
2
0
Fork 1
Code Issues Packages Projects Releases Wiki Activity
7,806 Commits
11 Branches
17 Tags
102 MiB
translations_update
translations
dependabot/pip/master/uvloop-0.21.0
dependabot/pip/master/pallets-sphinx-themes-2.2.0
dependabot/pip/master/sphinx-issues-5.0.0
gh-pages
master
revert-3936-master
dependabot/pip/master/redis-5.1.1
dependabot/npm_and_yarn/searx/static/themes/simple/master/grunt-eslint-25.0.0
update_js_ariable_to_python
v1.0.0
v0.18.0
v0.17.0
v0.16.0
v0.15.0
v0.14.0
v0.13.1
v0.13.0
v0.12.0
v0.11.0
v0.10.0
v0.9.0
v0.8.1
v0.8.0
v0.7.0
v0.6.0
1.0.0
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '1892a87fd2'
${ noResults }
Commit Graph

1625 Commits (1892a87fd2139252b80f48f4e079a7b37b2b55c3)

Author SHA1 Message Date
Bnyro f3b4bf86a7 [feat] engine: implementation of void linux packages 
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
 8 months ago
Alexandre Flament d58760ef75 [mod] pypi engine: use packages.html 8 months ago
Austin-Olacsi 9330a072eb [feat] engine: implementation of pixiv 8 months ago
Bnyro e76ab1a4b3 [refactor] images: add resolution, image format and filesize fields 
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
 8 months ago
Markus Heiser b683aa63fb [feat] github: use packages template 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 8 months ago
Bnyro 1d6f475fbc [feat] dockerhub: use packages template 8 months ago
Bnyro cfbe59b6b3 [feat] engine: implementation of mozhi 8 months ago
Xinos 3c42252c78 [feat] engine: implementation of yandex music 
Access to music is limited to a few countries:

- https://yandex.com/support/music/access.html
 8 months ago
micsthepick fde21c8f99 [feat] engine: Add LiveSpace livestreams 8 months ago
Markus Heiser 76845ea42c [mod] engine ask.com - parse JS result to JSON 
Parse the result list from ask.com given in the variable named
window.MESON.initialState::

    <script nonce="..">
        window.MESON = window.MESON || {};
        window.MESON.initialState = {"siteConfig": ...
          ...}};
        window.MESON.loadedLang = "en";
    </script>

The result list is in field::

    json_resp['search']['webResults']['results']

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 8 months ago
Hackurei 3df53d6e50 [feat] engine: implementation of ask.com 8 months ago
Bnyro 11c0651ef4 [fix] lingva: redirect and parsing error 8 months ago
Hackurei b0fe0924a3 [feat] engine: implementation of brave goggles 8 months ago
Markus Heiser c14b117121 [fix] brave.search - update result selectors to fit to new layout 
Closes: https://github.com/searxng/searxng/issues/3167
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 9 months ago
Bnyro efbee96b1d [feat] brave: fix empty content and parse published dates 9 months ago
Bnyro 559b860618 [feat] engine: implementation of goodreads 9 months ago
Bnyro 8c73aa772b [fix] semantic scholar: bad request 9 months ago
Jinyuan Huang 9c5f9735cf [fix] engine: safesearch parameter in Google Videos engine (#2762) 
Closes: https://github.com/searxng/searxng/issues/2762
 9 months ago
Markus Heiser e560d7e373 [mod] presearch: add language & region support 
In Presearch there are languages for the UI and regions for narrowing down the
search.  With this change the SearXNG engine supports a search by region.  The
details can be found in the documentation of the source code.

To test, you can search terms like::

   !presearch bmw :zh-TW
   !presearch bmw :en-CA

1. You should get results corresponding to the region (Taiwan, Canada)
2. and in the language (Chinese, Englisch).
3. The context in info box content is in the same language.

Exceptions:

1. Region or language is not supported by Presearch or
2. SearXNG user did not selected a region tag, example::

    !presearch bmw :en

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 9 months ago
Markus Heiser a2c269bbac [mod] presearch: hardening engine's response against KeyErrors 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 9 months ago
Bnyro 0a78f59aba [fix] presearch: safesearch, time ranges, crash when no result found 9 months ago
Bnyro 621e1313af [feat] engine: implementation of stract (beta) 10 months ago
Markus Heiser 8dfc1dbc5c [fix] engine - offical URL moved to https://lingva.thedaviddelta.com/ 
The ML top-level domain has been removed from Freenom ... moved the official
instance to https://lingva.thedaviddelta.com  [1]

To test use translation syntax:

    !lv en-de Alternative front-end for Google Translate

[1] https://fosstodon.org/@thedaviddelta/111376540936289966

Closes: https://github.com/searxng/searxng/issues/2718
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 10 months ago
Markus Heiser 6df922b9da [fix] fetch_traits of google and zlibrary 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 10 months ago
Bnyro 8a4104b992 [feat] engine: implementation of rotten tomatoes 10 months ago
Bnyro dda74fc9c9 [feat] engine: implementation of mdn 10 months ago
Bnyro b5b81c9806 [feat] engine: implementation of fyyd 10 months ago
Bnyro 527e13ab46 [feat] engine: implementation of podcastindex.org 10 months ago
Bnyro 3bc85c511c [mod] tootfinder: implement python module 10 months ago
Markus Heiser 3829c253ff [mod] add option max_page to bing, brave, qwant, startpage & mojeek 
[1] https://github.com/searxng/searxng/issues/2982#issuecomment-1808975780

Reported-by: @Damaj301damaj-lol [1]
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 11 months ago
Markus Heiser 2274d55d5a [mod] add option max_page 
Related: https://github.com/searxng/searxng/issues/2982
Closes: https://github.com/searxng/searxng/issues/2972

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 11 months ago
Bnyro bf75a8c2a0 [feat] engine: implementation of bpb 11 months ago
Bnyro 04cfce2eb8 [feat] yep: support for images and news (and safesearch) 11 months ago
Markus Heiser 44392bd436 [mod] improve implementation of presearch engine 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 11 months ago
Bnyro 23582aac5c [feat] implementation of presearch engine 11 months ago
Bnyro c3cc24be12 [feat] engine: implementation of destatis 11 months ago
Émilien (perso) 4280318fc5 fixing results parsing brave 1 year ago
Hackurei efada7cba2 [fix] hackernews keyerror problem 1 year ago
Hackurei af071121de [fix] imgur - incorrect wikidata id 1 year ago
Markus Heiser 14323d683f [fix] ddg-lite & ddg-extra: don't send empty vqd value 
DDG's bot detection is sensitive to the vqd value.  For some search terms (such
as extremely long search terms that are often sent by bots), no vqd value can be
determined.

If SearXNG cannot determine a vqd value, then no request should go out to
DDG (WEB): a request with a wrong vqd value leads to DDG temporarily putting
SearXNG's IP on a block list.

Requests from IPs in this block list run into timeouts.

Not sure, but it seems the block list is a sliding window: to get my IP rid from
the bot list I had to cool down my IP for 1h (send no requests from that IP to
DDG).

Since such issues can't reproduce in a local instance I tested this patch 24h on
my public SearXNG instance: There are still errors (rare), but the reliability
is still 100%.

Related:

- https://github.com/searxng/searxng/pull/2922
- https://github.com/searxng/searxng/pull/2923

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 1 year ago
Markus Heiser 3388441917 [fix] ddg-lite vqd value: some search terms do not have a vqd value 
Some search terms do not have results and therefore no vqd value

BTW: remove a leftover from 9197efa

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 1 year ago
Markus Heiser 9197efa2a7 [fix] duckduckgo lite engine: set HTTP header 'Referer' 
We have had problems with this before, the bot protection from ddg-lite seems to
have included this referer in the rating [1][2].

From reverse engineering:

- The Referer ``https://google.com/`` was set in commt 257dc7d6c4 --> DDG lite
  does not like this referer anymore!

- The 'Referer' header is only set on second and follow up pages but not on the
  first page

- The vqd value is not needed on the first page, the ddg-lite client sets this
  value only on follow up pages / this can help to reduce the vqd requests from
  SearXNG.

Related to 'Referer' header & ddg requests:

[1] https://github.com/searxng/searxng/pull/2161
[2] https://github.com/searxng/searxng/pull/2081

Closes: https://github.com/searxng/searxng/issues/2796
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 1 year ago
Bnyro fa5b2a7948 [mod] yacy: use official instance by default and fix crashes 1 year ago
Hackurei ff78b1a902 [feat] implement hackernews engine - news.ycombinator.com 1 year ago
Aine 213cb74378 [fix] matrixrooms add proper MRS integration 
Related:

- https://github.com/searxng/searxng/issues/2918
 1 year ago
Bnyro 48cb58bd2e [feat] duckduckgo: support for videos and news 1 year ago
Bnyro c3ab49cd90 [fix] kickass: crash when no results 1 year ago
Bnyro f22daf8b47 [mod] piped: always show video length if available 1 year ago
Bnyro ce270961e8 [feat] engine: implementation of mastodon 1 year ago
Markus Heiser fd1422a670 [mod] engine - simplify region & lang handling, make filters configurable 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 1 year ago