Commit Graph

791 Commits (63b7d558b677319819dd48653a89325c4460ab3f)

Author SHA1 Message Date
Markus Heiser 8762863ebf [mod] presearch: set WEB timeout to 4sec & single network for all request
timeout: 4.0
  The timeout of presearch-WEB is left up from the default of 3sec to 4sec.  The
  engine has to send two HTTP requests, they often exceed the default timeout of
  3sec. Since all other presearch categories (images, videos, news) also have a
  timeout of 4 sec, the WEB search should also have the same timeout.

network: presearch
  Place all HTTP requests in the same network, named ``presearch``.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
9 months ago
Markus Heiser f9c5727ddc [mod] get rid of ./utils/brand.env and its workflow
All the environments defined in ./utils/brand.env are generated on the fly, so
there is no longer a need to define the brand environment in this file and all
the workflows to handle this file.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
10 months ago
Bnyro 3dea7e609b [feat] autocompleter: implementation of stract (beta) 10 months ago
Bnyro 621e1313af [feat] engine: implementation of stract (beta) 10 months ago
Markus Heiser 8dfc1dbc5c [fix] engine - offical URL moved to https://lingva.thedaviddelta.com/
The ML top-level domain has been removed from Freenom ... moved the official
instance to https://lingva.thedaviddelta.com  [1]

To test use translation syntax:

    !lv en-de Alternative front-end for Google Translate

[1] https://fosstodon.org/@thedaviddelta/111376540936289966

Closes: https://github.com/searxng/searxng/issues/2718
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
10 months ago
Bnyro d6ac2b5a55 [feat] engine: implementation of bahnhof.de 10 months ago
Bnyro 8a4104b992 [feat] engine: implementation of rotten tomatoes 10 months ago
Bnyro dda74fc9c9 [feat] engine: implementation of mdn 10 months ago
Bnyro b5b81c9806 [feat] engine: implementation of fyyd 10 months ago
Bnyro 527e13ab46 [feat] engine: implementation of podcastindex.org 10 months ago
Bnyro 3bc85c511c [mod] tootfinder: implement python module 10 months ago
Markus Heiser 3829c253ff [mod] add option max_page to bing, brave, qwant, startpage & mojeek
[1] https://github.com/searxng/searxng/issues/2982#issuecomment-1808975780

Reported-by: @Damaj301damaj-lol [1]
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
11 months ago
Markus Heiser 2274d55d5a [mod] add option max_page
Related: https://github.com/searxng/searxng/issues/2982
Closes: https://github.com/searxng/searxng/issues/2972

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
11 months ago
Bnyro bf75a8c2a0 [feat] engine: implementation of bpb 11 months ago
Bnyro 04cfce2eb8 [feat] yep: support for images and news (and safesearch) 11 months ago
Markus Heiser 44392bd436 [mod] improve implementation of presearch engine
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
11 months ago
Bnyro 23582aac5c [feat] implementation of presearch engine 11 months ago
Bnyro c3cc24be12 [feat] engine: implementation of destatis 11 months ago
Bnyro fa5b2a7948 [mod] yacy: use official instance by default and fix crashes 1 year ago
Alex Balgavy 5d53aac20f [mod] add hotkeys option to settings.yml
The change in the hotkey mechanism introduced in 317db5b04 does not allow
configuration via `settings.yml`.  This commit adds that functionality.

Closes: #2898
1 year ago
Hackurei ff78b1a902 [feat] implement hackernews engine - news.ycombinator.com 1 year ago
Aine 213cb74378 [fix] matrixrooms add proper MRS integration
Related:

- https://github.com/searxng/searxng/issues/2918
1 year ago
Bnyro 48cb58bd2e [feat] duckduckgo: support for videos and news 1 year ago
Bnyro ce270961e8 [feat] engine: implementation of mastodon 1 year ago
Bnyro 3e2ae756f0 [feat] engine: implementation of radio-browser.info 1 year ago
Bnyro 5ce1792432 [feat] engine: implementation of pinterest 1 year ago
Bnyro 159629c588 [mod] tagesschau: add option to only use tagesschau urls 1 year ago
Bnyro 2ca60a19fc [feat] engine: implementation of matrixrooms.info 1 year ago
Bnyro d1a3fc5be6 [feat] engine: implementation of tootfinder 1 year ago
Bnyro fc4a20f734 [mod] add movies category for tmdb, imdb and moviepilot 1 year ago
Bnyro 26fed56d51 [mod] settings.yml: remove plugin settings for plugins that don't exist anymore 1 year ago
jazzzooo 1a66d74673 [fix] engine - kickass update url, fix parsing, use multiple mirrors 1 year ago
Emilien Devos 47721a3485 add new parameter called server.public_instance
for enabling by default advanced limiter functions
in the future allow us to add features just for the public instances
1 year ago
Émilien (perso) 1851f27154
[mod] remove twitter (#2843) 1 year ago
Bnyro 75c9de02d1 [feat] engine: implementation of imgur 1 year ago
Bnyro 51236ae47a [feat] engine: implementation of chefkoch.de 1 year ago
Bnyro cc2e0537a3 [feat] engine: implementation of google icons/material design icons 1 year ago
Bnyro c999cfb422 [feat] engine: implementation of wallhaven 1 year ago
Émilien (perso) 33496e7f51 Switch back to qwant web normal API 1 year ago
Émilien (perso) ad725ce7d7
wikipedia wikidata infobox + disable wikisource (#2806)
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser 317db5b04f [mod] preferences: implement drop-down menu for hotkeys (default, vim)
Replace the on/off checkbox of the vim-hotkeys in the preferences by a drop-down
menu.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Bnyro a55e0ac553 [feat] search on category select without JS
Co-authored-by: Alexandre Flament <alex@al-f.net>
1 year ago
Bnyro efd3a2d6d1 [feat] engine: implementation of internet archive scholar 1 year ago
Markus Heiser d9dbcedeb6 [feat] implementation of qwant lite for web search
Related: https://github.com/searxng/searxng/issues/2719
Replace: https://github.com/searxng/searxng/pull/2748
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Bnyro b4e0d2eedc [feat] engine: implemenation of moviepilot (de) 1 year ago
Bnyro 140125e641 [feat] implementation of the movie database 1 year ago
Justas Zabulionis b701ee257b [fix] habrahabr 1 year ago
Justas Zabulionis cf734e6008 [fix] engine - pub.dev 1 year ago
Justas Zabulionis 92d39de410 [fix] solidtorrents redirects 1 year ago
jazzzooo ed3819bdd5 add inv.tux.pizza 1 year ago
jazzzooo 122b4342eb remove invidious.snopyta.org 1 year ago
jazzzooo e2a5e183cc [fix] settings.yml - change default invidious instances 1 year ago
jazzzooo 976b3e21c4 [fix] engine - pypi redirect 1 year ago
Bnyro 64d9587ac8 [feat] new engine: svgrepo 1 year ago
Bnyro 9e83c0dedc [feat] engine: implementation of Yummly
Co-authored-by: Markus Heiser <markus.heiser@damarit.de>
1 year ago
Markus Heiser 019bd97f4b [fix] settings.yml - fix docs-links in the comments
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Hackurei 1f21ac7d62 [feat] engine: implementation of bilibili https://www.bilibili.com 1 year ago
Hackurei 4da7003ae0 [feat] engine: implementation of odysee 1 year ago
Bnyro 9c4e9d3814 [feat] implementation of Wikimedia commons for images 1 year ago
Bnyro df71c24b20 [mod] autocomplete.py: add support for mwmbl completions 1 year ago
Markus Heiser d52919cc3e [mod] decrease the weighting of wikivoyage, wikibooks, wikisource and wikiversity
The search engines deliver hits for many search terms [1], but these are usually
not the focus of the user. In order to arrange these hits further down in the
list, their weighting is reduced.

[1] https://github.com/searxng/searxng/pull/2589#issuecomment-1670915089

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
PlayDay 018b0a9322 [feat] engine: XPath configuration for pkg.go.dev 1 year ago
Bnyro c59ae91b76 [feat] engine: implementation of mwmbl 1 year ago
Markus Heiser 9100a48541 [mod] improve seekr engines and add documentation
Tis patch adds some more fields to the result items and changed paging to the
``nextResultSet`` given in seekr's JSON response.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Bnyro 2bab658d39 [feat] engine: implementation of seekr for news, images and videos 1 year ago
Markus Heiser 7052a1a7cf [drop] engine archive.is / blocked by CAPTCHA [1]
Sadly archive.is is blocked by a CAPTCHA that can't be avoid (at least in a
XPath engine).

[1] https://github.com/searxng/searxng/issues/2643

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
ToxyFlog1627 f175574f37 [fix] typos in documentation & messages 1 year ago
Bnyro c76c999a1e [feat] engine: implementation of anaconda 1 year ago
Bnyro e25d1c7288 [feat] engine: implementation of German news, Tagesschau
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
GeckoLinux 2256ba2ffb [mod] settings.yml: move wolframalpha to categ general & disable by default
As suggested in comment [1] as a good compromise between [2] and [3].

This will help users that want Wolfram Alpha instant answers by default with
every query and don't mind the slowness.  It will be disabled by default so it's
fast for all users, and those that need it can enable it as a user-configurable
option without requiring setting up their own instance to change the Wolfram
Alpha categorization.

[1] https://github.com/searxng/searxng/pull/813#issuecomment-1574851572
[2] https://github.com/searxng/searxng/pull/813#issuecomment-1020581765
[3] https://github.com/searxng/searxng/issues/966#issue-1171107451
1 year ago
Markus Heiser c381fc001f [mod] settings: remove lemmy from categ 'general' & enable by default
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Bnyro 224f2250ae [feat] engine: support for lemmy communities, posts, comments and users 1 year ago
allendema_searxng_pi c00c0c5434 [mod] remove discontinued petalsearch engines 1 year ago
Markus Heiser 460bbe5b81 [mod] implement brave (WEB) engine to replace XPath configuration
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Bnyro d151497db3 [feat] engine: brave - support for news 1 year ago
Bnyro cae06f2781 [feat] engine: brave - support for videos 1 year ago
Bnyro 73364e158e [feat] engine: brave - support for images 1 year ago
Markus Heiser a2108432f7 [fix] settings.yml: typo in engine name wikipecies -> wikispecies
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Emilien Devos 0fc8f99ecc [feat] new engine: bt4g added & enabled and disable by default btdigg
Disable btdigg because on most SearXNG instances, SearXNG is blocked by btdigg
due to cloudflare too many requests.

This impementation did not parse the HTML page because there is an API in
XML (RSS).  The RSS feed provides fewer data like amount of seeders/leechers and
the files in the torrent file. It's a tradeoff for a "stable" engine as the XML
from RSS content will change way less than the HTML page.

Closes: https://github.com/searxng/searxng/issues/2553
1 year ago
Markus Heiser dad16c0949 [mod] settings.yml: enable engines from Wikimedia Foundation
The Wikimedia wikis [1] engines provide good answers and have short response
times --> no reason to disable these enhgines by default.  BTW: this patch adds
a (sub-) category ``wikimedia`` for the engines [1].

[1] https://meta.wikimedia.org/wiki/Wikimedia_wikis

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser db522cf76d [mod] engine: wikimedia - improve results, add addition settings & doc
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Bnyro 7d8c20c80d [feat] new engine: wikispecies 1 year ago
Markus Heiser 1b030d4b41 [doc] engine: Yacy
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
zutto ca518c6803 add option to change yacy search mode 1 year ago
Markus Heiser ef5831cd84 [mod] engine piped: split into two dedicated engiens for video & music
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser 7aa95d2d52 [doc] engine piped: add documentation to docs/dev/engines/online/
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Bnyro 636bfdac68 [feat] engine: implementation of Piped 1 year ago
mrpaulblack 65d8b1a310 [fix] remove disabled: false from engine definitions in settings.yml
* setting disabled: false is not needed, since it is by default enabled
1 year ago
Paolo Basso cada89ee36 [feat] engine: re-enables z-library (zlibrary-global.se)
- re-enables z-library as the new domain zlibrary-global.se is now available
  from the open web.   The announcement of the domain:

    https://www.reddit.com/r/zlibrary/comments/13whe08/mod_note_zlibraryglobalse_domain_is_officially/

  It is an official domain, it requires to log in to the "personal" subdomain
  only to download files, but the search works.

- changes the result template of zlibrary to paper.html, filling the appropriate fields
- implements language filtering for zlibrary
- implement zlibrary custom filters (engine traits)
- refactor and document the zlibrary engine
1 year ago
Hackurei cb92767f19 [feat] enigine: add CrowdView forum search engine 1 year ago
Markus Heiser e2df6b77a3 [mod] engine: Anna's Archive - additionl settings (content, sort, ext)
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser eafc2906f1 [mod] engine: Anna's Archive - fetch search arguments from search form
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Paolo Basso 7adb9090e5 [mod] engine: Anna's Archive - add language support 1 year ago
Paolo Basso e5637fe7b9 [feat] engine: implementation of Anna's Archive
Anna's Archive [1] is a free non-profit online shadow library metasearch engine
providing access to a variety of book resources (also via IPFS), created by a
team of anonymous archivists [2].

[1] https://annas-archive.org/
[2] https://annas-software.org/AnnaArchivist/annas-archive
1 year ago
Paolo Basso 401561cb58 [mod] engine torznab - refactor & option to hide links
- torznab engine using types and clearer code
- torznab option to hide torrent and magnet links.
- document the torznab engine
- add myself to authors

Closes: https://github.com/searxng/searxng/issues/1124
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser f77807257b [fix] engines: don't spam marginalia.nu with default settings
The engine configuration of marginalia [2][3][4][5] spams marginalia.nu with
requests from SearXNG instances [1].  It is not in the interest of SearXNG to
disturb other FOSS projects, so the engine will be removed::

    - name: marginalia
      engine: json_engine
      shortcut: mar
      categories: general
      paging: false
      # Key and license: https://www.marginalia.nu/marginalia-search/api/
      # index: 0 popular, 1 blogs, 2 big_sites, 3 default, 4 experimental
      search_url: https://api.marginalia.nu/<insert your key here>/search/{query}?index=4&count=20
      results_query: results
      url_query: url
      title_query: title
      content_query: description
      timeout: 1.5
      disabled: true
      about:
        website: https://www.marginalia.nu/
        official_api_documentation: https://api.marginalia.nu/
        use_official_api: true
        require_api_key: true
        results: JSON

[1] https://github.com/searxng/searxng/issues/1673
[2] https://github.com/searxng/searxng/pull/1627
[3] https://github.com/searxng/searxng/issues/1620
[4] https://news.ycombinator.com/item?id=35874640
[5] d82a858491/code/services-satellite/api-service/src/main/java/nu/marginalia/api/svc/ResponseCache.java (L12-L20)

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser 007a615ffa [mod] donation_url: disable by default
SearXNG's donation campaign has been ended.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser 45529f51a1
Merge pull request #2347 from return42/mod-lang-detection
If language recognition fails use the Accept-Language
2 years ago
Markus Heiser f1b6351ae1 [fix] engine: google play movies
Closes: https://github.com/searxng/searxng/pull/1746
Closes: https://github.com/searxng/searxng/issues/1599

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2 years ago
Markus Heiser 8adbc4fcec [mod] settings.yml: enable language detection by default_lang (auto)
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2 years ago