Bnyro
f3b4bf86a7
[feat] engine: implementation of void linux packages
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
8 months ago
Alexandre Flament
d58760ef75
[mod] pypi engine: use packages.html
8 months ago
Austin-Olacsi
9330a072eb
[feat] engine: implementation of pixiv
8 months ago
Bnyro
e76ab1a4b3
[refactor] images: add resolution, image format and filesize fields
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
8 months ago
Markus Heiser
b683aa63fb
[feat] github: use packages template
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
8 months ago
Bnyro
1d6f475fbc
[feat] dockerhub: use packages template
8 months ago
Bnyro
cfbe59b6b3
[feat] engine: implementation of mozhi
8 months ago
Xinos
3c42252c78
[feat] engine: implementation of yandex music
...
Access to music is limited to a few countries:
- https://yandex.com/support/music/access.html
8 months ago
micsthepick
fde21c8f99
[feat] engine: Add LiveSpace livestreams
8 months ago
Markus Heiser
76845ea42c
[mod] engine ask.com - parse JS result to JSON
...
Parse the result list from ask.com given in the variable named
window.MESON.initialState::
<script nonce="..">
window.MESON = window.MESON || {};
window.MESON.initialState = {"siteConfig": ...
...}};
window.MESON.loadedLang = "en";
</script>
The result list is in field::
json_resp['search']['webResults']['results']
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
8 months ago
Hackurei
3df53d6e50
[feat] engine: implementation of ask.com
8 months ago
Bnyro
11c0651ef4
[fix] lingva: redirect and parsing error
8 months ago
Hackurei
b0fe0924a3
[feat] engine: implementation of brave goggles
8 months ago
Markus Heiser
c14b117121
[fix] brave.search - update result selectors to fit to new layout
...
Closes: https://github.com/searxng/searxng/issues/3167
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
9 months ago
Bnyro
efbee96b1d
[feat] brave: fix empty content and parse published dates
9 months ago
Bnyro
559b860618
[feat] engine: implementation of goodreads
9 months ago
Bnyro
8c73aa772b
[fix] semantic scholar: bad request
9 months ago
Jinyuan Huang
9c5f9735cf
[fix] engine: safesearch parameter in Google Videos engine ( #2762 )
...
Closes: https://github.com/searxng/searxng/issues/2762
9 months ago
Markus Heiser
e560d7e373
[mod] presearch: add language & region support
...
In Presearch there are languages for the UI and regions for narrowing down the
search. With this change the SearXNG engine supports a search by region. The
details can be found in the documentation of the source code.
To test, you can search terms like::
!presearch bmw :zh-TW
!presearch bmw :en-CA
1. You should get results corresponding to the region (Taiwan, Canada)
2. and in the language (Chinese, Englisch).
3. The context in info box content is in the same language.
Exceptions:
1. Region or language is not supported by Presearch or
2. SearXNG user did not selected a region tag, example::
!presearch bmw :en
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
9 months ago
Markus Heiser
a2c269bbac
[mod] presearch: hardening engine's response against KeyErrors
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
9 months ago
Bnyro
0a78f59aba
[fix] presearch: safesearch, time ranges, crash when no result found
9 months ago
Bnyro
621e1313af
[feat] engine: implementation of stract (beta)
10 months ago
Markus Heiser
8dfc1dbc5c
[fix] engine - offical URL moved to https://lingva.thedaviddelta.com/
...
The ML top-level domain has been removed from Freenom ... moved the official
instance to https://lingva.thedaviddelta.com [1]
To test use translation syntax:
!lv en-de Alternative front-end for Google Translate
[1] https://fosstodon.org/@thedaviddelta/111376540936289966
Closes: https://github.com/searxng/searxng/issues/2718
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
10 months ago
Markus Heiser
6df922b9da
[fix] fetch_traits of google and zlibrary
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
10 months ago
Bnyro
8a4104b992
[feat] engine: implementation of rotten tomatoes
10 months ago
Bnyro
dda74fc9c9
[feat] engine: implementation of mdn
10 months ago
Bnyro
b5b81c9806
[feat] engine: implementation of fyyd
10 months ago
Bnyro
527e13ab46
[feat] engine: implementation of podcastindex.org
10 months ago
Bnyro
3bc85c511c
[mod] tootfinder: implement python module
10 months ago
Markus Heiser
3829c253ff
[mod] add option max_page to bing, brave, qwant, startpage & mojeek
...
[1] https://github.com/searxng/searxng/issues/2982#issuecomment-1808975780
Reported-by: @Damaj301damaj-lol [1]
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
11 months ago
Markus Heiser
2274d55d5a
[mod] add option max_page
...
Related: https://github.com/searxng/searxng/issues/2982
Closes: https://github.com/searxng/searxng/issues/2972
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
11 months ago
Bnyro
bf75a8c2a0
[feat] engine: implementation of bpb
11 months ago
Bnyro
04cfce2eb8
[feat] yep: support for images and news (and safesearch)
11 months ago
Markus Heiser
44392bd436
[mod] improve implementation of presearch engine
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
11 months ago
Bnyro
23582aac5c
[feat] implementation of presearch engine
11 months ago
Bnyro
c3cc24be12
[feat] engine: implementation of destatis
11 months ago
Émilien (perso)
4280318fc5
fixing results parsing brave
1 year ago
Hackurei
efada7cba2
[fix] hackernews keyerror problem
1 year ago
Hackurei
af071121de
[fix] imgur - incorrect wikidata id
1 year ago
Markus Heiser
14323d683f
[fix] ddg-lite & ddg-extra: don't send empty vqd value
...
DDG's bot detection is sensitive to the vqd value. For some search terms (such
as extremely long search terms that are often sent by bots), no vqd value can be
determined.
If SearXNG cannot determine a vqd value, then no request should go out to
DDG (WEB): a request with a wrong vqd value leads to DDG temporarily putting
SearXNG's IP on a block list.
Requests from IPs in this block list run into timeouts.
Not sure, but it seems the block list is a sliding window: to get my IP rid from
the bot list I had to cool down my IP for 1h (send no requests from that IP to
DDG).
Since such issues can't reproduce in a local instance I tested this patch 24h on
my public SearXNG instance: There are still errors (rare), but the reliability
is still 100%.
Related:
- https://github.com/searxng/searxng/pull/2922
- https://github.com/searxng/searxng/pull/2923
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser
3388441917
[fix] ddg-lite vqd value: some search terms do not have a vqd value
...
Some search terms do not have results and therefore no vqd value
BTW: remove a leftover from 9197efa
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser
9197efa2a7
[fix] duckduckgo lite engine: set HTTP header 'Referer'
...
We have had problems with this before, the bot protection from ddg-lite seems to
have included this referer in the rating [1][2].
From reverse engineering:
- The Referer ``https://google.com/ `` was set in commt 257dc7d6c4
--> DDG lite
does not like this referer anymore!
- The 'Referer' header is only set on second and follow up pages but not on the
first page
- The vqd value is not needed on the first page, the ddg-lite client sets this
value only on follow up pages / this can help to reduce the vqd requests from
SearXNG.
Related to 'Referer' header & ddg requests:
[1] https://github.com/searxng/searxng/pull/2161
[2] https://github.com/searxng/searxng/pull/2081
Closes: https://github.com/searxng/searxng/issues/2796
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Bnyro
fa5b2a7948
[mod] yacy: use official instance by default and fix crashes
1 year ago
Hackurei
ff78b1a902
[feat] implement hackernews engine - news.ycombinator.com
1 year ago
Aine
213cb74378
[fix] matrixrooms add proper MRS integration
...
Related:
- https://github.com/searxng/searxng/issues/2918
1 year ago
Bnyro
48cb58bd2e
[feat] duckduckgo: support for videos and news
1 year ago
Bnyro
c3ab49cd90
[fix] kickass: crash when no results
1 year ago
Bnyro
f22daf8b47
[mod] piped: always show video length if available
1 year ago
Bnyro
ce270961e8
[feat] engine: implementation of mastodon
1 year ago
Markus Heiser
fd1422a670
[mod] engine - simplify region & lang handling, make filters configurable
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Bnyro
3e2ae756f0
[feat] engine: implementation of radio-browser.info
1 year ago
Jinyuan Huang
e509cb7c45
[typo] solved a typo in yahoo error message.
1 year ago
Jinyuan Huang
d4d9f2073e
[fix] Bug: Yahoo results for simplified Chinese search sometimes have the first character cut off #2866
...
Co-authored-by: Blair Noctis <n@sail.ng>
1 year ago
Bnyro
fe9386b58d
[fix] emojipedia: fix engine
1 year ago
Markus Heiser
32a4ea350e
[fix] Revision of the Bing engines
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
jazzzooo
079636c079
[fix] engine - bing fix search, pagination, remove safesearch
1 year ago
Bnyro
5ce1792432
[feat] engine: implementation of pinterest
1 year ago
Bnyro
6096457e4d
[fix] matrixrooms.info: pagination not working properly
1 year ago
Markus Heiser
e1a8b8189f
[fix] engine - moviepilot instead of thumbnail use img_src
...
Instead of thumbnail use img_src in the result item, otherwise the "movies"
categories looks clunky.
Related:
- b4e0d2eedc (r128785388)
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Bnyro
159629c588
[mod] tagesschau: add option to only use tagesschau urls
1 year ago
Bnyro
2ca60a19fc
[feat] engine: implementation of matrixrooms.info
1 year ago
Bnyro
fc4a20f734
[mod] add movies category for tmdb, imdb and moviepilot
1 year ago
jazzzooo
e37d775fa2
[fix] engine - currency fix and simplify
1 year ago
Jinyuan Huang
ae28d429c9
[fix] bilibili new api used
1 year ago
jazzzooo
1a66d74673
[fix] engine - kickass update url, fix parsing, use multiple mirrors
1 year ago
Markus Heiser
b428ccc5a0
[fix] engine brave - fetch traits (modified settings menu)
...
Brave has changed it settings menu fundamental. Region codes are no longer in
the HTML page, we have to read the regional codes from a JS:
https://cdn.search.brave.com/serp/v2/_app/immutable/chunks/parameters.734c106a.js
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser
3a456b1282
[fix] engine annas archive - fetch traits (modified xpath selectors)
...
Anna’s Archive has cleaned up their languages, available file extensions and
changed the HTML form.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Émilien (perso)
1851f27154
[mod] remove twitter ( #2843 )
1 year ago
Bnyro
75c9de02d1
[feat] engine: implementation of imgur
1 year ago
Bnyro
fb72f71f0a
[fix] internet archive scholar: crash when there's no title
1 year ago
Markus Heiser
71358e9c67
Revert "[fix] engine - duckduckgo vqd edge-case"
...
This reverts commit 102502a4f0
.
1 year ago
Bnyro
51236ae47a
[feat] engine: implementation of chefkoch.de
1 year ago
jazzzooo
8bcca0e620
[fix] engine - brave don't show ads
1 year ago
jazzzooo
b729542a66
[fix] engine - google images error when no results
1 year ago
Bnyro
cc2e0537a3
[feat] engine: implementation of google icons/material design icons
1 year ago
Bnyro
c999cfb422
[feat] engine: implementation of wallhaven
1 year ago
jazzzooo
102502a4f0
[fix] engine - duckduckgo vqd edge-case
1 year ago
Markus Heiser
043dcbf7c5
[fix] engine qwant (web-lite) - ignore advertising adds
...
Closes: https://github.com/searxng/searxng/issues/2812
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Émilien (perso)
ad725ce7d7
wikipedia wikidata infobox + disable wikisource ( #2806 )
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Bnyro
efd3a2d6d1
[feat] engine: implementation of internet archive scholar
1 year ago
jazzzooo
223b3487c3
[fix] spelling
1 year ago
Markus Heiser
a9b6963971
[fix] engine - qwant delivers only 5 pages maximum
...
all qwant engines (incl qwant-lite) delivers only 5 pages maximum
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
jazzzooo
da1446c5ed
[fix] engine - qwant wrong error type
1 year ago
Markus Heiser
7398d525c8
[fix] qwant: subsequent fix of commit d9dbcedeb
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser
d9dbcedeb6
[feat] implementation of qwant lite for web search
...
Related: https://github.com/searxng/searxng/issues/2719
Replace: https://github.com/searxng/searxng/pull/2748
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Bnyro
b4e0d2eedc
[feat] engine: implemenation of moviepilot (de)
1 year ago
jazzzooo
7dfcc3386e
[fix] tagesschau videos
1 year ago
jazzzooo
ec540a967a
[fix] brave.videos
1 year ago
jazzzooo
27477f51fd
[fix] brave.news
1 year ago
Justas Zabulionis
41ef73ca3a
[fix] rumble redirect
1 year ago
Justas Zabulionis
be888810ba
[fix] pubmed content being None
1 year ago
Justas Zabulionis
92d39de410
[fix] solidtorrents redirects
1 year ago
Justas Zabulionis
cf8a6cf6db
[fix] solidtorrents pagination
1 year ago
Justas Zabulionis
8172f89075
[fix] solidtorrents
1 year ago
jazzzooo
74600c028d
[fix] engine - Crossref
...
Crossref was broken on result types journal-issue and component .. The old code
had lots of assumptions, and broke during parsing. Now the assumptions are more
explicit and checked them with the API.
1 year ago
Bnyro
3568a3cafb
[feat] odysee: implement fetch_traits for language support
1 year ago
Bnyro
09c61dabc9
[mod] odysee: time range support
1 year ago
jazzzooo
b98907e91f
[fix] engine - piped.music incorrect timestamps
1 year ago
jazzzooo
6039dbf211
[fix] engine - invidious thumbnails
1 year ago
jazzzooo
b2fd6304bf
[fix] engine - openstreetmap currency rendering
1 year ago