Markus Heiser
14323d683f
[fix] ddg-lite & ddg-extra: don't send empty vqd value
...
DDG's bot detection is sensitive to the vqd value. For some search terms (such
as extremely long search terms that are often sent by bots), no vqd value can be
determined.
If SearXNG cannot determine a vqd value, then no request should go out to
DDG (WEB): a request with a wrong vqd value leads to DDG temporarily putting
SearXNG's IP on a block list.
Requests from IPs in this block list run into timeouts.
Not sure, but it seems the block list is a sliding window: to get my IP rid from
the bot list I had to cool down my IP for 1h (send no requests from that IP to
DDG).
Since such issues can't reproduce in a local instance I tested this patch 24h on
my public SearXNG instance: There are still errors (rare), but the reliability
is still 100%.
Related:
- https://github.com/searxng/searxng/pull/2922
- https://github.com/searxng/searxng/pull/2923
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser
3388441917
[fix] ddg-lite vqd value: some search terms do not have a vqd value
...
Some search terms do not have results and therefore no vqd value
BTW: remove a leftover from 9197efa
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser
9197efa2a7
[fix] duckduckgo lite engine: set HTTP header 'Referer'
...
We have had problems with this before, the bot protection from ddg-lite seems to
have included this referer in the rating [1][2].
From reverse engineering:
- The Referer ``https://google.com/ `` was set in commt 257dc7d6c4
--> DDG lite
does not like this referer anymore!
- The 'Referer' header is only set on second and follow up pages but not on the
first page
- The vqd value is not needed on the first page, the ddg-lite client sets this
value only on follow up pages / this can help to reduce the vqd requests from
SearXNG.
Related to 'Referer' header & ddg requests:
[1] https://github.com/searxng/searxng/pull/2161
[2] https://github.com/searxng/searxng/pull/2081
Closes: https://github.com/searxng/searxng/issues/2796
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Bnyro
fa5b2a7948
[mod] yacy: use official instance by default and fix crashes
1 year ago
Alex Balgavy
5d53aac20f
[mod] add hotkeys option to settings.yml
...
The change in the hotkey mechanism introduced in 317db5b04
does not allow
configuration via `settings.yml`. This commit adds that functionality.
Closes : #2898
1 year ago
Hackurei
ff78b1a902
[feat] implement hackernews engine - news.ycombinator.com
1 year ago
Aine
213cb74378
[fix] matrixrooms add proper MRS integration
...
Related:
- https://github.com/searxng/searxng/issues/2918
1 year ago
Bnyro
48cb58bd2e
[feat] duckduckgo: support for videos and news
1 year ago
Bnyro
c3ab49cd90
[fix] kickass: crash when no results
1 year ago
Bnyro
f22daf8b47
[mod] piped: always show video length if available
1 year ago
Bnyro
ce270961e8
[feat] engine: implementation of mastodon
1 year ago
searxng-bot
48f8ac48d1
[translations] update from Weblate
...
68d743281
- 2023-10-05 - return42 <markus.heiser@darmarit.de>
42f091b7f
- 2023-10-05 - return42 <markus.heiser@darmarit.de>
2479c0d7b
- 2023-10-05 - ghose <correo@xmgz.eu>
a4e6cd592
- 2023-10-05 - return42 <markus.heiser@darmarit.de>
9d4e5f5c3
- 2023-10-05 - return42 <markus.heiser@darmarit.de>
b79d44775
- 2023-10-05 - gallegonovato <fran-carro@hotmail.es>
746291184
- 2023-10-06 - return42 <markus.heiser@darmarit.de>
f24d7e8b1
- 2023-10-05 - return42 <markus.heiser@darmarit.de>
6140911f9
- 2023-10-05 - Fjuro <ifjuro@proton.me>
1 year ago
Markus Heiser
fd1422a670
[mod] engine - simplify region & lang handling, make filters configurable
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Bnyro
3e2ae756f0
[feat] engine: implementation of radio-browser.info
1 year ago
Markus Heiser
d56b31d674
[fix] limiter / botdetection: remove http_connection method
...
Related:
- https://github.com/searxng/searxng/issues/2892#issuecomment-1742153932
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Jinyuan Huang
e509cb7c45
[typo] solved a typo in yahoo error message.
1 year ago
Jinyuan Huang
d4d9f2073e
[fix] Bug: Yahoo results for simplified Chinese search sometimes have the first character cut off #2866
...
Co-authored-by: Blair Noctis <n@sail.ng>
1 year ago
Bnyro
fe9386b58d
[fix] emojipedia: fix engine
1 year ago
Markus Heiser
32a4ea350e
[fix] Revision of the Bing engines
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
jazzzooo
079636c079
[fix] engine - bing fix search, pagination, remove safesearch
1 year ago
Bnyro
5ce1792432
[feat] engine: implementation of pinterest
1 year ago
Bnyro
6096457e4d
[fix] matrixrooms.info: pagination not working properly
1 year ago
Markus Heiser
e1a8b8189f
[fix] engine - moviepilot instead of thumbnail use img_src
...
Instead of thumbnail use img_src in the result item, otherwise the "movies"
categories looks clunky.
Related:
- b4e0d2eedc (r128785388)
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Bnyro
159629c588
[mod] tagesschau: add option to only use tagesschau urls
1 year ago
Bnyro
2ca60a19fc
[feat] engine: implementation of matrixrooms.info
1 year ago
Bnyro
d1a3fc5be6
[feat] engine: implementation of tootfinder
1 year ago
Bnyro
fc4a20f734
[mod] add movies category for tmdb, imdb and moviepilot
1 year ago
Émilien (perso)
0330648b98
[mod] warn to info for failed ping limiter
1 year ago
Bnyro
26fed56d51
[mod] settings.yml: remove plugin settings for plugins that don't exist anymore
1 year ago
searxng-bot
9a065832e0
[translations] update from Weblate
...
80bbf74ef
- 2023-09-27 - return42 <markus.heiser@darmarit.de>
5d554ef71
- 2023-09-27 - BernieHuang2008 <berniehuang2008@163.com>
771fd1b90
- 2023-09-27 - return42 <markus.heiser@darmarit.de>
d412012c8
- 2023-09-27 - y0nei <y0nei@proton.me>
1ac171d0a
- 2023-09-27 - return42 <markus.heiser@darmarit.de>
a004c40cc
- 2023-09-27 - return42 <markus.heiser@darmarit.de>
47e729f89
- 2023-09-27 - return42 <markus.heiser@darmarit.de>
f85b28cc4
- 2023-09-26 - Fjuro <ifjuro@proton.me>
75ce5d581
- 2023-09-27 - return42 <markus.heiser@darmarit.de>
40ce06009
- 2023-09-24 - nonepork <ptohrek@gmail.com>
21f343f71
- 2023-09-25 - tentsbet <remendne@pentrens.jp>
4c80f80fd
- 2023-09-22 - return42 <markus.heiser@darmarit.de>
ef3c859e4
- 2023-09-22 - artnay <jiri.gronroos@iki.fi>
1 year ago
dalf
ae2762eb78
Update searx.data - update_firefox_version.py
1 year ago
dalf
18da3d65c5
Update searx.data - update_ahmia_blacklist.py
1 year ago
dalf
4a66fa3e7d
Update searx.data - update_wikidata_units.py
1 year ago
dalf
9be6e20256
Update searx.data - update_engine_traits.py
1 year ago
dalf
d821ec44dd
Update searx.data - update_currencies.py
1 year ago
dalf
cdee5aa3b9
Update searx.data - update_engine_descriptions.py
1 year ago
Bnyro
75587d03a6
[fix] categories.html: can't select social media category using search on category select
1 year ago
jazzzooo
e37d775fa2
[fix] engine - currency fix and simplify
1 year ago
Jinyuan Huang
ae28d429c9
[fix] bilibili new api used
1 year ago
jazzzooo
1a66d74673
[fix] engine - kickass update url, fix parsing, use multiple mirrors
1 year ago
Markus Heiser
0c39064d60
Update searx.data - update_engine_traits.py
...
Update searx.data - update_engine_traits.py
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser
b428ccc5a0
[fix] engine brave - fetch traits (modified settings menu)
...
Brave has changed it settings menu fundamental. Region codes are no longer in
the HTML page, we have to read the regional codes from a JS:
https://cdn.search.brave.com/serp/v2/_app/immutable/chunks/parameters.734c106a.js
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser
3a456b1282
[fix] engine annas archive - fetch traits (modified xpath selectors)
...
Anna’s Archive has cleaned up their languages, available file extensions and
changed the HTML form.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Jinyuan Huang
1f835a9f1f
solve #2839
1 year ago
jazzzooo
3c6549a17f
[fix] update user agent
1 year ago
Emilien Devos
ffec8d1b4c
add warning about enabling public_instance setting
1 year ago
Emilien Devos
47721a3485
add new parameter called server.public_instance
...
for enabling by default advanced limiter functions
in the future allow us to add features just for the public instances
1 year ago
Jinyuan Huang
1df4588279
[build] /static
1 year ago
Jinyuan Huang
98366bcf90
[fix] settings icon invisble on mobile devices
1 year ago
Alexandre Flament
19383921d7
/config: expose limiter configuration
1 year ago
Émilien (perso)
1851f27154
[mod] remove twitter ( #2843 )
1 year ago
Markus Heiser
597c68b4aa
[doc] move dosc of botdetection from developer to admin section
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Bnyro
75c9de02d1
[feat] engine: implementation of imgur
1 year ago
Bnyro
fb72f71f0a
[fix] internet archive scholar: crash when there's no title
1 year ago
searxng-bot
0660d20e1d
[translations] update from Weblate
...
f27a3bbd4
- 2023-09-21 - return42 <markus.heiser@darmarit.de>
a97336d0a
- 2023-09-21 - return42 <markus.heiser@darmarit.de>
91e8946b3
- 2023-09-19 - return42 <markus.heiser@darmarit.de>
19f53731e
- 2023-09-20 - ghose <correo@xmgz.eu>
daf10bd75
- 2023-09-19 - gallegonovato <fran-carro@hotmail.es>
ab004b8b8
- 2023-09-19 - return42 <markus.heiser@darmarit.de>
cdedd99c9
- 2023-09-19 - return42 <markus.heiser@darmarit.de>
1 year ago
Bnyro
95885e7f9f
[build] /static
1 year ago
Bnyro
8b0b6731fc
[fix] search.less: start page search view on mobile devices
1 year ago
Markus Heiser
71358e9c67
Revert "[fix] engine - duckduckgo vqd edge-case"
...
This reverts commit 102502a4f0
.
1 year ago
Bnyro
51236ae47a
[feat] engine: implementation of chefkoch.de
1 year ago
jazzzooo
8bcca0e620
[fix] engine - brave don't show ads
1 year ago
jazzzooo
b729542a66
[fix] engine - google images error when no results
1 year ago
Bnyro
f0df53673e
[mod] search-syntax.md: add tutorial about the feeling lucky feature
1 year ago
Bnyro
cc2e0537a3
[feat] engine: implementation of google icons/material design icons
1 year ago
Bnyro
c999cfb422
[feat] engine: implementation of wallhaven
1 year ago
jazzzooo
102502a4f0
[fix] engine - duckduckgo vqd edge-case
1 year ago
Markus Heiser
d013f51a25
[fix] Search on category select without JavaScript PR #2740
...
Small addendum to #2740 ; search_on_category_select is now no longer a plugin.
Related: https://github.com/searxng/searxng/pull/2740#issuecomment-1725437584
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser
0ce10046c4
[build] /static
1 year ago
ormai
a76c8e4101
Improve the layout of the search page on mobile
1 year ago
Émilien (perso)
33496e7f51
Switch back to qwant web normal API
1 year ago
Markus Heiser
043dcbf7c5
[fix] engine qwant (web-lite) - ignore advertising adds
...
Closes: https://github.com/searxng/searxng/issues/2812
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser
3ac7c40b6a
[build] /static
1 year ago
Emilien Devos
33e722f83b
better error message when no results found
1 year ago
Émilien (perso)
ad725ce7d7
wikipedia wikidata infobox + disable wikisource ( #2806 )
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Bnyro
dcee823345
[feat] implement feeling lucky feature
1 year ago
Markus Heiser
71508abcbf
[build] /static
1 year ago
Jinyuan Huang
2ec77ef813
[mod] reformatted keyBindingLayouts in JS client (default, vim)
1 year ago
Markus Heiser
317db5b04f
[mod] preferences: implement drop-down menu for hotkeys (default, vim)
...
Replace the on/off checkbox of the vim-hotkeys in the preferences by a drop-down
menu.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser
09935e2897
[build] /static
1 year ago
Bnyro
a55e0ac553
[feat] search on category select without JS
...
Co-authored-by: Alexandre Flament <alex@al-f.net>
1 year ago
Bnyro
efd3a2d6d1
[feat] engine: implementation of internet archive scholar
1 year ago
jazzzooo
223b3487c3
[fix] spelling
1 year ago
Markus Heiser
a9b6963971
[fix] engine - qwant delivers only 5 pages maximum
...
all qwant engines (incl qwant-lite) delivers only 5 pages maximum
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
jazzzooo
da1446c5ed
[fix] engine - qwant wrong error type
1 year ago
Markus Heiser
7398d525c8
[fix] qwant: subsequent fix of commit d9dbcedeb
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser
d9dbcedeb6
[feat] implementation of qwant lite for web search
...
Related: https://github.com/searxng/searxng/issues/2719
Replace: https://github.com/searxng/searxng/pull/2748
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Bnyro
b4e0d2eedc
[feat] engine: implemenation of moviepilot (de)
1 year ago
jazzzooo
7dfcc3386e
[fix] tagesschau videos
1 year ago
Markus Heiser
89fbac5763
[build] /static
1 year ago
Jinyuan Huang
92d0c378e0
[fix] keyboard navigation / simple theme (UI)
...
- avoid loop select
- fix select next item in mixed result lists
Replaces: https://github.com/searxng/searxng/pull/2789
Closes: https://github.com/searxng/searxng/issues/2751
Closes: https://github.com/searxng/searxng/issues/2788
1 year ago
jazzzooo
ec540a967a
[fix] brave.videos
1 year ago
jazzzooo
27477f51fd
[fix] brave.news
1 year ago
Bnyro
140125e641
[feat] implementation of the movie database
1 year ago
searxng-bot
4eebb25882
[translations] update from Weblate
...
4f055ccb8
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
9edaacb09
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
ccb3e8934
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
206640415
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
d8db608c2
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
6db95be68
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
0792cd970
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
949ad5db8
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
0921f948e
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
3677f0ccb
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
2dea9cd3a
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
5038588e8
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
6b63e980b
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
858a8660b
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
5852633d2
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
92d25097b
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
8ae9d7a20
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
989ccd21a
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
1c309f3fc
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
3ee5e679e
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
7420db0cf
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
7327ffb1f
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
542814e22
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
5f2623600
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
7bea3da45
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
68a854d93
- 2023-09-11 - ghose <correo@xmgz.eu>
1781efe60
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
016a60442
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
00f143119
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
8e61bb7ac
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
d04327a41
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
841227415
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
9ed21b385
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
914b774da
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
ff7b45ec8
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
4146f8707
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
383602051
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
b050d9ee4
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
8d6e7a20c
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
ee77e2072
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
0420f44b6
- 2023-09-11 - return42 <markus.heiser@darmarit.de>
1 year ago
Justas Zabulionis
41ef73ca3a
[fix] rumble redirect
1 year ago
Justas Zabulionis
b701ee257b
[fix] habrahabr
1 year ago
Justas Zabulionis
be888810ba
[fix] pubmed content being None
1 year ago
Justas Zabulionis
cf734e6008
[fix] engine - pub.dev
1 year ago
Justas Zabulionis
92d39de410
[fix] solidtorrents redirects
1 year ago
Justas Zabulionis
cf8a6cf6db
[fix] solidtorrents pagination
1 year ago
Justas Zabulionis
8172f89075
[fix] solidtorrents
1 year ago