searxng-bot
01b5b9cb8e
[translations] update from Weblate
...
2325f1583
- 2023-10-20 - return42 <markus.heiser@darmarit.de>
5090c6a8e
- 2023-10-18 - return42 <markus.heiser@darmarit.de>
3a38219d8
- 2023-10-18 - return42 <markus.heiser@darmarit.de>
94a9f4164
- 2023-10-16 - return42 <markus.heiser@darmarit.de>
bdbeb4b30
- 2023-10-16 - return42 <markus.heiser@darmarit.de>
f9b483f48
- 2023-10-16 - return42 <markus.heiser@darmarit.de>
7f1ca1997
- 2023-10-16 - return42 <markus.heiser@darmarit.de>
c5a701dc4
- 2023-10-14 - alexgabi <alexgabi@disroot.org>
11 months ago
Markus Heiser
b013cbb4cc
[build] /static
11 months ago
Bnyro
df2e41c150
[fix] search.js: crash on homepage when setting form listeners
11 months ago
Émilien (perso)
4280318fc5
fixing results parsing brave
11 months ago
searxng-bot
ac82daf58d
[translations] update from Weblate
...
74e401e68
- 2023-10-09 - return42 <markus.heiser@darmarit.de>
897dd8db1
- 2023-10-09 - return42 <markus.heiser@darmarit.de>
6ed046a90
- 2023-10-09 - tentsbet <remendne@pentrens.jp>
815ecb336
- 2023-10-09 - return42 <markus.heiser@darmarit.de>
65d9a0c2f
- 2023-10-07 - return42 <markus.heiser@darmarit.de>
3ec249ef9
- 2023-10-07 - return42 <markus.heiser@darmarit.de>
53dc6c108
- 2023-10-07 - return42 <markus.heiser@darmarit.de>
11 months ago
Hackurei
efada7cba2
[fix] hackernews keyerror problem
11 months ago
Hackurei
af071121de
[fix] imgur - incorrect wikidata id
11 months ago
Markus Heiser
14323d683f
[fix] ddg-lite & ddg-extra: don't send empty vqd value
...
DDG's bot detection is sensitive to the vqd value. For some search terms (such
as extremely long search terms that are often sent by bots), no vqd value can be
determined.
If SearXNG cannot determine a vqd value, then no request should go out to
DDG (WEB): a request with a wrong vqd value leads to DDG temporarily putting
SearXNG's IP on a block list.
Requests from IPs in this block list run into timeouts.
Not sure, but it seems the block list is a sliding window: to get my IP rid from
the bot list I had to cool down my IP for 1h (send no requests from that IP to
DDG).
Since such issues can't reproduce in a local instance I tested this patch 24h on
my public SearXNG instance: There are still errors (rare), but the reliability
is still 100%.
Related:
- https://github.com/searxng/searxng/pull/2922
- https://github.com/searxng/searxng/pull/2923
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
11 months ago
Markus Heiser
3388441917
[fix] ddg-lite vqd value: some search terms do not have a vqd value
...
Some search terms do not have results and therefore no vqd value
BTW: remove a leftover from 9197efa
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
11 months ago
Markus Heiser
9197efa2a7
[fix] duckduckgo lite engine: set HTTP header 'Referer'
...
We have had problems with this before, the bot protection from ddg-lite seems to
have included this referer in the rating [1][2].
From reverse engineering:
- The Referer ``https://google.com/ `` was set in commt 257dc7d6c4
--> DDG lite
does not like this referer anymore!
- The 'Referer' header is only set on second and follow up pages but not on the
first page
- The vqd value is not needed on the first page, the ddg-lite client sets this
value only on follow up pages / this can help to reduce the vqd requests from
SearXNG.
Related to 'Referer' header & ddg requests:
[1] https://github.com/searxng/searxng/pull/2161
[2] https://github.com/searxng/searxng/pull/2081
Closes: https://github.com/searxng/searxng/issues/2796
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
11 months ago
Bnyro
fa5b2a7948
[mod] yacy: use official instance by default and fix crashes
11 months ago
Alex Balgavy
5d53aac20f
[mod] add hotkeys option to settings.yml
...
The change in the hotkey mechanism introduced in 317db5b04
does not allow
configuration via `settings.yml`. This commit adds that functionality.
Closes : #2898
11 months ago
Hackurei
ff78b1a902
[feat] implement hackernews engine - news.ycombinator.com
11 months ago
Aine
213cb74378
[fix] matrixrooms add proper MRS integration
...
Related:
- https://github.com/searxng/searxng/issues/2918
11 months ago
Bnyro
48cb58bd2e
[feat] duckduckgo: support for videos and news
11 months ago
Bnyro
c3ab49cd90
[fix] kickass: crash when no results
11 months ago
Bnyro
f22daf8b47
[mod] piped: always show video length if available
11 months ago
Bnyro
ce270961e8
[feat] engine: implementation of mastodon
11 months ago
searxng-bot
48f8ac48d1
[translations] update from Weblate
...
68d743281
- 2023-10-05 - return42 <markus.heiser@darmarit.de>
42f091b7f
- 2023-10-05 - return42 <markus.heiser@darmarit.de>
2479c0d7b
- 2023-10-05 - ghose <correo@xmgz.eu>
a4e6cd592
- 2023-10-05 - return42 <markus.heiser@darmarit.de>
9d4e5f5c3
- 2023-10-05 - return42 <markus.heiser@darmarit.de>
b79d44775
- 2023-10-05 - gallegonovato <fran-carro@hotmail.es>
746291184
- 2023-10-06 - return42 <markus.heiser@darmarit.de>
f24d7e8b1
- 2023-10-05 - return42 <markus.heiser@darmarit.de>
6140911f9
- 2023-10-05 - Fjuro <ifjuro@proton.me>
11 months ago
Markus Heiser
fd1422a670
[mod] engine - simplify region & lang handling, make filters configurable
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
11 months ago
Bnyro
3e2ae756f0
[feat] engine: implementation of radio-browser.info
11 months ago
Markus Heiser
d56b31d674
[fix] limiter / botdetection: remove http_connection method
...
Related:
- https://github.com/searxng/searxng/issues/2892#issuecomment-1742153932
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
11 months ago
Jinyuan Huang
e509cb7c45
[typo] solved a typo in yahoo error message.
11 months ago
Jinyuan Huang
d4d9f2073e
[fix] Bug: Yahoo results for simplified Chinese search sometimes have the first character cut off #2866
...
Co-authored-by: Blair Noctis <n@sail.ng>
11 months ago
Bnyro
fe9386b58d
[fix] emojipedia: fix engine
11 months ago
Markus Heiser
32a4ea350e
[fix] Revision of the Bing engines
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
11 months ago
jazzzooo
079636c079
[fix] engine - bing fix search, pagination, remove safesearch
11 months ago
Bnyro
5ce1792432
[feat] engine: implementation of pinterest
12 months ago
Bnyro
6096457e4d
[fix] matrixrooms.info: pagination not working properly
12 months ago
Markus Heiser
e1a8b8189f
[fix] engine - moviepilot instead of thumbnail use img_src
...
Instead of thumbnail use img_src in the result item, otherwise the "movies"
categories looks clunky.
Related:
- b4e0d2eedc (r128785388)
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
12 months ago
Bnyro
159629c588
[mod] tagesschau: add option to only use tagesschau urls
12 months ago
Bnyro
2ca60a19fc
[feat] engine: implementation of matrixrooms.info
12 months ago
Bnyro
d1a3fc5be6
[feat] engine: implementation of tootfinder
12 months ago
Bnyro
fc4a20f734
[mod] add movies category for tmdb, imdb and moviepilot
12 months ago
Émilien (perso)
0330648b98
[mod] warn to info for failed ping limiter
12 months ago
Bnyro
26fed56d51
[mod] settings.yml: remove plugin settings for plugins that don't exist anymore
12 months ago
searxng-bot
9a065832e0
[translations] update from Weblate
...
80bbf74ef
- 2023-09-27 - return42 <markus.heiser@darmarit.de>
5d554ef71
- 2023-09-27 - BernieHuang2008 <berniehuang2008@163.com>
771fd1b90
- 2023-09-27 - return42 <markus.heiser@darmarit.de>
d412012c8
- 2023-09-27 - y0nei <y0nei@proton.me>
1ac171d0a
- 2023-09-27 - return42 <markus.heiser@darmarit.de>
a004c40cc
- 2023-09-27 - return42 <markus.heiser@darmarit.de>
47e729f89
- 2023-09-27 - return42 <markus.heiser@darmarit.de>
f85b28cc4
- 2023-09-26 - Fjuro <ifjuro@proton.me>
75ce5d581
- 2023-09-27 - return42 <markus.heiser@darmarit.de>
40ce06009
- 2023-09-24 - nonepork <ptohrek@gmail.com>
21f343f71
- 2023-09-25 - tentsbet <remendne@pentrens.jp>
4c80f80fd
- 2023-09-22 - return42 <markus.heiser@darmarit.de>
ef3c859e4
- 2023-09-22 - artnay <jiri.gronroos@iki.fi>
12 months ago
dalf
ae2762eb78
Update searx.data - update_firefox_version.py
12 months ago
dalf
18da3d65c5
Update searx.data - update_ahmia_blacklist.py
12 months ago
dalf
4a66fa3e7d
Update searx.data - update_wikidata_units.py
12 months ago
dalf
9be6e20256
Update searx.data - update_engine_traits.py
12 months ago
dalf
d821ec44dd
Update searx.data - update_currencies.py
12 months ago
dalf
cdee5aa3b9
Update searx.data - update_engine_descriptions.py
12 months ago
Bnyro
75587d03a6
[fix] categories.html: can't select social media category using search on category select
12 months ago
jazzzooo
e37d775fa2
[fix] engine - currency fix and simplify
12 months ago
Jinyuan Huang
ae28d429c9
[fix] bilibili new api used
12 months ago
jazzzooo
1a66d74673
[fix] engine - kickass update url, fix parsing, use multiple mirrors
12 months ago
Markus Heiser
0c39064d60
Update searx.data - update_engine_traits.py
...
Update searx.data - update_engine_traits.py
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
12 months ago
Markus Heiser
b428ccc5a0
[fix] engine brave - fetch traits (modified settings menu)
...
Brave has changed it settings menu fundamental. Region codes are no longer in
the HTML page, we have to read the regional codes from a JS:
https://cdn.search.brave.com/serp/v2/_app/immutable/chunks/parameters.734c106a.js
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
12 months ago
Markus Heiser
3a456b1282
[fix] engine annas archive - fetch traits (modified xpath selectors)
...
Anna’s Archive has cleaned up their languages, available file extensions and
changed the HTML form.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
12 months ago