Commit Graph

4823 Commits (f6d797ef430b18eb88f9db9ad5ab675f6f849c2c)

Author SHA1 Message Date
dalf 92efb941d8 Update searx.data - update_firefox_version.py 12 months ago
dalf fa494b9be3 Update searx.data - update_currencies.py 12 months ago
dalf 1b92ea4e70 Update searx.data - update_engine_descriptions.py 12 months ago
dalf 55e7cb3e33 Update searx.data - update_ahmia_blacklist.py 12 months ago
searxng-bot 6af8644ead [translations] update from Weblate
4e5e5db44 - 2023-10-26 - quenty_occitania <quentinantonin@free.fr>
e1a8d3508 - 2023-10-26 - quenty_occitania <quentinantonin@free.fr>
84bddfb89 - 2023-10-26 - return42 <markus.heiser@darmarit.de>
d67a4114d - 2023-10-26 - quenty_occitania <quentinantonin@free.fr>
62fe8e328 - 2023-10-26 - return42 <markus.heiser@darmarit.de>
6e37ab975 - 2023-10-26 - quenty_occitania <quentinantonin@free.fr>
2cdab3247 - 2023-10-25 - SomeTr <SomeTr@users.noreply.translate.codeberg.org>
cf7ea7234 - 2023-10-23 - clsty <celestial.y@outlook.com>
0ea313893 - 2023-10-23 - return42 <markus.heiser@darmarit.de>
22151e440 - 2023-10-23 - return42 <markus.heiser@darmarit.de>
e4eaf42b6 - 2023-10-22 - clsty <celestial.y@outlook.com>
12 months ago
Markus Heiser ef56e1d684 [fix] HTMLParser: undocumented not implemented method
In python versions <py3.10 there is an issue with an undocumented method
HTMLParser.error() [1][2] that was deprecated in Python 3.4 and removed
in Python 3.5.

To be compatible to higher versions (>=py3.10) an error method is implemented
which throws an AssertionError exception like the higher Python versions do [3].

[1] https://github.com/python/cpython/issues/76025
[2] https://bugs.python.org/issue31844
[3] https://github.com/python/cpython/pull/8562

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
searxng-bot 01b5b9cb8e [translations] update from Weblate
2325f1583 - 2023-10-20 - return42 <markus.heiser@darmarit.de>
5090c6a8e - 2023-10-18 - return42 <markus.heiser@darmarit.de>
3a38219d8 - 2023-10-18 - return42 <markus.heiser@darmarit.de>
94a9f4164 - 2023-10-16 - return42 <markus.heiser@darmarit.de>
bdbeb4b30 - 2023-10-16 - return42 <markus.heiser@darmarit.de>
f9b483f48 - 2023-10-16 - return42 <markus.heiser@darmarit.de>
7f1ca1997 - 2023-10-16 - return42 <markus.heiser@darmarit.de>
c5a701dc4 - 2023-10-14 - alexgabi <alexgabi@disroot.org>
1 year ago
Markus Heiser b013cbb4cc [build] /static 1 year ago
Bnyro df2e41c150 [fix] search.js: crash on homepage when setting form listeners 1 year ago
Émilien (perso) 4280318fc5 fixing results parsing brave 1 year ago
searxng-bot ac82daf58d [translations] update from Weblate
74e401e68 - 2023-10-09 - return42 <markus.heiser@darmarit.de>
897dd8db1 - 2023-10-09 - return42 <markus.heiser@darmarit.de>
6ed046a90 - 2023-10-09 - tentsbet <remendne@pentrens.jp>
815ecb336 - 2023-10-09 - return42 <markus.heiser@darmarit.de>
65d9a0c2f - 2023-10-07 - return42 <markus.heiser@darmarit.de>
3ec249ef9 - 2023-10-07 - return42 <markus.heiser@darmarit.de>
53dc6c108 - 2023-10-07 - return42 <markus.heiser@darmarit.de>
1 year ago
Hackurei efada7cba2 [fix] hackernews keyerror problem 1 year ago
Hackurei af071121de [fix] imgur - incorrect wikidata id 1 year ago
Markus Heiser 14323d683f [fix] ddg-lite & ddg-extra: don't send empty vqd value
DDG's bot detection is sensitive to the vqd value.  For some search terms (such
as extremely long search terms that are often sent by bots), no vqd value can be
determined.

If SearXNG cannot determine a vqd value, then no request should go out to
DDG (WEB): a request with a wrong vqd value leads to DDG temporarily putting
SearXNG's IP on a block list.

Requests from IPs in this block list run into timeouts.

Not sure, but it seems the block list is a sliding window: to get my IP rid from
the bot list I had to cool down my IP for 1h (send no requests from that IP to
DDG).

Since such issues can't reproduce in a local instance I tested this patch 24h on
my public SearXNG instance: There are still errors (rare), but the reliability
is still 100%.

Related:

- https://github.com/searxng/searxng/pull/2922
- https://github.com/searxng/searxng/pull/2923

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser 3388441917 [fix] ddg-lite vqd value: some search terms do not have a vqd value
Some search terms do not have results and therefore no vqd value

BTW: remove a leftover from 9197efa

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser 9197efa2a7 [fix] duckduckgo lite engine: set HTTP header 'Referer'
We have had problems with this before, the bot protection from ddg-lite seems to
have included this referer in the rating [1][2].

From reverse engineering:

- The Referer ``https://google.com/`` was set in commt 257dc7d6c4 --> DDG lite
  does not like this referer anymore!

- The 'Referer' header is only set on second and follow up pages but not on the
  first page

- The vqd value is not needed on the first page, the ddg-lite client sets this
  value only on follow up pages / this can help to reduce the vqd requests from
  SearXNG.

Related to 'Referer' header & ddg requests:

[1] https://github.com/searxng/searxng/pull/2161
[2] https://github.com/searxng/searxng/pull/2081

Closes: https://github.com/searxng/searxng/issues/2796
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Bnyro fa5b2a7948 [mod] yacy: use official instance by default and fix crashes 1 year ago
Alex Balgavy 5d53aac20f [mod] add hotkeys option to settings.yml
The change in the hotkey mechanism introduced in 317db5b04 does not allow
configuration via `settings.yml`.  This commit adds that functionality.

Closes: #2898
1 year ago
Hackurei ff78b1a902 [feat] implement hackernews engine - news.ycombinator.com 1 year ago
Aine 213cb74378 [fix] matrixrooms add proper MRS integration
Related:

- https://github.com/searxng/searxng/issues/2918
1 year ago
Bnyro 48cb58bd2e [feat] duckduckgo: support for videos and news 1 year ago
Bnyro c3ab49cd90 [fix] kickass: crash when no results 1 year ago
Bnyro f22daf8b47 [mod] piped: always show video length if available 1 year ago
Bnyro ce270961e8 [feat] engine: implementation of mastodon 1 year ago
searxng-bot 48f8ac48d1 [translations] update from Weblate
68d743281 - 2023-10-05 - return42 <markus.heiser@darmarit.de>
42f091b7f - 2023-10-05 - return42 <markus.heiser@darmarit.de>
2479c0d7b - 2023-10-05 - ghose <correo@xmgz.eu>
a4e6cd592 - 2023-10-05 - return42 <markus.heiser@darmarit.de>
9d4e5f5c3 - 2023-10-05 - return42 <markus.heiser@darmarit.de>
b79d44775 - 2023-10-05 - gallegonovato <fran-carro@hotmail.es>
746291184 - 2023-10-06 - return42 <markus.heiser@darmarit.de>
f24d7e8b1 - 2023-10-05 - return42 <markus.heiser@darmarit.de>
6140911f9 - 2023-10-05 - Fjuro <ifjuro@proton.me>
1 year ago
Markus Heiser fd1422a670 [mod] engine - simplify region & lang handling, make filters configurable
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Bnyro 3e2ae756f0 [feat] engine: implementation of radio-browser.info 1 year ago
Markus Heiser d56b31d674 [fix] limiter / botdetection: remove http_connection method
Related:

- https://github.com/searxng/searxng/issues/2892#issuecomment-1742153932

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Jinyuan Huang e509cb7c45 [typo] solved a typo in yahoo error message. 1 year ago
Jinyuan Huang d4d9f2073e [fix] Bug: Yahoo results for simplified Chinese search sometimes have the first character cut off #2866
Co-authored-by: Blair Noctis <n@sail.ng>
1 year ago
Bnyro fe9386b58d [fix] emojipedia: fix engine 1 year ago
Markus Heiser 32a4ea350e [fix] Revision of the Bing engines
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
jazzzooo 079636c079 [fix] engine - bing fix search, pagination, remove safesearch 1 year ago
Bnyro 5ce1792432 [feat] engine: implementation of pinterest 1 year ago
Bnyro 6096457e4d [fix] matrixrooms.info: pagination not working properly 1 year ago
Markus Heiser e1a8b8189f [fix] engine - moviepilot instead of thumbnail use img_src
Instead of thumbnail use img_src in the result item, otherwise the "movies"
categories looks clunky.

Related:

- b4e0d2eedc (r128785388)

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Bnyro 159629c588 [mod] tagesschau: add option to only use tagesschau urls 1 year ago
Bnyro 2ca60a19fc [feat] engine: implementation of matrixrooms.info 1 year ago
Bnyro d1a3fc5be6 [feat] engine: implementation of tootfinder 1 year ago
Bnyro fc4a20f734 [mod] add movies category for tmdb, imdb and moviepilot 1 year ago
Émilien (perso) 0330648b98 [mod] warn to info for failed ping limiter 1 year ago
Bnyro 26fed56d51 [mod] settings.yml: remove plugin settings for plugins that don't exist anymore 1 year ago
searxng-bot 9a065832e0 [translations] update from Weblate
80bbf74ef - 2023-09-27 - return42 <markus.heiser@darmarit.de>
5d554ef71 - 2023-09-27 - BernieHuang2008 <berniehuang2008@163.com>
771fd1b90 - 2023-09-27 - return42 <markus.heiser@darmarit.de>
d412012c8 - 2023-09-27 - y0nei <y0nei@proton.me>
1ac171d0a - 2023-09-27 - return42 <markus.heiser@darmarit.de>
a004c40cc - 2023-09-27 - return42 <markus.heiser@darmarit.de>
47e729f89 - 2023-09-27 - return42 <markus.heiser@darmarit.de>
f85b28cc4 - 2023-09-26 - Fjuro <ifjuro@proton.me>
75ce5d581 - 2023-09-27 - return42 <markus.heiser@darmarit.de>
40ce06009 - 2023-09-24 - nonepork <ptohrek@gmail.com>
21f343f71 - 2023-09-25 - tentsbet <remendne@pentrens.jp>
4c80f80fd - 2023-09-22 - return42 <markus.heiser@darmarit.de>
ef3c859e4 - 2023-09-22 - artnay <jiri.gronroos@iki.fi>
1 year ago
dalf ae2762eb78 Update searx.data - update_firefox_version.py 1 year ago
dalf 18da3d65c5 Update searx.data - update_ahmia_blacklist.py 1 year ago
dalf 4a66fa3e7d Update searx.data - update_wikidata_units.py 1 year ago
dalf 9be6e20256 Update searx.data - update_engine_traits.py 1 year ago
dalf d821ec44dd Update searx.data - update_currencies.py 1 year ago
dalf cdee5aa3b9 Update searx.data - update_engine_descriptions.py 1 year ago
Bnyro 75587d03a6 [fix] categories.html: can't select social media category using search on category select 1 year ago
jazzzooo e37d775fa2 [fix] engine - currency fix and simplify 1 year ago
Jinyuan Huang ae28d429c9 [fix] bilibili new api used 1 year ago
jazzzooo 1a66d74673 [fix] engine - kickass update url, fix parsing, use multiple mirrors 1 year ago
Markus Heiser 0c39064d60 Update searx.data - update_engine_traits.py
Update searx.data - update_engine_traits.py

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser b428ccc5a0 [fix] engine brave - fetch traits (modified settings menu)
Brave has changed it settings menu fundamental.  Region codes are no longer in
the HTML page, we have to read the regional codes from a JS:

  https://cdn.search.brave.com/serp/v2/_app/immutable/chunks/parameters.734c106a.js

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser 3a456b1282 [fix] engine annas archive - fetch traits (modified xpath selectors)
Anna’s Archive has cleaned up their languages, available file extensions and
changed the HTML form.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Jinyuan Huang 1f835a9f1f solve #2839 1 year ago
jazzzooo 3c6549a17f [fix] update user agent 1 year ago
Emilien Devos ffec8d1b4c add warning about enabling public_instance setting 1 year ago
Emilien Devos 47721a3485 add new parameter called server.public_instance
for enabling by default advanced limiter functions
in the future allow us to add features just for the public instances
1 year ago
Jinyuan Huang 1df4588279 [build] /static 1 year ago
Jinyuan Huang 98366bcf90 [fix] settings icon invisble on mobile devices 1 year ago
Alexandre Flament 19383921d7 /config: expose limiter configuration 1 year ago
Émilien (perso) 1851f27154
[mod] remove twitter (#2843) 1 year ago
Markus Heiser 597c68b4aa [doc] move dosc of botdetection from developer to admin section
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Bnyro 75c9de02d1 [feat] engine: implementation of imgur 1 year ago
Bnyro fb72f71f0a [fix] internet archive scholar: crash when there's no title 1 year ago
searxng-bot 0660d20e1d [translations] update from Weblate
f27a3bbd4 - 2023-09-21 - return42 <markus.heiser@darmarit.de>
a97336d0a - 2023-09-21 - return42 <markus.heiser@darmarit.de>
91e8946b3 - 2023-09-19 - return42 <markus.heiser@darmarit.de>
19f53731e - 2023-09-20 - ghose <correo@xmgz.eu>
daf10bd75 - 2023-09-19 - gallegonovato <fran-carro@hotmail.es>
ab004b8b8 - 2023-09-19 - return42 <markus.heiser@darmarit.de>
cdedd99c9 - 2023-09-19 - return42 <markus.heiser@darmarit.de>
1 year ago
Bnyro 95885e7f9f [build] /static 1 year ago
Bnyro 8b0b6731fc [fix] search.less: start page search view on mobile devices 1 year ago
Markus Heiser 71358e9c67 Revert "[fix] engine - duckduckgo vqd edge-case"
This reverts commit 102502a4f0.
1 year ago
Bnyro 51236ae47a [feat] engine: implementation of chefkoch.de 1 year ago
jazzzooo 8bcca0e620 [fix] engine - brave don't show ads 1 year ago
jazzzooo b729542a66 [fix] engine - google images error when no results 1 year ago
Bnyro f0df53673e [mod] search-syntax.md: add tutorial about the feeling lucky feature 1 year ago
Bnyro cc2e0537a3 [feat] engine: implementation of google icons/material design icons 1 year ago
Bnyro c999cfb422 [feat] engine: implementation of wallhaven 1 year ago
jazzzooo 102502a4f0 [fix] engine - duckduckgo vqd edge-case 1 year ago
Markus Heiser d013f51a25 [fix] Search on category select without JavaScript PR #2740
Small addendum to #2740; search_on_category_select is now no longer a plugin.

Related: https://github.com/searxng/searxng/pull/2740#issuecomment-1725437584
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser 0ce10046c4 [build] /static 1 year ago
ormai a76c8e4101 Improve the layout of the search page on mobile 1 year ago
Émilien (perso) 33496e7f51 Switch back to qwant web normal API 1 year ago
Markus Heiser 043dcbf7c5 [fix] engine qwant (web-lite) - ignore advertising adds
Closes: https://github.com/searxng/searxng/issues/2812
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser 3ac7c40b6a [build] /static 1 year ago
Emilien Devos 33e722f83b better error message when no results found 1 year ago
Émilien (perso) ad725ce7d7
wikipedia wikidata infobox + disable wikisource (#2806)
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Bnyro dcee823345 [feat] implement feeling lucky feature 1 year ago
Markus Heiser 71508abcbf [build] /static 1 year ago
Jinyuan Huang 2ec77ef813 [mod] reformatted keyBindingLayouts in JS client (default, vim) 1 year ago
Markus Heiser 317db5b04f [mod] preferences: implement drop-down menu for hotkeys (default, vim)
Replace the on/off checkbox of the vim-hotkeys in the preferences by a drop-down
menu.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser 09935e2897 [build] /static 1 year ago
Bnyro a55e0ac553 [feat] search on category select without JS
Co-authored-by: Alexandre Flament <alex@al-f.net>
1 year ago
Bnyro efd3a2d6d1 [feat] engine: implementation of internet archive scholar 1 year ago
jazzzooo 223b3487c3 [fix] spelling 1 year ago
Markus Heiser a9b6963971 [fix] engine - qwant delivers only 5 pages maximum
all qwant engines (incl qwant-lite) delivers only 5 pages maximum

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
jazzzooo da1446c5ed [fix] engine - qwant wrong error type 1 year ago
Markus Heiser 7398d525c8 [fix] qwant: subsequent fix of commit d9dbcedeb
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser d9dbcedeb6 [feat] implementation of qwant lite for web search
Related: https://github.com/searxng/searxng/issues/2719
Replace: https://github.com/searxng/searxng/pull/2748
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Bnyro b4e0d2eedc [feat] engine: implemenation of moviepilot (de) 1 year ago
jazzzooo 7dfcc3386e [fix] tagesschau videos 1 year ago