Bnyro
a3d7e9c285
[mod] utils.py: add markdown_to_text helper function
2023-09-08 11:47:13 +02:00
searxng-bot
c62605b3e3
[translations] update from Weblate
...
304f6af5c76a4b6496
2023-09-08 09:20:19 +02:00
Markus Heiser
019bd97f4b
[fix] settings.yml - fix docs-links in the comments
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-06 11:35:39 +02:00
Hackurei
1f21ac7d62
[feat] engine: implementation of bilibili https://www.bilibili.com
2023-09-05 22:53:03 +02:00
Markus Heiser
696c35d2c3
[fix] engine - duckduckgo_images / determination of vqd value incorrect
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-05 22:24:51 +02:00
bonswouar
4fb26cd96d
[fix] engine duckduckgo weather api changes
2023-09-05 16:55:00 +02:00
Markus Heiser
01be9e0e20
[fix] engine: wikicommons - don't quoute ':|' in URL parameters
...
From [1]: It seems to be because of [2] For some reason it gets url encoded
twice, resulting in
- ``filetype%253Abitmap%257Cdrawing+birds`` instead of
- ``filetype:bitmap%7Cdrawing+birds``
[1] https://github.com/searxng/searxng/issues/2707
[2] https://github.com/searxng/searxng/blob/master/searx/engines/wikicommons.py#L43
Closes : #2707
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-03 18:45:39 +02:00
Markus Heiser
4f8895c6de
[fix] follow-up of 4da7003ae / add missing review from @Bnyro
...
[1] https://github.com/searxng/searxng/pull/2656#pullrequestreview-1607956209
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-02 09:26:45 +02:00
Hackurei
4da7003ae0
[feat] engine: implementation of odysee
2023-09-02 09:14:12 +02:00
Bnyro
9c4e9d3814
[feat] implementation of Wikimedia commons for images
2023-09-01 18:39:24 +02:00
searxng-bot
9fce459c7f
[translations] update from Weblate
...
979909accf40af3403
2023-09-01 09:29:07 +02:00
Jafar Farganlooj
7af66736c0
Create search-syntax.md fa
2023-08-30 16:39:10 +02:00
Jafar Farganlooj
26cd770cf7
[mod] Persian translation of the about page (fa_IR)
2023-08-30 16:13:44 +02:00
Alexandre Flament
faa4280e1a
[mod] bing: resolve redirect without additional requests
...
Remove the usage of searx.network.multi_requests
The results from Bing contains the target URL encoded in base64
See the u parameter, remove the first two character "a1", and done.
Also add a comment the check of the result_len / pageno
( from https://github.com/searx/searx/pull/1387 )
2023-08-29 07:39:06 +02:00
dalf
f57842b05d
Update searx.data - update_firefox_version.py
2023-08-29 07:21:46 +02:00
dalf
a5cd777350
Update searx.data - update_ahmia_blacklist.py
2023-08-29 07:21:21 +02:00
dalf
f361a10af6
Update searx.data - update_currencies.py
2023-08-29 07:20:42 +02:00
dalf
978062bdbe
Update searx.data - update_engine_descriptions.py
2023-08-29 07:20:06 +02:00
dalf
f59fd8dc9b
Update searx.data - update_wikidata_units.py
2023-08-29 07:17:44 +02:00
Markus Heiser
3294e7cfe4
[fix] reduce error logs related to X-Forwarded-For & X-Real-IP headers
...
To test start a `make run` instance and query multiple times for `ip` (the
answerer), you should see only once the error message(s):
ERROR searx.botdetection : X-Forwarded-For header is not set!
ERROR searx.botdetection : X-Real-IP header is not set!
[1] https://github.com/searxng/searxng-docker/discussions/174
[2] https://github.com/searxng/searxng-docker/pull/162#issuecomment-1692834457
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-28 08:05:17 +02:00
Bnyro
1428385d1c
[mod] preferences.py: add and use BooleanSetting for checkbox preferences
2023-08-27 21:23:43 +02:00
Bnyro
e5535ec078
[feat] settings: replace boolean select preferences with checkboxes
2023-08-27 21:23:43 +02:00
Bnyro
5a5cfc1930
[mod] random answerer: add random hex color generator
2023-08-27 18:59:54 +02:00
Markus Heiser
b0d2cd5ca9
[doc] add documentation of Mwmbl engine & autocompleter
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-27 17:25:26 +02:00
Bnyro
df71c24b20
[mod] autocomplete.py: add support for mwmbl completions
2023-08-27 17:25:26 +02:00
Bnyro
19300a5659
[mod] engine mwmbl: add link to official api docs
2023-08-27 17:25:26 +02:00
Alexandre Flament
97b1df1629
[mod] searx.network: memory optimization
...
Avoid to create a SSLContext in AsyncHTTPTransportNoHttp
See:
* 0f61aa58d6/httpx/_transports/default.py (L271)https://github.com/encode/httpx/issues/2298
2023-08-27 11:49:40 +02:00
Alexandre Flament
e16c007c22
[fix] openstreetmap engine
...
It seems there is an API change:
extratags can be either a dictionnary or None.
This commit avoid crash when extratags is None
Test query "!osm gare du nord"
2023-08-27 11:49:16 +02:00
Markus Heiser
0647f83a3e
[fix] google engine: don't overspecify the search query to Google
...
The method EngineTraits.get_region(..) returns engine's region string
that **best fits** to SearXNG's locale. This means it returns a
region (country) if only a language is set in the locale. By example the method
returns for a locale tag `es` a region `ES`.
Google's search parameter `cr` restricts search results to documents originating
in a particular country / in case of a locale tag (language) as described above,
this argument should be unset in the query send to Google.
Closes: https://github.com/searxng/searxng/issues/2672
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-26 07:47:07 +02:00
searxng-bot
7d806d1020
[translations] update from Weblate
...
a6c2d198838bc33a710ff21aa3c
2023-08-25 09:36:49 +02:00
Paul Braeuning
9069da051a
Merge pull request #2644 from dalf/update_httpx
...
Bump httpx 0.21.2 from to 0.24.1
2023-08-24 23:12:06 +02:00
Markus Heiser
4b42644579
[fix] engine google_video: google has changed the layout of the rsponse
...
Closes: https://github.com/searxng/searxng/issues/2664
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-22 08:34:04 +02:00
Alexandre Flament
b4e4cfc026
Bump httpx 0.21.2 from to 0.24.1
2023-08-21 22:05:12 +02:00
Markus Heiser
d52919cc3e
[mod] decrease the weighting of wikivoyage, wikibooks, wikisource and wikiversity
...
The search engines deliver hits for many search terms [1], but these are usually
not the focus of the user. In order to arrange these hits further down in the
list, their weighting is reduced.
[1] https://github.com/searxng/searxng/pull/2589#issuecomment-1670915089
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-21 21:52:40 +02:00
PlayDay
018b0a9322
[feat] engine: XPath configuration for pkg.go.dev
2023-08-19 19:19:31 +02:00
Bnyro
c59ae91b76
[feat] engine: implementation of mwmbl
2023-08-19 18:23:42 +02:00
searxng-bot
bb9e9ab773
[translations] update from Weblate
...
d8e4100b6b8e03f3bc
2023-08-18 19:22:13 +02:00
Markus Heiser
c741fc6f00
[mod] currency_convert: support for showing the answer source url
...
Show URL of the ddg-search page, not the URL of a (generic) Javascript. The
latter one is not usefull for the user.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-18 19:07:14 +02:00
Markus Heiser
e2744520f8
[mod] google: support for showing the answer source url
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-18 19:07:14 +02:00
Bnyro
5ec7df3480
[mod] engine duckduckgo definitions: support for answer source
2023-08-18 19:07:14 +02:00
Bnyro
64bc98b5fb
[mod] brave: support for showing the answer source url
2023-08-18 19:07:14 +02:00
Markus Heiser
6fc2ee514d
[build] /static
2023-08-18 19:07:14 +02:00
Bnyro
13d801b75d
[feat] results: show source of suggested answer
2023-08-18 19:07:14 +02:00
Markus Heiser
9100a48541
[mod] improve seekr engines and add documentation
...
Tis patch adds some more fields to the result items and changed paging to the
``nextResultSet`` given in seekr's JSON response.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-15 16:17:42 +02:00
Bnyro
2bab658d39
[feat] engine: implementation of seekr for news, images and videos
2023-08-15 16:17:42 +02:00
Markus Heiser
7052a1a7cf
[drop] engine archive.is / blocked by CAPTCHA [1]
...
Sadly archive.is is blocked by a CAPTCHA that can't be avoid (at least in a
XPath engine).
[1] https://github.com/searxng/searxng/issues/2643
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-14 08:50:13 +02:00
mrpaulblack
621b09b9b9
[fix] preferences: change engine table category colspan to 8
...
* this is a small fix to increase the colspan of the category in engine preferences from 7 to 8, since there was a column added
=> fixing a small fallout from 4731290317
2023-08-14 07:11:06 +02:00
ToxyFlog1627
f175574f37
[fix] typos in documentation & messages
2023-08-13 08:50:29 +02:00
Markus Heiser
c348427f07
[update] make pygments.less
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-11 10:54:50 +02:00
searxng-bot
99df7b84d1
[translations] update from Weblate
...
12c527bcdea46b66fcae3d8dcdfab6a59e351db1affcc94b682aa007c49bb6c
2023-08-11 09:17:56 +02:00
Bnyro
c76c999a1e
[feat] engine: implementation of anaconda
2023-08-10 23:51:07 +02:00
Bnyro
e25d1c7288
[feat] engine: implementation of German news, Tagesschau
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-10 20:27:54 +02:00
GeckoLinux
2256ba2ffb
[mod] settings.yml: move wolframalpha to categ general & disable by default
...
As suggested in comment [1] as a good compromise between [2] and [3].
This will help users that want Wolfram Alpha instant answers by default with
every query and don't mind the slowness. It will be disabled by default so it's
fast for all users, and those that need it can enable it as a user-configurable
option without requiring setting up their own instance to change the Wolfram
Alpha categorization.
[1] https://github.com/searxng/searxng/pull/813#issuecomment-1574851572
[2] https://github.com/searxng/searxng/pull/813#issuecomment-1020581765
[3] https://github.com/searxng/searxng/issues/966#issue-1171107451
2023-08-10 14:31:09 +02:00
Bnyro
834e1c3f12
[mod] engine lemmy: increase thumbnail quality to align with theme
2023-08-10 12:58:40 +02:00
Markus Heiser
c381fc001f
[mod] settings: remove lemmy from categ 'general' & enable by default
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-10 12:58:40 +02:00
Markus Heiser
fda111c0c9
[mod] engine lemmy: add more info fields to the result items
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-10 12:58:40 +02:00
Bnyro
224f2250ae
[feat] engine: support for lemmy communities, posts, comments and users
2023-08-10 12:58:40 +02:00
Bnyro
9f82c39610
[mod] engine google_play: raise error on unsupported category
2023-08-10 12:35:24 +02:00
Bnyro
0a99dc85b9
[mod] engine brave: raise error on unsupported category
2023-08-10 12:35:24 +02:00
Bnyro
4731290317
[mod] settings: show weight of each instance
2023-08-10 10:50:14 +02:00
Markus Heiser
733b795d53
[fix] make flask_babel.gettext() work in engine modules (L10n & threads)
...
incident:
flask_babel.gettext() does not work in the engine modules.
cause:
the request() and response() functions of the engine modules run in the
processor, whose search() method runs in a thread and in the threads the
context of the Flask app does not exist. The context of the Flask app is
needed by the gettext() function for the L10n.
Solution:
copy context of the Flask app into the threads. [1]
special case:
We cannot equip the search() method of the processors with the decorator [1],
because the decorator requires a context (Flask app) that does not yet exist
at the time of the initialization of the processors (the initialization of the
processors is part of the initialization of the Flask app).
[1] https://flask.palletsprojects.com/en/2.3.x/api/#flask.copy_current_request_context
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-09 13:27:43 +02:00
allendema_searxng_pi
c00c0c5434
[mod] remove discontinued petalsearch engines
2023-08-09 07:17:40 +02:00
Markus Heiser
b8352eca0c
[mod] brave engines: add fetch_traits() / improve language support
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-08 16:21:45 +02:00
Markus Heiser
460bbe5b81
[mod] implement brave (WEB) engine to replace XPath configuration
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-08 16:21:45 +02:00
Bnyro
d151497db3
[feat] engine: brave - support for news
2023-08-08 16:21:45 +02:00
Bnyro
cae06f2781
[feat] engine: brave - support for videos
2023-08-08 16:21:45 +02:00
Bnyro
73364e158e
[feat] engine: brave - support for images
2023-08-08 16:21:45 +02:00
Markus Heiser
bcaaae699f
[doc] fix some minor typos in the doc-strings of class EngineTraits
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-08 08:15:53 +02:00
Markus Heiser
a2108432f7
[fix] settings.yml: typo in engine name wikipecies -> wikispecies
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-07 10:35:44 +02:00
Markus Heiser
1d0abb7157
[doc] engine bt4g: add documentation to docs/dev/engines/online/
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-06 09:30:48 +02:00
Emilien Devos
0fc8f99ecc
[feat] new engine: bt4g added & enabled and disable by default btdigg
...
Disable btdigg because on most SearXNG instances, SearXNG is blocked by btdigg
due to cloudflare too many requests.
This impementation did not parse the HTML page because there is an API in
XML (RSS). The RSS feed provides fewer data like amount of seeders/leechers and
the files in the torrent file. It's a tradeoff for a "stable" engine as the XML
from RSS content will change way less than the HTML page.
Closes: https://github.com/searxng/searxng/issues/2553
2023-08-06 09:30:48 +02:00
Markus Heiser
dad16c0949
[mod] settings.yml: enable engines from Wikimedia Foundation
...
The Wikimedia wikis [1] engines provide good answers and have short response
times --> no reason to disable these enhgines by default. BTW: this patch adds
a (sub-) category ``wikimedia`` for the engines [1].
[1] https://meta.wikimedia.org/wiki/Wikimedia_wikis
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-04 19:06:50 +02:00
Markus Heiser
db522cf76d
[mod] engine: wikimedia - improve results, add addition settings & doc
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-04 19:06:50 +02:00
Bnyro
7d8c20c80d
[feat] new engine: wikispecies
2023-08-04 19:06:50 +02:00
searxng-bot
9a5e91ce84
[translations] update from Weblate
...
310daeb7201be8a264
2023-08-04 09:30:11 +02:00
Markus Heiser
1b030d4b41
[doc] engine: Yacy
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-03 19:58:51 +02:00
zutto
ca518c6803
add option to change yacy search mode
2023-08-03 19:58:51 +02:00
Markus Heiser
203f1f0928
[fix] engine piped: 'invalid content'
...
SearXNG does not allow a None value in the content field of a result item.
If the key (shortDescription, uploaderName) in the JSON response from piped
exists but is set to None, SearXNG ignores this result item::
DEBUG searx : result: invalid content: { .., 'content': None, ..}
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-03 16:23:36 +02:00
Markus Heiser
207fcc0c8c
[mod] engine piped: add paging support
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-03 16:23:36 +02:00
Markus Heiser
ef5831cd84
[mod] engine piped: split into two dedicated engiens for video & music
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-03 16:23:36 +02:00
Markus Heiser
7aa95d2d52
[doc] engine piped: add documentation to docs/dev/engines/online/
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-08-03 16:23:36 +02:00
Bnyro
636bfdac68
[feat] engine: implementation of Piped
2023-08-03 16:23:36 +02:00
dalf
8b4ba204b7
Update searx.data - update_engine_descriptions.py
2023-07-29 11:02:54 +02:00
dalf
d421385dc6
Update searx.data - update_wikidata_units.py
2023-07-29 11:02:23 +02:00
dalf
290f16207b
Update searx.data - update_currencies.py
2023-07-29 11:02:14 +02:00
dalf
fcd2013511
Update searx.data - update_firefox_version.py
2023-07-29 11:01:28 +02:00
dalf
cfa8169509
Update searx.data - update_ahmia_blacklist.py
2023-07-29 09:25:24 +02:00
searxng-bot
f45d1920d9
[translations] update from Weblate
...
ba4888c966ec8a8a280a7b701b3c0b34cbdb37cbd41c2
2023-07-29 08:15:21 +02:00
mrpaulblack
65d8b1a310
[fix] remove disabled: false from engine definitions in settings.yml
...
* setting disabled: false is not needed, since it is by default enabled
2023-07-22 18:19:01 +02:00
searxng-bot
51c531d450
[translations] update from Weblate
...
b7f1e9ae3c7c821e0e305f8480745a22afef0e2e4a7687ac
2023-07-22 17:47:05 +02:00
mrpaulblack
b477349824
[build] /static
2023-07-19 15:07:45 +02:00
Kiru
de5c1cedca
fix "#backToTop" button always being clickable
...
`pointer-events` never gets set to "none" when the button is hidden,
allowing you to click the button. And your mouse further changes it's
cursor to the pointer style.
2023-07-19 15:06:09 +02:00
searxng-bot
b7b184244d
[translations] update from Weblate
...
01350cf15f037a4d820a78ad73037743e656795c0ee18285c087c7fb6eb318c53b4a3d1fb3187499c12266462356a402c9a74b523d9f293868af8585261a2a72fcea15cf7685385eec0a37270130ddf7b93f96094a5cdcb39cba3939d973d937ce0762455c36ccab226ff7d48148a9ed840bc18951ffc22e394ec63e428c16a8218cf51e70260934c6244c2bb92dc5c143917957df1bf630d1c00dff0a6da54f12377e28b5b8ea78ec31e65f6c33b1fe393d390ca4f6b3530f8d6b6b67f2fc965f2d3f025ae2b8dc0bd4fb1ece768726a22ae2f2b5b8774f
2023-07-14 10:21:27 +02:00
Paolo Basso
cada89ee36
[feat] engine: re-enables z-library (zlibrary-global.se)
...
- re-enables z-library as the new domain zlibrary-global.se is now available
from the open web. The announcement of the domain:
https://www.reddit.com/r/zlibrary/comments/13whe08/mod_note_zlibraryglobalse_domain_is_officially/
It is an official domain, it requires to log in to the "personal" subdomain
only to download files, but the search works.
- changes the result template of zlibrary to paper.html, filling the appropriate fields
- implements language filtering for zlibrary
- implement zlibrary custom filters (engine traits)
- refactor and document the zlibrary engine
2023-07-07 21:36:51 +02:00
Hackurei
cb92767f19
[feat] enigine: add CrowdView forum search engine
2023-07-07 21:36:11 +02:00
searxng-bot
4a2f310da3
[translations] update from Weblate
...
152f20089dbf6b224ad4c00f
2023-07-07 21:13:47 +02:00
Markus Heiser
5720844fcd
[doc] rearranges Settings & Engines docs for better readability
...
We have built up detailed documentation of the *settings* and the *engines* over
the past few years. However, this documentation was still spread over various
chapters and was difficult to navigate in its entirety.
This patch rearranges the Settings & Engines documentation for better
readability.
To review new ordered docs::
make docs.clean docs.live
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-07-01 22:45:19 +02:00
searxng-bot
81c9a18456
[translations] update from Weblate
...
2238e87bc70d228a389c0c62656d9fcba9c9b116528b845fb8c50f2339f47c0fae0aa811c8216259
2023-06-30 11:49:07 +02:00
dalf
fbb72fc1f4
Update searx.data - update_engine_descriptions.py
2023-06-29 13:59:25 +02:00
Markus Heiser
87e7926ae9
[fix] engine: Anna's Archive - grep results from '.js-scroll-hidden' elements
...
The renderuing of the WEB page is very strange; except the firts position all
other positions of Anna's result page are enclosed in SGML comments. These
cooments are *uncommented* by some JS code, see query of the class
'.js-scroll-hidden' in Anna's HTML template [1].
[1] https://annas-software.org/AnnaArchivist/annas-archive/-/blob/main/allthethings/templates/macros/md5_list.html
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-06-29 09:32:57 +02:00
