Commit Graph

4342 Commits (whitelist-ratelimiter)

Author SHA1 Message Date
blob42 6122afdd98 whitelist_ratelimiter: @dalf patch
- it calls ip_address and ip_network only once for the settings.
- init_whitelist to make tests easier
- get_remote_addr get the IP address for the function is_accepted_request
- for reference: https://esd.io/blog/flask-apps-heroku-real-ip-spoofing.html
1 year ago
blob42 04121beb10 limiter_whitelisting: extra checks and fallback to no whitelisting 1 year ago
blob42 bbc52eb9d5 limiter_whitelisting: add tests, update doc 1 year ago
blob42 e3ceff4302 limiter_whitelisting: allow ip and subnet whitelisting #add 2127
- add a new condition to bypass the rate limiter for whitelisted ips
- the whitelisting condition has the highest priority
1 year ago
Markus Heiser 3abff182ea [fix] remove engine neeva from settings.yml
Engine is broken and can't by used any longer as a simple XPath engine.
@allendema tested a engines/neeva.py version using json from the dom, but
without luck: There was some kind of captcha for pagination.

[1] https://github.com/searxng/searxng/issues/2007#issuecomment-1426061698

Closes: https://github.com/searxng/searxng/issues/2007
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Lea a530ac4099 fix: typo in suggestions 1 year ago
Markus Heiser 415f6398d6 [fix] time_range in HTML form should not be a string 'None'
Before this patch SearXNG returns 'time_range': 'None'::

    <form method="GET" action="/searx/search">
      ...
      <input type="hidden" name="time_range" value="None">
      ...
    </form>

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
wibyweb 6707354bc8 [mod] engine wiby: add pagination
Suggested by: @wibyweb in searx https://github.com/searx/searx/pull/3465

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser 4c06837a50 [mod] make python code pylint 2.16.1 compliant
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser 7320b0c796
Merge pull request #2130 from searxng/translations_update
Update translations
1 year ago
dependabot[bot] a5a73d77b3
Bump grunt from 1.5.3 to 1.6.1 in /searx/static/themes/simple
Bumps [grunt](https://github.com/gruntjs/grunt) from 1.5.3 to 1.6.1.
- [Release notes](https://github.com/gruntjs/grunt/releases)
- [Changelog](https://github.com/gruntjs/grunt/blob/main/CHANGELOG)
- [Commits](https://github.com/gruntjs/grunt/compare/v1.5.3...v1.6.1)

---
updated-dependencies:
- dependency-name: grunt
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
1 year ago
Markus Heiser 257dc7d6c4 [fix-2146] set different HTTP Referer header to DuckDuckGo requests
For what ever reasons, ddg-lite don't like the Referer

  https://lite.duckduckgo.com/

In an interactive session in the WEB browser the the Reverer has exactly this
value, but ddg-lite don't like this value when the request is build up by
SearXNG.  The new value is:

  https://google.com/

What fakes a user comes from a google link.

Related: https://github.com/searxng/searxng/pull/2081
Closes: https://github.com/searxng/searxng/issues/2146

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
searxng-bot 8db35f8e9c [translations] update from Weblate
009d48c2 - 2023-02-01 - tygyh <jonis9898@hotmail.com>
a5353bad - 2023-02-01 - Mooo <moose@mail.ru>
1617f458 - 2023-01-28 - emirhan <xemirhankoc@gmail.com>
79bc60f4 - 2023-01-29 - ewm <gnu.ewm@protonmail.com>
1 year ago
Alexandre Flament 9d102fb08f
Merge pull request #2132 from dalf/update_pr_1967
search.suspended_time settings: bug fixes
1 year ago
Markus Heiser feccee01c0 [doc] Add doc-strings to searx.exceptions
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser 4f808088f1
Merge pull request #2139 from dalf/fix_update_languages
Fix update languages
1 year ago
Markus Heiser d989c9429f
Merge pull request #2134 from searxng/update_data_update_wikidata_units.py
Update searx.data - update_wikidata_units.py
1 year ago
Markus Heiser 5c2667b956
Merge pull request #2135 from searxng/update_data_update_ahmia_blacklist.py
Update searx.data - update_ahmia_blacklist.py
1 year ago
Markus Heiser e6a17f2fae
Merge pull request #2136 from searxng/update_data_update_firefox_version.py
Update searx.data - update_firefox_version.py
1 year ago
Markus Heiser c4cbf8829a
Merge pull request #2137 from searxng/update_data_update_currencies.py
Update searx.data - update_currencies.py
1 year ago
Alexandre Flament bfca63c536 wikipedia engine: update _fetch_supported_languages
the layout https://meta.wikimedia.org/wiki/List_of_Wikipedias has changed
1 year ago
Alexandre Flament 8256de2fe8 peertube engine: update _fetch_supported_languages
There is now an API to get the list of supported languages
https://docs.joinpeertube.org/api-rest-reference.html#tag/Video/operation/getLanguages
1 year ago
dalf f900e33092 Update searx.data - update_engine_descriptions.py 1 year ago
dalf dafe026815 Update searx.data - update_currencies.py 1 year ago
dalf 47435be70b Update searx.data - update_firefox_version.py 1 year ago
dalf 53a4a90d0c Update searx.data - update_wikidata_units.py 1 year ago
dalf 9dd95457a9 Update searx.data - update_ahmia_blacklist.py 1 year ago
Alexandre Flament 37addec69e search.suspended_time settings: bug fixes
* fix type in settings.yml: replace suspend_times by suspended_times
* always use delay defined in settings.yml:
  * HTTP status 402 and 403: read the value from settings.yml instead of using the hardcoded value of 1 day.
  * startpage engine: CAPTCHA suspend the engine for one day instead of one week
1 year ago
Alexandre Flament 28356f4284
Merge pull request #2115 from searxng/dependabot/pip/master/flask-babel-3.0.0
Bump flask-babel from 2.0.0 to 3.0.0
1 year ago
mrpaulblack b3883dc395 [build] /static 1 year ago
mrpaulblack 8ead23347f [fix] use input elements for pagination requests
* use html input elements instead of buttons for the pagination forms at the bottom of the result page
* move the less section that hides the pagination number widget on mobile to the mobile section
* clean up the less code for styling the numbers of the pagination widget
* fix: add the margin for box results (like in news category) to the bottom of the result to have a margin between pagination widget and article result
1 year ago
llmII d2b2300ee1 Feature: Pagination Widget with list of numbers.
Adds to the navigation widget, preserving forward/backward nav, and
inserting a list of clickable page numbers between them.

Phone sized devices continue without this widget as deterministic
display under small screen sizes has not been solved.

The widget is agnostic to the actual amount of pages there are that one
can navigate to and as such shows all plausible, albeit not necessarilly
valid, possibilities.

This widget does not interfere with infinite scroll in any fashion.
1 year ago
Alexandre Flament 06b5068a2e SearXNG version: YYYY.MM.DD without leading zero 1 year ago
Alexandre Flament a9d6f7532a weblate: migration to https://translate.codeberg.org/ 1 year ago
searxng-bot 6e4c8b3516 [translations] update from Weblate 1 year ago
Alexandre Flament f759a84af4 SearXNG version: fix make docker
continuation of #2117
related to #2111

This commit:
* fixes the Docker tag using an additional variable DOCKER_TAG, see searx/version.py
* fixes the Docker labels org.label-schema.vcs-ref and org.opencontainers.image.revision
* adds searx/version_frozen to .gitignore
1 year ago
dependabot[bot] 70fff2ebf1 Bump flask-babel from 2.0.0 to 3.0.0
Bumps [flask-babel](https://github.com/python-babel/flask-babel) from 2.0.0 to 3.0.0.
- [Release notes](https://github.com/python-babel/flask-babel/releases)
- [Changelog](https://github.com/python-babel/flask-babel/blob/master/CHANGELOG)
- [Commits](https://github.com/python-babel/flask-babel/compare/v2.0.0...v3.0.0)

---
updated-dependencies:
- dependency-name: flask-babel
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
1 year ago
Alexandre Flament 0515f2974b Version number follows PEP440 : replace - by +
Close #2111
1 year ago
Alexandre Flament 6d72ef3cbe
Merge pull request #2109 from ahmad-alkadri/fix/highlight-full-word
Standalone words highlighting for query result in non-CJK characters
1 year ago
Alexandre Flament 13b0c251c4
Merge pull request #2100 from nexryai/master
Add goo engine
1 year ago
ahmad-alkadri 99b5272d9a A little fix and modified the testing for content highlight 1 year ago
Léon Tiekötter 0cedb1c6d8 Add search.suspended_times settings
Make suspended_time changeable in settings.yml
Allow different values to be set for different exceptions.

Co-authored-by: Alexandre Flament <alex@al-f.net>
1 year ago
ahmad-alkadri 6c421110b5 Perso branch - added cjk check and enclosement 1 year ago
searxng-bot 3e5ea08504 [translations] update from Weblate
6a57ee0b - 2023-01-11 - Markus Heiser <markus.heiser@darmarit.de>
b180a810 - 2023-01-06 - Nik Drešar <nik.dresar@gmail.com>
8710174a - 2023-01-11 - Markus Heiser <markus.heiser@darmarit.de>
529a2591 - 2023-01-08 - Markus Heiser <markus.heiser@darmarit.de>
a254bd01 - 2023-01-08 - Markus Heiser <markus.heiser@darmarit.de>
860c3fce - 2023-01-11 - Markus Heiser <markus.heiser@darmarit.de>
c140fb52 - 2023-01-06 - Markus Heiser <markus.heiser@darmarit.de>
1 year ago
nexryai 4e7bb1bf9a
Add goo engine 1 year ago
Ahmad Alkadri 7fc8d72889 [fix] bing: parsing result; check to see if the element contains links
This patch is to hardening the parsing of the bing response:

1. To fix [2087] check if the selected result item contains a link, otherwise
   skip result item and continue in the result loop.  Increment the result
   pointer when a result has been added / the enumerate that counts for skipped
   items is no longer valid when result items are skipped.

   To test the bugfix use:   ``!bi :all cerbot``

2. Limit the XPath selection of result items to direct children nodes (list
   items ``li``) of the ordered list (``ol``).

   To test the selector use: ``!bi :en pontiac aztek wiki``

   .. in the result list you should find the wikipedia entry on top,
   compare [2068]

[2087] https://github.com/searxng/searxng/issues/2087
[2068] https://github.com/searxng/searxng/issues/2068
1 year ago
Milad-Laly cf4db4be37 [fix] Mojeek Xpath showing suggestions and searches + add lang support 1 year ago
Markus Heiser 54e63839db
Merge pull request #2088 from llmII/fix-suggestions
Fix #2083
1 year ago
Markus Heiser 9d6b048fba [build] /static 1 year ago
llmII 33d97fd01a Fix #2083
This changes the Suggestions to be a single column, not a wrapping row,
changing the input to be incapable of overflowing into visually adjacent
elements.
1 year ago