Commit Graph

6989 Commits (whitelist-ratelimiter)
 

Author SHA1 Message Date
blob42 6122afdd98 whitelist_ratelimiter: @dalf patch
- it calls ip_address and ip_network only once for the settings.
- init_whitelist to make tests easier
- get_remote_addr get the IP address for the function is_accepted_request
- for reference: https://esd.io/blog/flask-apps-heroku-real-ip-spoofing.html
1 year ago
blob42 04121beb10 limiter_whitelisting: extra checks and fallback to no whitelisting 1 year ago
blob42 bbc52eb9d5 limiter_whitelisting: add tests, update doc 1 year ago
blob42 e3ceff4302 limiter_whitelisting: allow ip and subnet whitelisting #add 2127
- add a new condition to bypass the rate limiter for whitelisted ips
- the whitelisting condition has the highest priority
1 year ago
Markus Heiser 295c87a926
Merge pull request #2187 from blob42/update-doc
[doc] add example for enabling an engine disabled by default
1 year ago
blob42 27809c84f8 [doc] add example for enabling an engine disabled by default 1 year ago
Alexandre Flament 675dc04917
Merge pull request #2183 from return42/node.env.dev
[mod] install developer tools by: make node.env.dev
1 year ago
Markus Heiser 92a0457532
Merge pull request #2184 from return42/emacs-lsp
[emacs] .dir-locals.el: add Language Server Protocol Support (LSP)
1 year ago
Markus Heiser cedef9930b [emacs] .dir-locals.el: add Language Server Protocol Support (LSP)
Add LSP and update comment strings for full fledge developer tools.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser 3eed80a074 [mod] install developer tools by: make node.env.dev
- rename ``./manage node.env.devtools`` to ``./manage node.env.dev``
- add ``make node.env.dev``
- remove local developer tools by ``make node.clean``

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser 7cbfa6a8dd
Merge pull request #2182 from return42/fix-make-nvm
[fix] make nvm.env exit with error when VERBOSE is unset
1 year ago
Markus Heiser eebb489fb7 [fix] make nvm.env exit with error when VERBOSE is unset
$ make nvm.install
    INFO:  install (update) NVM at /800GBPCIex4/share/SearXNG/.nvm
    INFO:  already cloned at: /800GBPCIex4/share/SearXNG/.nvm
      || Fetching origin
    INFO:  checkout v0.39.1
      || HEAD is now at 9600617 v0.39.1
    make: *** [Makefile:96: nvm.install] Error 1

Without this fix we need to set VERBOSE environment to avoid the 'Error 1':

    $ VERBOSE=0 make nvm.install

BTW: fix an issue if there are any leftovers in ${NVM_DIR} from previos
installations

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser 2cf1425e8b
Merge pull request #2177 from return42/rm-neeva
[fix] remove engine neeva from settings.yml
1 year ago
Markus Heiser 3abff182ea [fix] remove engine neeva from settings.yml
Engine is broken and can't by used any longer as a simple XPath engine.
@allendema tested a engines/neeva.py version using json from the dom, but
without luck: There was some kind of captcha for pagination.

[1] https://github.com/searxng/searxng/issues/2007#issuecomment-1426061698

Closes: https://github.com/searxng/searxng/issues/2007
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Lea a530ac4099 fix: typo in suggestions 1 year ago
Markus Heiser 415f6398d6 [fix] time_range in HTML form should not be a string 'None'
Before this patch SearXNG returns 'time_range': 'None'::

    <form method="GET" action="/searx/search">
      ...
      <input type="hidden" name="time_range" value="None">
      ...
    </form>

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser 9a710587e8 [fix] remove usage of deprecated-module distutis
Closes: https://github.com/searxng/searxng/issues/2168

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
wibyweb 6707354bc8 [mod] engine wiby: add pagination
Suggested by: @wibyweb in searx https://github.com/searx/searx/pull/3465

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser 9c00b9fed1
Merge pull request #2174 from searxng/dependabot/pip/master/redis-4.5.1
Bump redis from 4.4.2 to 4.5.1
1 year ago
dependabot[bot] a7284e0b9c Bump redis from 4.4.2 to 4.5.1
Bumps [redis](https://github.com/redis/redis-py) from 4.4.2 to 4.5.1.
- [Release notes](https://github.com/redis/redis-py/releases)
- [Changelog](https://github.com/redis/redis-py/blob/master/CHANGES)
- [Commits](https://github.com/redis/redis-py/compare/v4.4.2...v4.5.1)

---
updated-dependencies:
- dependency-name: redis
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
1 year ago
Markus Heiser 3ebbdc179c
Merge pull request #2173 from searxng/dependabot/pip/master/pylint-2.16.1
Bump pylint from 2.15.10 to 2.16.1
1 year ago
dependabot[bot] f1a3872aeb Bump pylint from 2.15.10 to 2.16.1
Bumps [pylint](https://github.com/PyCQA/pylint) from 2.15.10 to 2.16.1.
- [Release notes](https://github.com/PyCQA/pylint/releases)
- [Commits](https://github.com/PyCQA/pylint/compare/v2.15.10...v2.16.1)

---
updated-dependencies:
- dependency-name: pylint
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
1 year ago
Markus Heiser 4c06837a50 [mod] make python code pylint 2.16.1 compliant
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser 7320b0c796
Merge pull request #2130 from searxng/translations_update
Update translations
1 year ago
Markus Heiser 716463fef8
Merge pull request #2158 from searxng/dependabot/npm_and_yarn/searx/static/themes/simple/master/grunt-1.6.1
Bump grunt from 1.5.3 to 1.6.1 in /searx/static/themes/simple
1 year ago
dependabot[bot] a5a73d77b3
Bump grunt from 1.5.3 to 1.6.1 in /searx/static/themes/simple
Bumps [grunt](https://github.com/gruntjs/grunt) from 1.5.3 to 1.6.1.
- [Release notes](https://github.com/gruntjs/grunt/releases)
- [Changelog](https://github.com/gruntjs/grunt/blob/main/CHANGELOG)
- [Commits](https://github.com/gruntjs/grunt/compare/v1.5.3...v1.6.1)

---
updated-dependencies:
- dependency-name: grunt
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
1 year ago
Markus Heiser 233ee1bb15
Merge pull request #2157 from searxng/dependabot/pip/master/selenium-4.8.0
Bump selenium from 4.7.2 to 4.8.0
1 year ago
Markus Heiser 01492cf1cc
Merge pull request #2160 from searxng/dependabot/pip/master/flask-babel-3.0.1
Bump flask-babel from 3.0.0 to 3.0.1
1 year ago
dependabot[bot] e6285aed94
Bump selenium from 4.7.2 to 4.8.0
Bumps [selenium](https://github.com/SeleniumHQ/Selenium) from 4.7.2 to 4.8.0.
- [Release notes](https://github.com/SeleniumHQ/Selenium/releases)
- [Commits](https://github.com/SeleniumHQ/Selenium/commits/selenium-4.8.0)

---
updated-dependencies:
- dependency-name: selenium
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
1 year ago
Markus Heiser 4bc69c803d
Merge pull request #2156 from searxng/dependabot/pip/master/splinter-0.19.0
Bump splinter from 0.18.1 to 0.19.0
1 year ago
Markus Heiser 9faf0dc289
Merge pull request #2161 from return42/fix-2146
[fix-2146] set different HTTP Referer header to DuckDuckGo requests
1 year ago
Markus Heiser 257dc7d6c4 [fix-2146] set different HTTP Referer header to DuckDuckGo requests
For what ever reasons, ddg-lite don't like the Referer

  https://lite.duckduckgo.com/

In an interactive session in the WEB browser the the Reverer has exactly this
value, but ddg-lite don't like this value when the request is build up by
SearXNG.  The new value is:

  https://google.com/

What fakes a user comes from a google link.

Related: https://github.com/searxng/searxng/pull/2081
Closes: https://github.com/searxng/searxng/issues/2146

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
searxng-bot 8db35f8e9c [translations] update from Weblate
009d48c2 - 2023-02-01 - tygyh <jonis9898@hotmail.com>
a5353bad - 2023-02-01 - Mooo <moose@mail.ru>
1617f458 - 2023-01-28 - emirhan <xemirhankoc@gmail.com>
79bc60f4 - 2023-01-29 - ewm <gnu.ewm@protonmail.com>
1 year ago
dependabot[bot] 0bf7f287bb
Bump flask-babel from 3.0.0 to 3.0.1
Bumps [flask-babel](https://github.com/python-babel/flask-babel) from 3.0.0 to 3.0.1.
- [Release notes](https://github.com/python-babel/flask-babel/releases)
- [Changelog](https://github.com/python-babel/flask-babel/blob/master/CHANGELOG)
- [Commits](https://github.com/python-babel/flask-babel/compare/v3.0.0...v3.0.1)

---
updated-dependencies:
- dependency-name: flask-babel
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
1 year ago
dependabot[bot] 4a456f00fd
Bump splinter from 0.18.1 to 0.19.0
Bumps [splinter](https://github.com/cobrateam/splinter) from 0.18.1 to 0.19.0.
- [Release notes](https://github.com/cobrateam/splinter/releases)
- [Changelog](https://github.com/cobrateam/splinter/blob/master/docs/news.rst)
- [Commits](https://github.com/cobrateam/splinter/compare/0.18.1...0.19.0)

---
updated-dependencies:
- dependency-name: splinter
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
1 year ago
Markus Heiser d9ab83642f
Merge pull request #2148 from return42/lxc-ubu2204
[LXC] ubuntu 21.10 upgrade to ubuntu 22.04 LTS
1 year ago
Markus Heiser c90e157ddd [LXC] ubuntu 21.10 upgrade to ubuntu 22.04 LTS [1]
[1] https://wiki.ubuntu.com/Releases

Tested by::

    # build the container ..
    $ sudo -H ./utils/lxc.sh build searxng-ubu2204

    # install a complete SearXNG suite ..
    $ sudo -H ./utils/lxc.sh cmd searxng-ubu2204 FORCE_TIMEOUT=0 ./utils/searxng.sh install all

    # install nginx to export the SearXNG instance by HTTP
    $ sudo -H ./utils/lxc.sh cmd searxng-ubu2204 FORCE_TIMEOUT=0 ./utils/searxng.sh install nginx

    # check instance
    $  sudo -H ./utils/lxc.sh cmd searxng-ubu2204 FORCE_TIMEOUT=0 ./utils/searxng.sh instance check
    INFO:  [searxng-ubu2204] FORCE_TIMEOUT=0 ./utils/searxng.sh instance check
    INFO:  wrapper:  utils/searxng.sh instance _call searxng.check

    SearXNG checks
    --------------
    ...
    INFO    searx                         : merge the default settings ( /usr/local/searxng/searxng-src/searx/settings.yml ) and the user settings ( /etc/searxng/settings.yml )
    INFO    searx                         : max_request_timeout=None
    INFO    searx.redisdb                 : connecting to Redis db=0 path='/usr/local/searxng-redis/run/redis.sock'
    INFO    searx.redisdb                 : connected to Redis

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Alexandre Flament 9d102fb08f
Merge pull request #2132 from dalf/update_pr_1967
search.suspended_time settings: bug fixes
1 year ago
Markus Heiser 031162be04 [doc] settings.py document search.suspended_times
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser feccee01c0 [doc] Add doc-strings to searx.exceptions
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
1 year ago
Markus Heiser 4f808088f1
Merge pull request #2139 from dalf/fix_update_languages
Fix update languages
1 year ago
Markus Heiser d989c9429f
Merge pull request #2134 from searxng/update_data_update_wikidata_units.py
Update searx.data - update_wikidata_units.py
1 year ago
Markus Heiser 5c2667b956
Merge pull request #2135 from searxng/update_data_update_ahmia_blacklist.py
Update searx.data - update_ahmia_blacklist.py
1 year ago
Markus Heiser e6a17f2fae
Merge pull request #2136 from searxng/update_data_update_firefox_version.py
Update searx.data - update_firefox_version.py
1 year ago
Markus Heiser c4cbf8829a
Merge pull request #2137 from searxng/update_data_update_currencies.py
Update searx.data - update_currencies.py
1 year ago
Markus Heiser 2b60124546
Merge pull request #2138 from searxng/update_data_update_engine_descriptions.py
Update searx.data - update_engine_descriptions.py
1 year ago
Alexandre Flament bfca63c536 wikipedia engine: update _fetch_supported_languages
the layout https://meta.wikimedia.org/wiki/List_of_Wikipedias has changed
1 year ago
Alexandre Flament 8256de2fe8 peertube engine: update _fetch_supported_languages
There is now an API to get the list of supported languages
https://docs.joinpeertube.org/api-rest-reference.html#tag/Video/operation/getLanguages
1 year ago
dalf f900e33092 Update searx.data - update_engine_descriptions.py 1 year ago
dalf dafe026815 Update searx.data - update_currencies.py 1 year ago