mirror of
https://github.com/searxng/searxng
synced 2024-11-09 01:10:26 +00:00
823c490c84
Block requests from PetalBlock. Normally robots.txt is enough to stop PetalBlock from making requests [1]. However, if SearXNG is offered below a path (example.org/search), then the robots.txt is not available in the root paths of the domain / subdomain. [1] https://webmaster.petalsearch.com/site/petalbot Signed-off-by: Markus Heiser <markus.heiser@darmarit.de> |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| ahmia_filter.py | ||
| hash_plugin.py | ||
| hostname_replace.py | ||
| limiter.py | ||
| oa_doi_rewrite.py | ||
| search_on_category_select.py | ||
| self_info.py | ||
| tor_check.py | ||
| tracker_url_remover.py | ||
| vim_hotkeys.py | ||