Alexandre Flament
64cccae99e
[mod] various engines: use eval_xpath* functions and searx.exceptions.*
...
Engine list: ahmia, duckduckgo_images, elasticsearch, google, google_images, google_videos, youtube_api
4 years ago
Alexandre Flament
2006eb4680
[mod] move extract_text, extract_url to searx.utils
4 years ago
Markus Heiser
8162d7aff4
[fix] google engine - div classes has been renamed in HTML reult
...
Since 1. October 2020 google has changed the 'class' attribute of the HTML
result page.
Fix the xpath expressions and ignore <div class="g" ../> sections which do not
match to title's xpath expression.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
4 years ago
Marc Abonce Seguin
ecf5899153
fetch google's search langs rather than ui langs
4 years ago
Dalf
1022228d95
Drop Python 2 (1/n): remove unicode string and url_utils
4 years ago
Adam Tauber
52eba0c721
[fix] pep8
4 years ago
Markus Heiser
410c2f903d
[fix] revise google engine
...
this commit is picked from #1985
4 years ago
Marc Abonce Seguin
ccaf6ca02c
[fix] update xpaths for new google results page
5 years ago
Adam Tauber
731e34299d
Merge pull request #1744 from dalf/optimizations
...
[mod] speed optimization
5 years ago
Emilien Devos
8f51430f5c
[fix] Force Google old UI with a new user agent
5 years ago
Dalf
85b3723345
[mod] speed optimization
...
compile XPath only once
avoid redundant call to urlparse
get_locale(webapp.py): avoid useless call to request.accept_languages.best_match
5 years ago
Emilien Devos
cbd1ebdce8
[fix] Force Google old UI ( #1597 )
5 years ago
Noémi Ványi
b63d645a52
Revert "remove 'all' option from search languages"
...
This reverts commit 4d1770398a
.
6 years ago
Marc Abonce Seguin
0169b63e84
[fix] fetch google's supported languages
6 years ago
Marc Abonce Seguin
5568f24d6c
[fix] check language aliases when setting search language
6 years ago
Marc Abonce Seguin
f7f9c50393
[fix] force English results in Google when using en-US
7 years ago
Marc Abonce Seguin
772c048d01
refactor engine's search language handling
...
Add match_language function in utils to match any user given
language code with a list of engine's supported languages.
Also add language_aliases dict on each engine to translate
standard language codes into the custom codes used by the engine.
7 years ago
Marc Abonce Seguin
d1eae9359f
fix fetch_langauges to be more accurate
...
Add languages supported by either all default general engines or 10 engines.
7 years ago
Noémi Ványi
2d5eed9b59
send constant cookie with query to Google
7 years ago
marc
4d1770398a
remove 'all' option from search languages
7 years ago
Adam Tauber
1613c6319e
[fix] handle /sorry redirects
7 years ago
Adam Tauber
6eb9503896
[fix] use english in google engine if no language was set - this prevents guessing the language by the IP of the instance
7 years ago
Adam Tauber
6fdb6640d9
[fix] revert language changes to prevent CAPTCHAs
7 years ago
Adam Tauber
9ab8536479
[fix] fix language support of google
7 years ago
Adam Tauber
52e615dede
[enh] py3 compatibility
8 years ago
Adam Tauber
52d1087202
[enh] add result number parsing to google engine
8 years ago
David A Roberts
1d30141c20
[enh] show spelling corrections
8 years ago
Adam Tauber
0d4da30c7f
[enh] add instant answers to google engine
8 years ago
marc
af35eee10b
tests for _fetch_supported_languages in engines
...
and refactor method to make it testable without making requests
8 years ago
marc
f62ce21f50
[mod] fetch supported languages for several engines
...
utils/fetch_languages.py gets languages supported by each engine and
generates engines_languages.json with each engine's supported language.
8 years ago
marc
c677aee58a
filter langauges
8 years ago
marc
149802c569
[enh] add supported_languages on engines and auto-generate languages.py
8 years ago
Noémi Ványi
c59c76e6ee
add year to time range to engines which support "Last year"
...
Engines:
* Bing images
* Flickr (noapi)
* Google
* Google Images
* Google News
8 years ago
Adam Tauber
16bdc0baf4
[mod] do not escape html content in engines
8 years ago
Adam Tauber
350a84520d
[fix] time range detection
8 years ago
Noemi Vanyi
2e5839503f
add time range search for google
8 years ago
stepshal
b3ab221b98
Fix anomalous backslash in string
8 years ago
Adam Tauber
85c0351dca
Merge pull request #526 from ukwt/anime
...
Add a few search engines
9 years ago
Kirill Isakov
90c51cb449
Fix a few typos in Google search engine
9 years ago
Adam Tauber
6d55642ab4
[fix] no more redirect ++ explicitly specify search language to avoid googles ip based heuristics
9 years ago
Adam Tauber
09b7673fbd
[fix] temporary disable googles inner links - #491
9 years ago
Adam Tauber
66f48c2bf5
[fix] google markup change - closes #489
9 years ago
Adam Tauber
5cea4f9445
[fix] prevent google engine to redirect
...
nid/pref cookies are also removed
9 years ago
Adam Tauber
d8f8bdc951
[fix] quickfix for sometimes missing PREF cookie
9 years ago
Adam Tauber
5d49c15f79
[fix] google engine - ignore new useless result type
9 years ago
Adam Tauber
0ad272c5cb
[fix] content escaping - closes #441
...
TODO check other engines too
9 years ago
Dalf
fc0ae0f907
google engine: code cleanup
9 years ago
Dalf
72c8de35a2
google engine :remove OSM map
9 years ago
Alexandre Flament
b8fc531b60
[enh] google engine : parse map links and more
9 years ago
Alexandre Flament
39ff21237c
[enh] google engine : avoid some "sorry google" by adding another cookie : NID. This cookie is specific by hostname.
...
This allow to send request to google.* (according to the search language).
Before this commit, request in other languages than english was sent to www.google.com which was redirected to www.google.*
The PREF is still use on the www.google.com domain.
9 years ago