You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
searxng/searx/engines
Alexandre Flament 01e2648e93 Simplify search.py, basically updated PR #518
The timeouts in settings.yml is about the total time (not only the HTTP request but also the prepare the request and parsing the response)
It was more or less the case before since the threaded_requests function ignores the thread after the timeout even the HTTP request is ended.

New / changed stats :
* page_load_time : record the HTTP request time
* page_load_count: the number of HTTP request
* engine_time : the execution total time of an engine
* engine_time_count : the number of "engine_time" measure

The avg response times in the preferences are the engine response time (engine_load_time / engine_load_count)

To sum up :
* Search.search() filters the engines that can't process the request
* Search.search() call search_multiple_requests function
* search_multiple_requests creates one thread per engine, each thread runs the search_one_request function
* search_one_request calls the request function, make the HTTP request, calls the response function, extends the result_container
* search_multiple_requests waits for the the thread to finish (or timeout)
8 years ago
..
__init__.py Simplify search.py, basically updated PR #518 8 years ago
archlinux.py Add missing blank lines after class or function definition. 8 years ago
base.py [enh] Add BASE engine in category Science. Basic and advanced search. 8 years ago
bing.py [enh] display number of results 8 years ago
bing_images.py add time range support for bing images 8 years ago
bing_news.py add time range search for bing news 8 years ago
blekko_images.py [fix] pep8 compatibilty 9 years ago
btdigg.py add digbt engine 8 years ago
currency_convert.py Fix anomalous backslash in string 8 years ago
dailymotion.py Merge pull request #308 from dalf/versions_upgrade 9 years ago
deezer.py update versions.cfg to use the current up-to-date packages 9 years ago
deviantart.py [fix] time range detection 8 years ago
dictzone.py [fix] unicode urls 8 years ago
digbt.py [fix] results with digbit don't truncate anymore 8 years ago
digg.py [fix] pep8 compatibilty 9 years ago
doku.py Fix query encoding 8 years ago
duckduckgo.py [fix] time range detection 8 years ago
duckduckgo_definitions.py [fix] compile regex in ddg_definitions 8 years ago
dummy.py update versions.cfg to use the current up-to-date packages 9 years ago
faroo.py [fix] pep8 compatibilty 9 years ago
fdroid.py Add F-Droid search engine 8 years ago
filecrop.py Fix quantity of blank lines after code object. 8 years ago
flickr.py update versions.cfg to use the current up-to-date packages 9 years ago
flickr_noapi.py add time range search for flickr 8 years ago
frinkiac.py fix pep8 errors 9 years ago
generalfile.py update versions.cfg to use the current up-to-date packages 9 years ago
gigablast.py [fix] gigablast redirect - closes #575 8 years ago
github.py update versions.cfg to use the current up-to-date packages 9 years ago
google.py [fix] time range detection 8 years ago
google_images.py [fix] google images paging - closes #571 8 years ago
google_news.py update versions.cfg to use the current up-to-date packages 9 years ago
ina.py Add INA search engine 8 years ago
json_engine.py [fix] behaviour for page_size>1 and first_page_num>0 8 years ago
kickass.py fix kickass torrents engine 8 years ago
mediawiki.py [fix] restrict wikipedia queries to the titles to avoid irrelevant results 9 years ago
mixcloud.py update versions.cfg to use the current up-to-date packages 9 years ago
nyaa.py Fix PEP8 warnings for Nyaa.py 8 years ago
openstreetmap.py update versions.cfg to use the current up-to-date packages 9 years ago
pdbe.py initial commit of pdbe engine 8 years ago
photon.py update versions.cfg to use the current up-to-date packages 9 years ago
piratebay.py [fix] piratebay tld according to wikipedia 9 years ago
qwant.py Removed the keywords from the settings in qwant engine 9 years ago
reddit.py [fix] incorrect URLs in Reddit results - closes #538 8 years ago
scanr_structures.py Add ScanR structures search engine 8 years ago
searchcode_code.py [fix] pep8 compatibilty 9 years ago
searchcode_doc.py [fix] pep8 compatibilty 9 years ago
seedpeer.py Added seepeer to config and added seepeer search parser 8 years ago
soundcloud.py Add missing blank lines after class or function definition. 8 years ago
spotify.py update versions.cfg to use the current up-to-date packages 9 years ago
stackoverflow.py [fix] pep8 compatibilty 9 years ago
startpage.py Fix anomalous backslash in string 8 years ago
subtitleseeker.py update versions.cfg to use the current up-to-date packages 9 years ago
swisscows.py Fix anomalous backslash in string 8 years ago
tokyotoshokan.py Fix anomalous backslash in string 8 years ago
torrentz.py Add Torrentz.eu search engine 8 years ago
translated.py [fix] unicode urls 8 years ago
twitter.py [fix] handle missing url in twitter results 9 years ago
vimeo.py Fix Vimeo engine. 9 years ago
wikidata.py [fix] merge infoboxes based on weight 8 years ago
wikipedia.py [fix] urls merge in infobox (#593) 8 years ago
wolframalpha_api.py Improving Wolfram Alpha search hit content 8 years ago
wolframalpha_noapi.py #607 - noapi fix 8 years ago
www1x.py [fix] pep8 compatibilty 9 years ago
www500px.py Fix anomalous backslash in string 8 years ago
xpath.py [fix] behaviour for page_size>1 and first_page_num>0 8 years ago
yacy.py update versions.cfg to use the current up-to-date packages 9 years ago
yahoo.py [fix] time range detection 8 years ago
yahoo_news.py Fix anomalous backslash in string 8 years ago
yandex.py [fix] swisscow and yandex escaping - fixes #499 9 years ago
youtube_api.py Adds two engines : Youtube with or without API 9 years ago
youtube_noapi.py add time range search for youtube noapi 8 years ago