Commit Graph

189 Commits (94ac560dcc85e2e75d3b14706a65eb9488643eb4)

Author SHA1 Message Date
rinpatch dcc9fdb47f
Added unit test 6 years ago
rinpatch 06e070aee2 Fix string length 6 years ago
rinpatch c40d8e1d15 Unit test 6 years ago
Marc Abonce Seguin f7f9c50393 [fix] force English results in Google when using en-US 6 years ago
Marc Abonce Seguin 9687786226 update unit tests for google news and wikidata 6 years ago
Marc Abonce Seguin 772c048d01 refactor engine's search language handling
Add match_language function in utils to match any user given
language code with a list of engine's supported languages.

Also add language_aliases dict on each engine to translate
standard language codes into the custom codes used by the engine.
6 years ago
Noémi Ványi 3ef8533f4d fix unit tests 6 years ago
marc 4d1770398a remove 'all' option from search languages 7 years ago
Adam Tauber 9e79ad4bde [fix] pdbe test 7 years ago
Adam Tauber 060c797739 [fix] change domain name in google engine test 7 years ago
pyrrh0n1c a1d1a50149 Fixed unittests. 7 years ago
pyrrh0n1c 4340c0b16c Fixed typos. 7 years ago
Adam Tauber 00a7041daa
Merge pull request #1068 from Apply55gx/genius
Continuation of PR #1004 (seems abandoned)
7 years ago
Noémi Ványi 5954a8e16a minor fix of BASE engine 7 years ago
jibe-b df0d915806 [add] pubmed engine 7 years ago
Noémi Ványi 9c2b7a82f0 minor fixes of arxiv
Closes #1050
7 years ago
jibe-b 3e3672e079 [add] arxiv engine 7 years ago
Apply55gx d800e3fcfa Merge pull request #1 from asciimoo/master
-
7 years ago
marc 54f0ab1f3b test fetch langauges function on bing images 7 years ago
marc 44085e31d0 update engines_languages.json and languages.py
Also, fix fetch_languages.py so it can run on python3.
7 years ago
marc a524dbb823 [fix] language support for bing images and videos 7 years ago
jibe-b d081eee3f8 [add] unit_test for base engine 7 years ago
misnyo c3232b0e1a Merge branch 'master' into nyaa 7 years ago
misnyo 01330f71cd [fix] nyaa.si fixed 7 years ago
misnyo 3182ba7069 [fix] google news dom xpath fix 7 years ago
Adam Tauber e74aaa781e Merge pull request #1016 from misnyo/blekko
[mod]blekko images removed
7 years ago
misnyo 0607b167f8 [fix] faroo json api and image layout fixed 7 years ago
misnyo f139f9cfdb [mod]blekko images removed 7 years ago
misnyo bf3f9a91fa [fix]torrentz unit_tests timezone fix 7 years ago
misnyo 2098e1b7ff [fix]torrentz unit_tests timezone fix 7 years ago
misnyo d14e2781b2 [fix]torrentz search engine fixed for new version 7 years ago
woorst 636b760196 remove unicode characters 7 years ago
woorst 62b2f79ce7 fix line lengths for pep8 standards 7 years ago
woorst 2434c29dc5 New engine: Genius (lyrics) 7 years ago
marc 3ca9cad927 add bing videos engine 7 years ago
marc 856dfc3018 add google videos 7 years ago
Noémi Ványi 2242000bd4 change unresponsive_engines to a set to eliminate duplication of errors 7 years ago
Noémi Ványi 243d3e4298 show engine errors in infobox && add new error alert 7 years ago
marc 405e5c8f24 [fix] duckduckgo images doesn't fail with countryless language 7 years ago
marc 3b950929b1 [fix] fix duckduckgo's offset
First page now starts with 0 offset,
rather than starting on the 30th result.

DuckDuckGo returns 30 results on each page.
7 years ago
marc c65a409f0d add duckduckgo images engine 7 years ago
Adam Tauber 8db527c1d2 [fix] use raw response with etree.parsefromstring - Unicode strings with encoding declaration are not supported 7 years ago
marc 9ee8e552da [fix] bing images 7 years ago
Alexandre Flament f5128c7cb9 [mod] add/modify image fetching for bing_news, qwant and twitter engines 7 years ago
Adam Tauber 52e615dede [enh] py3 compatibility 7 years ago
François Revol 45d15bd6f0 Add framalibre engine
framalibre.org is a catalogue of Free Software, edited by Framasoft.

For now we pass the thumbnail as img_src as it doesn't seem to be used
for IT...
7 years ago
marc 805fb02ed1 add language support for qwant
closes issue #863
7 years ago
Alexandre Flament e67dfaaac7 Merge branch 'master' into flask_perimeter 8 years ago
Alexandre Flament 7fdfeca3a4 [mod] add a __common__ template that can't be selected but that provides a common place for shared templates.
What has been moved into this template :
* opensearch*.xml is always the same whatever the themes.
* the text inside */about.html
8 years ago
David A Roberts 1d30141c20 [enh] show spelling corrections 8 years ago
Alexandre Flament 84a2c97a65 [mod] searx uses flask framework only in webapp.py. Make migration to another framework easier. 8 years ago
Adam Tauber 6bf9c398a7 [fix] use english as default language in bing
If no language is specified, bing returns results with multiple languages
for one query which isn't really useful. Setting english as default
insted if nothing.
8 years ago
marc 1175b3906f change language list to only include languages with a minimum of engines
that support them.
users can still query lesser supported through the :lang_code bang.
8 years ago
marc af35eee10b tests for _fetch_supported_languages in engines
and refactor method to make it testable without making requests
8 years ago
marc e0c270bd72 tests for language support in engines 8 years ago
marc f62ce21f50 [mod] fetch supported languages for several engines
utils/fetch_languages.py gets languages supported by each engine and
generates engines_languages.json with each engine's supported language.
8 years ago
marc 92c6e88ad3 small fixes 8 years ago
marc a11948c71b Add language support for more engines. 8 years ago
Noémi Ványi b034356825 add year filter to engines with time range support && tests
Following engines does not support "Last year":
 * Bing News
 * DeviantArt
 * DuckDuckGo
 * Yahoo
 * YouTube (noapi)
8 years ago
Noémi Ványi c59c76e6ee add year to time range to engines which support "Last year"
Engines:
 * Bing images
 * Flickr (noapi)
 * Google
 * Google Images
 * Google News
8 years ago
Adam Tauber 9b2bd6847f [fix] 500px unit tests 8 years ago
Adam Tauber f6e9c074bb [fix] vimeo engine change follow-up 8 years ago
Adam Tauber a2c94895c1 [fix] google news engine change follow-up 8 years ago
Adam Tauber 8116e341cc [fix] kickass test html escaping 8 years ago
Adam Tauber fdf63940e8 [fix] tests ++ flickr error 8 years ago
Adam Tauber 971ed0abd1 [enh] add quick answer functionality with an example answerer 8 years ago
Adam Tauber 044809e298 [fix] search mocking in webapp test 8 years ago
Adam Tauber 16ff8d06c7 [fix] bing paging and language support
see https://msdn.microsoft.com/en-us/library/ff795620.aspx for bing
specific search operators

closes #755
8 years ago
dalf fbb080f358 Change plugin API :
- pre_search(request, search)
- post_search(request, search)
- on_result(request, search, result)

with
- request is the Flask request
- search a searx.Search instance
- result a searx result as usual
8 years ago
dalf 67e11c42b9 Clean up the architecture
Purposes :
- isolate the plugins calls
- distinction between parsing the web request and running the search (Search class). To be able to test code easily, to run searx code outside a web server, to filter the search query parameters with plugins more easily, etc...

Details :
- request.request_data contains request.form or request.args (initialize inside pre_request() function)
- Query class is renamed RawTextQuery
- SearchQuery class defines all search parameters
- get_search_query_from_webapp create a SearchQuery instance (basically the previous Search.__init__ code)
- Search class and SearchWithPlugins class takes a SearchQuery instance as class constructor parameter
- SearchWithPlugins class inherites from Search class, and run plugins
- A dedicated function search_with_plugins executes plugins to have a well define locals() (which is used by the plugins code).
- All plugins code is executed inside the try...except block (webapp.py, index function)
- advanced_search HTTP parameter value stays in webapp.py (it is only part of UI)
- multiple calls to result_container.get_ordered_results() doesn't compute the order multiple time (note : this method was call only once before)
- paging value is stored in the result_container class (compute in the extend method)
- test about engine.suspend_end_time is done during search method call (instead of __init__)
- check that the format parameter value is one of these : html, rss, json, rss (before the html value was assumed but some text formatting wasn't not done)
8 years ago
Noémi Ványi 1490d6bc93 add time range search for flickr 8 years ago
Noémi Ványi 5c02b9ef31 add time range support for bing images 8 years ago
Noémi Ványi d2e0cbafb2 add time range search for youtube noapi 8 years ago
Noémi Ványi f70d405202 add time range search for bing news 8 years ago
Noémi Ványi 53c9fde992 fix kickass torrents engine 8 years ago
Adam Tauber 629fa4355a [fix] gecko driver cannot detect the page load finish on preferences form submit. It now works with this dirty workaround.. 8 years ago
Alexander Minges 3c5883408c initial commit of pdbe engine
Adds support for queries to the Protein Data Bank Europe (PDBe).
8 years ago
Pydo 55a5b686ed Merge branch 'master' of https://github.com/asciimoo/searx into feature/seedpeer-engine-integration
Resolved conflict searx/settings.yml
8 years ago
Adam Tauber 295fc9ce96 [fix] robot test engine names II. 8 years ago
Adam Tauber bee7b497a3 [mod] rename "default" theme to "legacy" 8 years ago
marc d1d4ed4376 [fix] results with digbit don't truncate anymore 8 years ago
firebovine f67db1e107 fix tests to reflect: Wolfram|Alpha (input) response 8 years ago
marc 09ee2aa69d [fix] Result text in Wolfram|Alpha (#607) 8 years ago
Pydo ec4a03628e Put html fixture in file to be pep8 line length compliant 8 years ago
Pydo aa85045a7d Added seedpeer unitests 8 years ago
Adam Tauber 7591c8bfe3 Merge pull request #672 from kvch/self-info-paging
Self information on later pages
8 years ago
Adam Tauber 3043c404e4 Merge pull request #671 from kvch/custom-404
Custom 404 message - fixes #317
8 years ago
Noemi Vanyi aa227180e2 remove self info answers from pages after first one 8 years ago
Noemi Vanyi 0056c4035e add custom 404 page 8 years ago
Adam Tauber f693a54ad7 Merge pull request #664 from kvch/uncapitalize-searx
uncapitalize searx in templates
8 years ago
Noémi Ványi 4bd44cd98f uncapitalize searx in templates 8 years ago
Noemi Vanyi 6dd5f7a8c9 add digbt unittest 8 years ago
Adam Tauber eb57481450 [fix] google images paging - closes #571 8 years ago
marc ad58b14be7 [fix] merge infoboxes based on weight
also minor changes in attributes and images from wikidata
8 years ago
marc a0a1284998 wikidata refactor and more attributes (see issue #560) 8 years ago
Adam Tauber 350a84520d [fix] time range detection 8 years ago
Noemi Vanyi ba590de7f1 [fix] deviantart engine xpaths 8 years ago
Adam Tauber aa09f963eb Merge pull request #621 from stepshal/anomalous-backslash-in-string
Fix anomalous backslash in string
8 years ago
Adam Tauber c75d0d1532 [fix] result count tests 8 years ago
Adam Tauber f7a3e9771d Merge pull request #615 from mmuman/scanr
Add ScanR structures search engine
8 years ago