Commit Graph

328 Commits (master)

Author SHA1 Message Date
pyrrh0n1c 4340c0b16c Fixed typos. 7 years ago
Adam Tauber 00a7041daa
Merge pull request #1068 from Apply55gx/genius
Continuation of PR #1004 (seems abandoned)
7 years ago
Noémi Ványi 5954a8e16a minor fix of BASE engine 7 years ago
jibe-b df0d915806 [add] pubmed engine 7 years ago
Noémi Ványi 9c2b7a82f0 minor fixes of arxiv
Closes #1050
7 years ago
jibe-b 3e3672e079 [add] arxiv engine 7 years ago
Apply55gx d800e3fcfa Merge pull request #1 from asciimoo/master
-
7 years ago
marc 54f0ab1f3b test fetch langauges function on bing images 7 years ago
marc 44085e31d0 update engines_languages.json and languages.py
Also, fix fetch_languages.py so it can run on python3.
7 years ago
marc a524dbb823 [fix] language support for bing images and videos 7 years ago
jibe-b d081eee3f8 [add] unit_test for base engine 7 years ago
misnyo c3232b0e1a Merge branch 'master' into nyaa 7 years ago
misnyo 01330f71cd [fix] nyaa.si fixed 7 years ago
misnyo 3182ba7069 [fix] google news dom xpath fix 7 years ago
Adam Tauber e74aaa781e Merge pull request #1016 from misnyo/blekko
[mod]blekko images removed
7 years ago
misnyo 0607b167f8 [fix] faroo json api and image layout fixed 7 years ago
misnyo f139f9cfdb [mod]blekko images removed 7 years ago
misnyo bf3f9a91fa [fix]torrentz unit_tests timezone fix 7 years ago
misnyo 2098e1b7ff [fix]torrentz unit_tests timezone fix 7 years ago
misnyo d14e2781b2 [fix]torrentz search engine fixed for new version 7 years ago
woorst 636b760196 remove unicode characters 7 years ago
woorst 62b2f79ce7 fix line lengths for pep8 standards 7 years ago
woorst 2434c29dc5 New engine: Genius (lyrics) 7 years ago
marc 3ca9cad927 add bing videos engine 7 years ago
marc 856dfc3018 add google videos 7 years ago
Noémi Ványi 2242000bd4 change unresponsive_engines to a set to eliminate duplication of errors 7 years ago
Noémi Ványi 243d3e4298 show engine errors in infobox && add new error alert 7 years ago
marc 405e5c8f24 [fix] duckduckgo images doesn't fail with countryless language 7 years ago
marc 3b950929b1 [fix] fix duckduckgo's offset
First page now starts with 0 offset,
rather than starting on the 30th result.

DuckDuckGo returns 30 results on each page.
7 years ago
marc c65a409f0d add duckduckgo images engine 7 years ago
Adam Tauber 8db527c1d2 [fix] use raw response with etree.parsefromstring - Unicode strings with encoding declaration are not supported 7 years ago
marc 9ee8e552da [fix] bing images 7 years ago
Alexandre Flament f5128c7cb9 [mod] add/modify image fetching for bing_news, qwant and twitter engines 7 years ago
Adam Tauber 52e615dede [enh] py3 compatibility 7 years ago
François Revol 45d15bd6f0 Add framalibre engine
framalibre.org is a catalogue of Free Software, edited by Framasoft.

For now we pass the thumbnail as img_src as it doesn't seem to be used
for IT...
7 years ago
marc 805fb02ed1 add language support for qwant
closes issue #863
7 years ago
Alexandre Flament e67dfaaac7 Merge branch 'master' into flask_perimeter 7 years ago
Alexandre Flament 7fdfeca3a4 [mod] add a __common__ template that can't be selected but that provides a common place for shared templates.
What has been moved into this template :
* opensearch*.xml is always the same whatever the themes.
* the text inside */about.html
7 years ago
David A Roberts 1d30141c20 [enh] show spelling corrections 7 years ago
Alexandre Flament 84a2c97a65 [mod] searx uses flask framework only in webapp.py. Make migration to another framework easier. 7 years ago
Adam Tauber 6bf9c398a7 [fix] use english as default language in bing
If no language is specified, bing returns results with multiple languages
for one query which isn't really useful. Setting english as default
insted if nothing.
7 years ago
marc 1175b3906f change language list to only include languages with a minimum of engines
that support them.
users can still query lesser supported through the :lang_code bang.
7 years ago
marc af35eee10b tests for _fetch_supported_languages in engines
and refactor method to make it testable without making requests
8 years ago
marc e0c270bd72 tests for language support in engines 8 years ago
marc f62ce21f50 [mod] fetch supported languages for several engines
utils/fetch_languages.py gets languages supported by each engine and
generates engines_languages.json with each engine's supported language.
8 years ago
marc 92c6e88ad3 small fixes 8 years ago
marc a11948c71b Add language support for more engines. 8 years ago
Noémi Ványi b034356825 add year filter to engines with time range support && tests
Following engines does not support "Last year":
 * Bing News
 * DeviantArt
 * DuckDuckGo
 * Yahoo
 * YouTube (noapi)
8 years ago
Noémi Ványi c59c76e6ee add year to time range to engines which support "Last year"
Engines:
 * Bing images
 * Flickr (noapi)
 * Google
 * Google Images
 * Google News
8 years ago
Adam Tauber 9b2bd6847f [fix] 500px unit tests 8 years ago
Adam Tauber f6e9c074bb [fix] vimeo engine change follow-up 8 years ago
Adam Tauber a2c94895c1 [fix] google news engine change follow-up 8 years ago
Adam Tauber 8116e341cc [fix] kickass test html escaping 8 years ago
Adam Tauber fdf63940e8 [fix] tests ++ flickr error 8 years ago
Adam Tauber 971ed0abd1 [enh] add quick answer functionality with an example answerer 8 years ago
Adam Tauber 044809e298 [fix] search mocking in webapp test 8 years ago
Adam Tauber 16ff8d06c7 [fix] bing paging and language support
see https://msdn.microsoft.com/en-us/library/ff795620.aspx for bing
specific search operators

closes #755
8 years ago
dalf fbb080f358 Change plugin API :
- pre_search(request, search)
- post_search(request, search)
- on_result(request, search, result)

with
- request is the Flask request
- search a searx.Search instance
- result a searx result as usual
8 years ago
dalf 67e11c42b9 Clean up the architecture
Purposes :
- isolate the plugins calls
- distinction between parsing the web request and running the search (Search class). To be able to test code easily, to run searx code outside a web server, to filter the search query parameters with plugins more easily, etc...

Details :
- request.request_data contains request.form or request.args (initialize inside pre_request() function)
- Query class is renamed RawTextQuery
- SearchQuery class defines all search parameters
- get_search_query_from_webapp create a SearchQuery instance (basically the previous Search.__init__ code)
- Search class and SearchWithPlugins class takes a SearchQuery instance as class constructor parameter
- SearchWithPlugins class inherites from Search class, and run plugins
- A dedicated function search_with_plugins executes plugins to have a well define locals() (which is used by the plugins code).
- All plugins code is executed inside the try...except block (webapp.py, index function)
- advanced_search HTTP parameter value stays in webapp.py (it is only part of UI)
- multiple calls to result_container.get_ordered_results() doesn't compute the order multiple time (note : this method was call only once before)
- paging value is stored in the result_container class (compute in the extend method)
- test about engine.suspend_end_time is done during search method call (instead of __init__)
- check that the format parameter value is one of these : html, rss, json, rss (before the html value was assumed but some text formatting wasn't not done)
8 years ago
Noémi Ványi 1490d6bc93 add time range search for flickr 8 years ago
Noémi Ványi 5c02b9ef31 add time range support for bing images 8 years ago
Noémi Ványi d2e0cbafb2 add time range search for youtube noapi 8 years ago
Noémi Ványi f70d405202 add time range search for bing news 8 years ago
Noémi Ványi 53c9fde992 fix kickass torrents engine 8 years ago
Adam Tauber 629fa4355a [fix] gecko driver cannot detect the page load finish on preferences form submit. It now works with this dirty workaround.. 8 years ago
Alexander Minges 3c5883408c initial commit of pdbe engine
Adds support for queries to the Protein Data Bank Europe (PDBe).
8 years ago
Pydo 55a5b686ed Merge branch 'master' of https://github.com/asciimoo/searx into feature/seedpeer-engine-integration
Resolved conflict searx/settings.yml
8 years ago
Adam Tauber 295fc9ce96 [fix] robot test engine names II. 8 years ago
Adam Tauber bee7b497a3 [mod] rename "default" theme to "legacy" 8 years ago
marc d1d4ed4376 [fix] results with digbit don't truncate anymore 8 years ago
firebovine f67db1e107 fix tests to reflect: Wolfram|Alpha (input) response 8 years ago
marc 09ee2aa69d [fix] Result text in Wolfram|Alpha (#607) 8 years ago
Pydo ec4a03628e Put html fixture in file to be pep8 line length compliant 8 years ago
Pydo aa85045a7d Added seedpeer unitests 8 years ago
Adam Tauber 7591c8bfe3 Merge pull request #672 from kvch/self-info-paging
Self information on later pages
8 years ago
Adam Tauber 3043c404e4 Merge pull request #671 from kvch/custom-404
Custom 404 message - fixes #317
8 years ago
Noemi Vanyi aa227180e2 remove self info answers from pages after first one 8 years ago
Noemi Vanyi 0056c4035e add custom 404 page 8 years ago
Adam Tauber f693a54ad7 Merge pull request #664 from kvch/uncapitalize-searx
uncapitalize searx in templates
8 years ago
Noémi Ványi 4bd44cd98f uncapitalize searx in templates 8 years ago
Noemi Vanyi 6dd5f7a8c9 add digbt unittest 8 years ago
Adam Tauber eb57481450 [fix] google images paging - closes #571 8 years ago
marc ad58b14be7 [fix] merge infoboxes based on weight
also minor changes in attributes and images from wikidata
8 years ago
marc a0a1284998 wikidata refactor and more attributes (see issue #560) 8 years ago
Adam Tauber 350a84520d [fix] time range detection 8 years ago
Noemi Vanyi ba590de7f1 [fix] deviantart engine xpaths 8 years ago
Adam Tauber aa09f963eb Merge pull request #621 from stepshal/anomalous-backslash-in-string
Fix anomalous backslash in string
8 years ago
Adam Tauber c75d0d1532 [fix] result count tests 8 years ago
Adam Tauber f7a3e9771d Merge pull request #615 from mmuman/scanr
Add ScanR structures search engine
8 years ago
a01200356 8fc4b8156a [fix] multilingual duckduckgo
only works if both country and language are set
8 years ago
François Revol 1dba6dcbac Add ScanR structures search engine
In theory ScanR should also search for projects but the API is different,
so we'd need another engine.
8 years ago
stepshal b3ab221b98 Fix anomalous backslash in string 8 years ago
stepshal cd9b494cb5 Fix quantity of blank lines after code object. 8 years ago
François Revol b538de568a Add INA search engine 8 years ago
Adam Tauber 257e52954a [enh][fix] update to latest dependencies ++ fix tests & travis test runner
WARNING: dependency changes
8 years ago
Maxqia 56e53c9297 [fix] currency_convert: make unit tests pass
also make regex more efficent and normalize 's'es
8 years ago
a01200356 6dca14e95d [enh] multilingual duckduckgo_definitions 8 years ago
a01200356 8d335dbdae [enh] wikipedia infobox
creates simple multilingual infobox using wikipedia's api
8 years ago
Kirill Isakov d98024c26e Update Reddit unit test -- check for img_src 8 years ago
Adam Tauber 85c0351dca Merge pull request #526 from ukwt/anime
Add a few search engines
8 years ago
Kirill Isakov d54e82dfb9 Revert to using random UA in Reddit search engine 8 years ago
Adam Tauber 5544fdb756 Merge pull request #531 from guyou/add-doku-engine
Add doku engine
8 years ago
Noemi Vanyi f0fd9ad628 add unit && robot tests 8 years ago
Noemi Vanyi fe691a0988 new preferences handling
Preferences class was introduced in order to handle user preferences. Right now
it parses cookies and the form in preferences. Also it can retrieve settings
based on the name of the setting.

ATTENTION
Please note that engine preferences are handled differently from now on. So it
introduces incompatible changes. Every user who has saved preferences should reset and
save his/her settings again.

This change was needed, because everytime a default disabled engine was
added saved user preferences would broke. Now engine setting tracking is
fixed.
8 years ago
Adam Tauber 9331fc28a8 [fix] broken google images parsing 8 years ago
Guilhem Bonnefille bb29a910f2 Fix pep8 about too long lines
Code is refactored and example data are truncated.
8 years ago
Guilhem Bonnefille cf09b500f3 Add support for dokuwiki engine 8 years ago
Kirill Isakov d0001f10e6 Add searx user agent to Reddit engine request to comply with API usage terms 8 years ago
Kirill Isakov c1d456b136 Add F-Droid search engine 8 years ago
Kirill Isakov 547b8a8765 Add Tokyo Toshokan search engine 8 years ago
Adam Tauber 71de593a5b [fix] bing images page change 8 years ago
Kirill Isakov 7fbc12ee4e Add Torrentz.eu search engine 8 years ago
Kirill Isakov d026a97e42 Add Reddit search engine 8 years ago
Kirill Isakov 8b7dc2acb9 Remove content field from ArchWiki results; reformat code in archlinux.py
Content field in Arch Wiki search results is of no real use, more often
than not it contains no usable information and includes too many markup
tags which make the text unreadable. It is safe to remove it.
8 years ago
Kirill Isakov e5677ae6b6 Add Nyaa.se search engine 8 years ago
Kirill Isakov d748b8419a Add Arch Linux Wiki search engine 8 years ago
a01200356 751c9a346e [fix] duckduckgo's xpaths changed
test_duckduckgo modified to reflect changes in duckduckgo's html
8 years ago
a01200356 8f3b33de23 [fix] remove unnecesary async calls in wolframalpha_noapi
setting async to false in the request did the job, lol.
8 years ago
a01200356 4d8996eb4d [enh] unit tests for wolframalpha 8 years ago
Adam Tauber d06178139f [fix] wolframalpha page changes
related issues: #508 #509
8 years ago
Noemi Vanyi baf16b8869 better test data 8 years ago
Noemi Vanyi 3034c85163 fix pep8 errors 8 years ago
Noemi Vanyi 33fa3da2e8 add Frinkiac engine & tests 8 years ago
Adam Tauber 0491b78f70 [fix] pep8 8 years ago
Adam Tauber 33ff1de9be [fix] missing gigablast tests 8 years ago
Adam Tauber ebbf33343a [fix] bing images changes 8 years ago
a01200356 c2e034f52a move two tests 8 years ago
Adam Tauber 53979a7bf7 [mod] remove buildout/makefile infrastructure 8 years ago