Commit Graph

926 Commits (v0.17.0)

Author SHA1 Message Date
Dalf ffe0972f91 Remove some engines : subtitleseeker, seedpeer, swisscows
http://www.subtitleseeker.com and http://www.seedpeer.eu don't exist anymore.
https://swisscows.ch/ has change : the engine needs to be updated
5 years ago
Alexandre Flament df2b9a76f7
Merge branch 'master' into ne/fix-google-image-search 5 years ago
Nick Espig 1c6ab79b9f
Fix google image search
- Because there is not full image url in the dom, we replace "image_url" with the same url as the "url" (url of source).
  See example HTML https://gist.github.com/Nachtalb/2dea8a4d2c723c49226ad9645838121f
- Remove unused import
- Fix google image search title
- Keep google image safe value up to date
5 years ago
Marc Abonce Seguin 3e1c2153f7 [fix] duckduckgo images requests 5 years ago
Marc Abonce Seguin f2d49a6971 [fix] get youtube results from js object
Results are not appearing in the html document anymore,
instead they are found inside an object embedded in a script.
5 years ago
Jonas Zohren f7bdd827c4 [enh] adds apkmirror search engine 5 years ago
Léo Bourrel bf4a38ad66 Remove asksteem 6 years ago
d-tux f1814079f0
Merge branch 'master' into engines/unsplash 6 years ago
Marc Abonce Seguin 626a8e9ac9 [fix] unicode error with WolframAlpha API engine 6 years ago
d-tux 329172f66e
Merge branch 'master' into engines/unsplash 6 years ago
Noémi Ványi 97351a2c72 fix after rebase 6 years ago
Noémi Ványi b63d645a52 Revert "remove 'all' option from search languages"
This reverts commit 4d1770398a.
6 years ago
Marc Abonce Seguin 0169b63e84 [fix] fetch google's supported languages 6 years ago
Marc Abonce Seguin 51111c2594 [fix] always set langauge_aliases even if it's empty 6 years ago
Marc Abonce Seguin 5568f24d6c [fix] check language aliases when setting search language 6 years ago
Venca24 2456b8f571 [mod] google videos 6 years ago
Noémi Ványi 1ea56576dc
Merge branch 'master' into devel_google_videos 6 years ago
Noémi Ványi aeb6dab187
Merge branch 'master' into master 6 years ago
Noémi Ványi 5b81f7c2cc
Merge branch 'master' into bugfix_startpage 6 years ago
Venca24 cf26aba93b [FIX] google videos thumbnails 6 years ago
Léo Bourrel 73ec2ba74e Update bing image engine with new image json format 6 years ago
Michael Pfitzner 44ce51f0c5 restore startpage search results 6 years ago
d-tux 4a127b19de
Merge branch 'master' into engines/unsplash 6 years ago
dimqua 0d86ed9c7e update startpage.py 6 years ago
dimqua 442772a6c5 remove findx engine (#1452) 6 years ago
Venca24 0bdf090ed7 [fix] google videos engine 6 years ago
Denis Wernert b9ada93b3a Removes what looks like tracking parameters 6 years ago
Denis Wernert 72d063d27d Uses the raw url for the image result, rather than the full
size result.
6 years ago
Denis Wernert cd7849ffc8 Adds the Unsplash image engine 6 years ago
Adam Tauber 052a71d05a
Merge pull request #1368 from aliceinwire/gentoo_engine
Add Gentoo wiki search engine
6 years ago
Alice Ferrazzi d24c58cf4e Fix pep8 errors 6 years ago
Alice Ferrazzi ff2eac9f6b Fix choosing languges function
Searching for english is now giving all pages results.
Instead searching for a specific language different from english
is correctly returning only translated pages for the selected language.
6 years ago
Adam Tauber baacfac32b [fix] remove publicly unavailable 500px engine - #1338 6 years ago
dadosch b575f898c0 duden.de engine 6 years ago
Adam Tauber 845ba79e75 [fix] update qwant search url
thx to @dalf for the fix (#1365)
6 years ago
Alice Ferrazzi 5f0888b8f4 added languages to Gentoo engine 6 years ago
Alice Ferrazzi b7886bb15c gentoo engine test 6 years ago
Adam Tauber d51732c0e5
Merge pull request #1303 from MarcAbonce/bing
Fix bing "garbage" results
6 years ago
Léo Bourrel 7a474db61b Fix formatting 6 years ago
Léo Bourrel acaef6600e Update path to wikidata image 6 years ago
Adam Tauber f82ead3e30 [fix] add py3 compatibility to base engine - closes #1319 6 years ago
Adam Tauber 57e7e9da98 [fix] use html result page in google images (previous endpoint stopped working) 6 years ago
Noémi Ványi 16915116e0 fix piratebay url
Closes #1229
6 years ago
Marc Abonce Seguin 75b276f408 fix bing "garbage" results (issue #1275) 6 years ago
Noémi Ványi b843c1351a add missing parameter to gigablast search url
Closes #1293
6 years ago
rinpatch 059c2ccb95
Fix acgsou encoding error on python2 and add unicode characters to unit testt 6 years ago
rinpatch 3b89ce9bfa
Switch acgsou to http 6 years ago
Adam Tauber 1a1f9852f1
Merge pull request #1283 from rinpatch/acgsou-engine
[Feature] Acgsou as a searchable engine
6 years ago
rinpatch f6695cea59
Fix nyaa to use https 6 years ago
rinpatch f17e54a396
Forgot to remove print command used for debugging 6 years ago
rinpatch dcc9fdb47f
Added unit test 6 years ago
rinpatch e3bd2670d7
Traling whitespace 6 years ago
rinpatch 86f47689fe
Hopefully fix code style errors(again)(again) 6 years ago
rinpatch b8b23d8006
Hopefully fix code style errors(again) 6 years ago
rinpatch fb364ffae7
Hopefully fix code style errors 6 years ago
rinpatch 3ec35a06f7
Added Engine 6 years ago
rinpatch cd1374d2f2 added whitespaces 6 years ago
rinpatch a305dae9d8 switched currency convert to duckduckgo and added Bitcoin to currency list 6 years ago
Noémi Ványi 25b48143ea fix findx engine 6 years ago
Marc Abonce Seguin f7f9c50393 [fix] force English results in Google when using en-US 6 years ago
Marc Abonce Seguin b12857a70d [fix] make search requests on wikidata more accurate 6 years ago
Marc Abonce Seguin 835d1edd58 [fix] google news xpath 6 years ago
Marc Abonce Seguin 343e555ee9 [fix] append http if no scheme is provided in xpath's extact_url
This solves a bug with Yahoo where some results don't specify
a protocol.
6 years ago
Adam Tauber 283f6c9053
Merge pull request #1252 from MarcAbonce/search-languages
[mod] Refactor engine's search language handling
6 years ago
Marc Abonce Seguin 772c048d01 refactor engine's search language handling
Add match_language function in utils to match any user given
language code with a list of engine's supported languages.

Also add language_aliases dict on each engine to translate
standard language codes into the custom codes used by the engine.
6 years ago
Noémi Ványi 8cc529e9a3 forward category to engine without highlighting on the ui 6 years ago
Noémi Ványi d04e471ce5 add findx engine for general, images and videos 6 years ago
Marc Abonce Seguin d1eae9359f fix fetch_langauges to be more accurate
Add languages supported by either all default general engines or 10 engines.
6 years ago
Marc Abonce Seguin 216716db70 [fix] change duckduckgo url to avoid error response 6 years ago
Adam Tauber 03d7a8f065 [fix] pep8 6 years ago
Adam Tauber b4c657d227 [enh] add asksteem engine - closes #1163 6 years ago
Noémi Ványi 988cf38196 fix Microsoft Academic engine 6 years ago
Adam Tauber 2f69eaeb2f [fix] fix engine initialization 6 years ago
Noémi Ványi c645915171 fix bing videos engine 6 years ago
Marc Abonce Seguin 829032f306 [fix] read utf-8 files (settings, languages, currency) with python3.5
Related to discussion in #1124
The io.open import is necessary for python2
7 years ago
Adam Tauber 8511e64f35
Merge pull request #1124 from JosephKiranBabu/python3-unicode-support
Make Python 3 able to read settings files with Unicode characters
7 years ago
Noémi Ványi f3aa5ea47d fix yacy result url
Closes #1064
7 years ago
Joseph Nuthalapati bdc803e185
Make Python 3 able to read settings files with Unicode characters
SearX currently doesn't start up when run with Python 3 as it tries to parse the
settings.yml file with ASCII codecs.
There are similar problems with engines_languages.json and currencies.json
Python 3 requires that files with Unicode characters be read with a 'b' flag.
This also works with Python 2 and hence can be integrated into the main source
code.

Tested with the latest Python 3.6.4rc1 on Debian unstable.

Signed-off-by: Joseph Nuthalapati <njoseph@thoughtworks.com>
7 years ago
Noémi Ványi 2d5eed9b59 send constant cookie with query to Google 7 years ago
Adam Tauber 7752b0a807 [fix] gigablast url parameter change - fixes #1107 7 years ago
marc 4d1770398a remove 'all' option from search languages 7 years ago
Adam Tauber 1613c6319e [fix] handle /sorry redirects 7 years ago
Adam Tauber 1088c2a75d [fix] do not crash if publication date is missing in pubmed engine 7 years ago
Adam Tauber 801b5a56ad [fix] multiple fixes in pdbe engine 7 years ago
Adam Tauber 0969e50c5b [fix] convert json engine result attributes to string - closes #1006 7 years ago
Adam Tauber 6eb9503896 [fix] use english in google engine if no language was set - this prevents guessing the language by the IP of the instance 7 years ago
Adam Tauber 6fdb6640d9 [fix] revert language changes to prevent CAPTCHAs 7 years ago
Adam Tauber 9ab8536479 [fix] fix language support of google 7 years ago
pyrrh0n1c 4340c0b16c Fixed typos. 7 years ago
pyrrh0n1c 2231b02add Fixed the currency_convert engine. 7 years ago
Adam Tauber 00a7041daa
Merge pull request #1068 from Apply55gx/genius
Continuation of PR #1004 (seems abandoned)
7 years ago
Adam Tauber 7a9b18e9e9 [mod] add more error handling to json engine II. 7 years ago
Adam Tauber 181f1c6305 [mod] add more error handling to json engine 7 years ago
Noémi Ványi 5954a8e16a minor fix of BASE engine 7 years ago
Noémi Ványi d20bba6dc7 minor fixes of pubmed engine
Closes #1045
7 years ago
jibe-b df0d915806 [add] pubmed engine 7 years ago
Noémi Ványi 9c2b7a82f0 minor fixes of arxiv
Closes #1050
7 years ago
jibe-b e391b2d970 [fix] remove .encode for python3 compatibility 7 years ago
jibe-b 5278fa666c [enh] use format to concatenate strings 7 years ago
jibe-b 3e3672e079 [add] arxiv engine 7 years ago
Apply55gx d800e3fcfa Merge pull request #1 from asciimoo/master
-
7 years ago
Apply55gx 18a4e7035f removed unused indicies array 7 years ago
marc 44085e31d0 update engines_languages.json and languages.py
Also, fix fetch_languages.py so it can run on python3.
7 years ago
marc a524dbb823 [fix] language support for bing images and videos 7 years ago
misnyo 33fd938016 [mod] int_or_zero refactored to searx_utils 7 years ago
misnyo c3232b0e1a Merge branch 'master' into nyaa 7 years ago
Adam Tauber 234366b900 Merge pull request #1018 from misnyo/generalfile
[mod]generalfile engine removed
7 years ago
Adam Tauber c505c3c1ca Merge pull request #1019 from misnyo/gigablast
[fix] gigablast api fix
7 years ago
misnyo b91772eff1 [fix] gigablast pep8 fix 7 years ago
misnyo 01330f71cd [fix] nyaa.si fixed 7 years ago
misnyo 1e2b60f380 [mod] tokyotoshokan dependecy to other engine removed 7 years ago
misnyo 3182ba7069 [fix] google news dom xpath fix 7 years ago
misnyo 8849606e5f [fix] gigablast api fix 7 years ago
misnyo 2d66df0548 [mod]generalfile engine removed 7 years ago
Adam Tauber e74aaa781e Merge pull request #1016 from misnyo/blekko
[mod]blekko images removed
7 years ago
Adam Tauber 610117d054 Merge pull request #1015 from misnyo/digg
[fix] digg now requires cookie for search
7 years ago
misnyo 6e92fb383a [fix] digg cookie characters created in module import 7 years ago
misnyo 20d2d4dab1 [fix] pep8 fix for faroo engine 7 years ago
misnyo 0607b167f8 [fix] faroo json api and image layout fixed 7 years ago
misnyo a49cc18f9c [fix] digg now requires cookie for search 7 years ago
misnyo f139f9cfdb [mod]blekko images removed 7 years ago
misnyo d14e2781b2 [fix]torrentz search engine fixed for new version 7 years ago
woorst 2434c29dc5 New engine: Genius (lyrics) 7 years ago
marc 3ca9cad927 add bing videos engine 7 years ago
marc 856dfc3018 add google videos 7 years ago
Adam Tauber 077d8efed8 [fix] use poolrequests in ddg engines 7 years ago
Adam Tauber 0f6612bb40 [mod] separate engine load and initialization 7 years ago
Adam Tauber 1794f6a4d3 [enh] add "inactive" attribute to engines
This modification allows us to deactivate engines in settings.yml
without commenting them out
7 years ago
marc 405e5c8f24 [fix] duckduckgo images doesn't fail with countryless language 7 years ago
potato 9b82cb1908 [fix] is_valid_lang fixed for new languages.py + dictzone engine encoding 7 years ago
vache asatryan 5835ebf955 fix github url 7 years ago
Noémi Ványi c361811cb5 [fix] fix xpath of google images 7 years ago
Adam Tauber 343ac7197d [fix] pep8 7 years ago
Adam Tauber 78365ffb8a [enh] add init function to engines which loads parallel 7 years ago
marc 3b950929b1 [fix] fix duckduckgo's offset
First page now starts with 0 offset,
rather than starting on the 30th result.

DuckDuckGo returns 30 results on each page.
7 years ago
marc c65a409f0d add duckduckgo images engine 7 years ago
Adam Tauber 1972a044a3 [fix] produce valid urls if scheme is missing 7 years ago
Adam Tauber 8db527c1d2 [fix] use raw response with etree.parsefromstring - Unicode strings with encoding declaration are not supported 7 years ago
Adam Tauber a4f7046b8f [fix] pep8 7 years ago
Noémi Ványi 2a9339f4b7 [fix] add more description on possible search tpyes 7 years ago
Noémi Ványi 2db807368c [enh] make search type of mediawiki configurable 7 years ago
marc 9ee8e552da [fix] bing images 7 years ago
Dalf c233bf0df9 [fix] framalibre : remove result['thumbnail'] (not used) 7 years ago
Alexandre Flament f5128c7cb9 [mod] add/modify image fetching for bing_news, qwant and twitter engines 7 years ago
Adam Tauber 52e615dede [enh] py3 compatibility 7 years ago
Adam Tauber 46a2c63f8e [fix] yahoo news date parsing 7 years ago
Alexandre Flament 12d91c1d67 [mod] searx doesn't crash at startup when an engine can't be loaded (see #884) 7 years ago
François Revol 45d15bd6f0 Add framalibre engine
framalibre.org is a catalogue of Free Software, edited by Framasoft.

For now we pass the thumbnail as img_src as it doesn't seem to be used
for IT...
7 years ago
marc fd65c12921 make search language handling less strict
languages.py can change, so users may query on a language that is not
on the list anymore, even if it is still recognized by a few engines.

also made no and nb the same because they seem to return the same,
though most engines will only support one or the other.
7 years ago
marc 805fb02ed1 add language support for qwant
closes issue #863
7 years ago