Commit Graph

148 Commits (d24e7948ebd8aaa25a1907c225e1d2d3de37c17c)

Author SHA1 Message Date
Dalf 6e0285b2db [fix] wikidata engine: faster processing, remove one HTTP redirection.
* Search URL is https://www.wikidata.org/w/index.php?{query}&ns0=1 (with ns0=1 at the end to avoid an HTTP redirection)
* url_detail: remove the disabletidy=1 deprecated parameter
* Add eval_xpath function: compile once for all xpath.
* Add get_id_cache: retrieve all HTML with an id, avoid the slow to procress dynamic xpath '//div[@id="{propertyid}"]'.replace('{propertyid}')
* Create an etree.HTMLParser() instead of using the global one (see #1575)
5 years ago
Frank de Lange cbc5e13275 [enh] flickr_noapi: use complete JSON data block, add 'content', 'img_format', 'source', etc. (#1571)
Fetch complete JSON data block, use legend to extract images. 
Unquote urlencoded strings.
Add image description as 'content'. 
Add 'img_format' and 'source' data (needs PR #1567 to enable this data to be displayed). 
Show images which lack ownerid instead of discarding them.
5 years ago
Frank de Lange 204a2cbbf0 [fix] bing_videos (#1579)
use JSON where possible, compose 'content' using all available data, use correct 'url' (direct to source instead of redirect through bing)
5 years ago
Frank de Lange 11fc9913e9 [enh] bing_images: use data from embedded JSON to improve results (e.g. real page title) (#1568)
use data from embedded JSON to improve results (e.g. real page title), add image format and source info (see PR #1567), improve paging logic (it now works)
5 years ago
volth eb182df132 [mod] restore btdigg engine as btdig.com (#1515) 5 years ago
rachmadani haryono 3b1122c5fa [fix] fix duden engine (#1594) 5 years ago
Dalf ffe0972f91 Remove some engines : subtitleseeker, seedpeer, swisscows
http://www.subtitleseeker.com and http://www.seedpeer.eu don't exist anymore.
https://swisscows.ch/ has change : the engine needs to be updated
5 years ago
Marc Abonce Seguin 3e1c2153f7 [fix] duckduckgo images requests 6 years ago
Marc Abonce Seguin f2d49a6971 [fix] get youtube results from js object
Results are not appearing in the html document anymore,
instead they are found inside an object embedded in a script.
6 years ago
d-tux f1814079f0
Merge branch 'master' into engines/unsplash 6 years ago
Marc Abonce Seguin 626a8e9ac9 [fix] unicode error with WolframAlpha API engine 6 years ago
d-tux 329172f66e
Merge branch 'master' into engines/unsplash 6 years ago
Noémi Ványi 97351a2c72 fix after rebase 6 years ago
Noémi Ványi b63d645a52 Revert "remove 'all' option from search languages"
This reverts commit 4d1770398a.
6 years ago
Marc Abonce Seguin 0169b63e84 [fix] fetch google's supported languages 6 years ago
Marc Abonce Seguin 5568f24d6c [fix] check language aliases when setting search language 6 years ago
Noémi Ványi 1ea56576dc
Merge branch 'master' into devel_google_videos 6 years ago
Noémi Ványi 5b81f7c2cc
Merge branch 'master' into bugfix_startpage 6 years ago
Venca24 0e493db2fb [fix] google videos test 6 years ago
Léo Bourrel 73ec2ba74e Update bing image engine with new image json format 6 years ago
Michael Pfitzner 83a06d276d change rest of test_startpage.py 6 years ago
Michael Pfitzner 5a20d9ecd1 change the html in test_startpage.py to look more like the actual startpage site 6 years ago
Venca24 cee15f0375 [fix] google videos test 6 years ago
Denis Wernert b9ada93b3a Removes what looks like tracking parameters 6 years ago
Denis Wernert ee07a5e750 Adds a unit test for the unsplash engine 6 years ago
Adam Tauber baacfac32b [fix] remove publicly unavailable 500px engine - #1338 6 years ago
dadosch b575f898c0 duden.de engine 6 years ago
Léo Bourrel 0a37f90990 Fix wikidata tests with updated path to media 6 years ago
Adam Tauber a3b83b73cb [fix] remove obsolete test 6 years ago
Noémi Ványi 7fd7bd75ff follow up tests 6 years ago
rinpatch 059c2ccb95
Fix acgsou encoding error on python2 and add unicode characters to unit testt 7 years ago
rinpatch b7eb05dac6
Fix unit test url 7 years ago
rinpatch a79c676f27
Remove Japanese characters 7 years ago
rinpatch 1ac0c90037
Fix unit test 7 years ago
rinpatch dcc9fdb47f
Added unit test 7 years ago
rinpatch 06e070aee2 Fix string length 7 years ago
rinpatch c40d8e1d15 Unit test 7 years ago
Marc Abonce Seguin f7f9c50393 [fix] force English results in Google when using en-US 7 years ago
Marc Abonce Seguin 9687786226 update unit tests for google news and wikidata 7 years ago
Marc Abonce Seguin 772c048d01 refactor engine's search language handling
Add match_language function in utils to match any user given
language code with a list of engine's supported languages.

Also add language_aliases dict on each engine to translate
standard language codes into the custom codes used by the engine.
7 years ago
Noémi Ványi 3ef8533f4d fix unit tests 7 years ago
marc 4d1770398a remove 'all' option from search languages 7 years ago
Adam Tauber 9e79ad4bde [fix] pdbe test 7 years ago
Adam Tauber 060c797739 [fix] change domain name in google engine test 7 years ago
pyrrh0n1c a1d1a50149 Fixed unittests. 7 years ago
pyrrh0n1c 4340c0b16c Fixed typos. 7 years ago
Adam Tauber 00a7041daa
Merge pull request #1068 from Apply55gx/genius
Continuation of PR #1004 (seems abandoned)
7 years ago
Noémi Ványi 5954a8e16a minor fix of BASE engine 7 years ago
jibe-b df0d915806 [add] pubmed engine 7 years ago
Noémi Ványi 9c2b7a82f0 minor fixes of arxiv
Closes #1050
7 years ago