Federico Leva
3ddfa85391
uploader.py: Handle protocol-relative base URL
...
Fixes https://github.com/WikiTeam/wikiteam/issues/376
5 years ago
Federico Leva
aabf3ea037
uploader.py: switch to requests, BytesIO, rights API
...
* Now uploads the logo again, at least in standard or Wikia skin.
* Finds license information more often.
* Translates Wikia license URL.
* More specific error reporting.
5 years ago
Federico Leva
e194077e52
uploader.py: Use requests GET, handle Wikia weird URLs
...
POST requests with urllib were getting empty responses from Wikia.
5 years ago
nemobis
0eeb6bfcb0
Upload all relevant wikidump.7z and history.xml.7z
...
Don't stop at the first 7z file found in the directory listing.
Should be fast enough for most users.
Fixes #326
5 years ago
Federico Leva
4351e09d80
uploader.py: respect --admin in collection
6 years ago
Federico Leva
d07a14cbce
New version of uploader.py with possibility of separate directory
...
Also much faster than using os.walk, which lists all the images
in all wikidump directories.
6 years ago
emijrp
5db991bfbb
now it updates the metadata
9 years ago
emijrp
6651618def
2016, link to tutorial, print
9 years ago
PiRSquared17
6b2c5a6915
Fix license URL, misc.
10 years ago
PiRSquared17
109528384b
Save and upload logos in uploader.py
10 years ago
PiRSquared17
cb005516b2
Set verbose=True for upload
...
This makes it show progress.
10 years ago
PiRSquared17
905511f996
Port uploader.py to use internetarchive package
...
Remove curl stuff and replace with internetarchive pip package (or https://github.com/jjjake/ia-wrapper ) API
10 years ago
Emilio J. Rodríguez-Posada
9681fdfd14
linking to GitHub
10 years ago
nemobis
ac4c93c12a
Issue 85: more cross-platform shebang on all scripts
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@962 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
nemobis
53236811d9
Also reupload the dump when verified missing
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@945 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
nemobis
a3fe96b782
Revamp uploader.py for wider usage: move issues to tracker; add options --help, --prune-directories, --prune-wikidump, --admin
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@940 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
nemobis
b74d6f79ce
Reduce requests for existing items and remove whitespace: tested with wiki-smackdownneoseekercom_w
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@939 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
nemobis
a358ffbfe0
Issue 88: Escaped a bit too much, some HTML we really need
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@936 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
nemobis
c95465ac14
Nice to see curl progress, but only for actual upload
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@935 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
nemobis
0ef0a5b229
Actually update last-updated-date
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@934 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
nemobis
991b96fbe2
Mark dump uploaded only if confirmed by curl exit code
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@931 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
nemobis
7c4cb64859
Revert r874: breaks backwards compatibility, no usecase provided
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@883 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
Hydriz
0dd9c5f299
Follow up r874, forgot to uncomment accesskey and secretkey after testing
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@879 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
Hydriz
8680a55e24
Fix identifier name so that it can be more human-readable and backward compatible
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@874 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
nemobis
ad5d468824
Add some documentation; would need a proper --help
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@846 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
nemobis
cb77d8738d
TODO: bug - translate relative copyright URLs as in http://archive.org/details/wiki-wikipovrayorg now linking http://archive.org/content/POV-Wiki:Copyrights
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@776 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis
7bbc0aa387
maybe it's something else
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@752 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis
22a163c183
more todos
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@751 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis
953cfbfc8a
Added some todos.
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@750 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp
10a9ed4df7
uploader: lang parameter
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@746 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp
d5ae56bd24
uploader
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@745 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp
f62e2686de
uploader
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@744 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp
277d9a9ec9
uploader
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@740 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp
8c2cfa80e9
uploader
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@739 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp
6bdd1a492c
uploader
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@738 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp
d61ea1b77d
uploader
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@737 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp
bc24877a72
uploader
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@736 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp
1d972d10d8
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@731 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
Hydriz
b8b2dbcf4a
Moving the collection parameter to the top of the script so as to allow the user to easily configure that setting.
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@666 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
nemobis
cc459f1685
identifier pattern for the record
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@653 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
Hydriz
a8f2cb283b
Adding comments and making file look nicer. The response to archive.org's S3 is okay though
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@647 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
nemobis
1aebf77afa
error
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@632 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
nemobis
fd219ecb8d
Some missing apex; more comments.
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@631 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp
53f075c089
working on the uploader to Internet Archive S3
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@617 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp
55c44d45b4
working on the uploader to Internet Archive S3
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@616 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp
7a510850e5
working on the uploader to Internet Archive S3
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@615 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp
7cdf391b74
working on the uploader to Internet Archive S3; launcher.py now do not explore subdirectories, just the current one '.'
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@613 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp
83ff174888
working on the uploader to Internet Archive S3
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@612 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp
06d0ffc32e
working on the uploader to Internet Archive S3
...
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@611 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago