Commit Graph

46 Commits (8fef62d46ee7b3fe708879c57ea0c8db8a7b6afb)

Author SHA1 Message Date
nemobis 0eeb6bfcb0
Upload all relevant wikidump.7z and history.xml.7z
Don't stop at the first 7z file found in the directory listing.
Should be fast enough for most users.

Fixes #326
4 years ago
Federico Leva 4351e09d80 uploader.py: respect --admin in collection 6 years ago
Federico Leva d07a14cbce New version of uploader.py with possibility of separate directory
Also much faster than using os.walk, which lists all the images
in all wikidump directories.
6 years ago
emijrp 5db991bfbb now it updates the metadata 9 years ago
emijrp 6651618def 2016, link to tutorial, print 9 years ago
PiRSquared17 6b2c5a6915 Fix license URL, misc. 9 years ago
PiRSquared17 109528384b Save and upload logos in uploader.py 9 years ago
PiRSquared17 cb005516b2 Set verbose=True for upload
This makes it show progress.
9 years ago
PiRSquared17 905511f996 Port uploader.py to use internetarchive package
Remove curl stuff and replace with internetarchive pip package (or https://github.com/jjjake/ia-wrapper) API
9 years ago
Emilio J. Rodríguez-Posada 9681fdfd14 linking to GitHub 10 years ago
nemobis ac4c93c12a Issue 85: more cross-platform shebang on all scripts
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@962 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
10 years ago
nemobis 53236811d9 Also reupload the dump when verified missing
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@945 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
nemobis a3fe96b782 Revamp uploader.py for wider usage: move issues to tracker; add options --help, --prune-directories, --prune-wikidump, --admin
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@940 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
nemobis b74d6f79ce Reduce requests for existing items and remove whitespace: tested with wiki-smackdownneoseekercom_w
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@939 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
nemobis a358ffbfe0 Issue 88: Escaped a bit too much, some HTML we really need
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@936 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
nemobis c95465ac14 Nice to see curl progress, but only for actual upload
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@935 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
nemobis 0ef0a5b229 Actually update last-updated-date
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@934 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
nemobis 991b96fbe2 Mark dump uploaded only if confirmed by curl exit code
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@931 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
nemobis 7c4cb64859 Revert r874: breaks backwards compatibility, no usecase provided
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@883 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
Hydriz 0dd9c5f299 Follow up r874, forgot to uncomment accesskey and secretkey after testing
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@879 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
Hydriz 8680a55e24 Fix identifier name so that it can be more human-readable and backward compatible
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@874 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
nemobis ad5d468824 Add some documentation; would need a proper --help
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@846 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
nemobis cb77d8738d TODO: bug - translate relative copyright URLs as in http://archive.org/details/wiki-wikipovrayorg now linking http://archive.org/content/POV-Wiki:Copyrights
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@776 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 7bbc0aa387 maybe it's something else
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@752 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 22a163c183 more todos
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@751 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 953cfbfc8a Added some todos.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@750 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 10a9ed4df7 uploader: lang parameter
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@746 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp d5ae56bd24 uploader
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@745 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp f62e2686de uploader
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@744 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 277d9a9ec9 uploader
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@740 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 8c2cfa80e9 uploader
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@739 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 6bdd1a492c uploader
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@738 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp d61ea1b77d uploader
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@737 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp bc24877a72 uploader
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@736 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 1d972d10d8 git-svn-id: https://wikiteam.googlecode.com/svn/trunk@731 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95 12 years ago
Hydriz b8b2dbcf4a Moving the collection parameter to the top of the script so as to allow the user to easily configure that setting.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@666 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis cc459f1685 identifier pattern for the record
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@653 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
Hydriz a8f2cb283b Adding comments and making file look nicer. The response to archive.org's S3 is okay though
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@647 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 1aebf77afa error
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@632 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis fd219ecb8d Some missing apex; more comments.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@631 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 53f075c089 working on the uploader to Internet Archive S3
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@617 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 55c44d45b4 working on the uploader to Internet Archive S3
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@616 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 7a510850e5 working on the uploader to Internet Archive S3
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@615 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 7cdf391b74 working on the uploader to Internet Archive S3; launcher.py now do not explore subdirectories, just the current one '.'
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@613 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 83ff174888 working on the uploader to Internet Archive S3
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@612 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 06d0ffc32e working on the uploader to Internet Archive S3
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@611 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago