Commit Graph

56 Commits (master)

Author SHA1 Message Date
yzqzss d7153f4c60
Update uploader.py 1 year ago
Liu 3638e6992f Simplify tracking item identifier 2 years ago
Liu 94eb932b3f Display appended-date IA URL if appended 2 years ago
Liu d947d7571a Allow date append only if not admin 2 years ago
Liu 9f9df1e0aa Update logic to only append date if identifier without date exists 2 years ago
Liu 6c137764cb Move identifier-date option behind flag 2 years ago
Liu 990d5dfb4f Add dump date to item identifier 2 years ago
Federico Leva 3ddfa85391 uploader.py: Handle protocol-relative base URL
Fixes https://github.com/WikiTeam/wikiteam/issues/376
4 years ago
Federico Leva aabf3ea037 uploader.py: switch to requests, BytesIO, rights API
* Now uploads the logo again, at least in standard or Wikia skin.
* Finds license information more often.
* Translates Wikia license URL.
* More specific error reporting.
4 years ago
Federico Leva e194077e52 uploader.py: Use requests GET, handle Wikia weird URLs
POST requests with urllib were getting empty responses from Wikia.
4 years ago
nemobis 0eeb6bfcb0
Upload all relevant wikidump.7z and history.xml.7z
Don't stop at the first 7z file found in the directory listing.
Should be fast enough for most users.

Fixes #326
4 years ago
Federico Leva 4351e09d80 uploader.py: respect --admin in collection 6 years ago
Federico Leva d07a14cbce New version of uploader.py with possibility of separate directory
Also much faster than using os.walk, which lists all the images
in all wikidump directories.
6 years ago
emijrp 5db991bfbb now it updates the metadata 8 years ago
emijrp 6651618def 2016, link to tutorial, print 8 years ago
PiRSquared17 6b2c5a6915 Fix license URL, misc. 9 years ago
PiRSquared17 109528384b Save and upload logos in uploader.py 9 years ago
PiRSquared17 cb005516b2 Set verbose=True for upload
This makes it show progress.
9 years ago
PiRSquared17 905511f996 Port uploader.py to use internetarchive package
Remove curl stuff and replace with internetarchive pip package (or https://github.com/jjjake/ia-wrapper) API
9 years ago
Emilio J. Rodríguez-Posada 9681fdfd14 linking to GitHub 10 years ago
nemobis ac4c93c12a Issue 85: more cross-platform shebang on all scripts
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@962 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
10 years ago
nemobis 53236811d9 Also reupload the dump when verified missing
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@945 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
10 years ago
nemobis a3fe96b782 Revamp uploader.py for wider usage: move issues to tracker; add options --help, --prune-directories, --prune-wikidump, --admin
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@940 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
10 years ago
nemobis b74d6f79ce Reduce requests for existing items and remove whitespace: tested with wiki-smackdownneoseekercom_w
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@939 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
10 years ago
nemobis a358ffbfe0 Issue 88: Escaped a bit too much, some HTML we really need
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@936 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
10 years ago
nemobis c95465ac14 Nice to see curl progress, but only for actual upload
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@935 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
10 years ago
nemobis 0ef0a5b229 Actually update last-updated-date
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@934 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
10 years ago
nemobis 991b96fbe2 Mark dump uploaded only if confirmed by curl exit code
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@931 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
10 years ago
nemobis 7c4cb64859 Revert r874: breaks backwards compatibility, no usecase provided
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@883 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
Hydriz 0dd9c5f299 Follow up r874, forgot to uncomment accesskey and secretkey after testing
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@879 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
Hydriz 8680a55e24 Fix identifier name so that it can be more human-readable and backward compatible
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@874 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
nemobis ad5d468824 Add some documentation; would need a proper --help
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@846 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
11 years ago
nemobis cb77d8738d TODO: bug - translate relative copyright URLs as in http://archive.org/details/wiki-wikipovrayorg now linking http://archive.org/content/POV-Wiki:Copyrights
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@776 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 7bbc0aa387 maybe it's something else
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@752 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 22a163c183 more todos
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@751 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 953cfbfc8a Added some todos.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@750 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 10a9ed4df7 uploader: lang parameter
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@746 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp d5ae56bd24 uploader
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@745 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp f62e2686de uploader
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@744 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 277d9a9ec9 uploader
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@740 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 8c2cfa80e9 uploader
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@739 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 6bdd1a492c uploader
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@738 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp d61ea1b77d uploader
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@737 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp bc24877a72 uploader
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@736 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 1d972d10d8 git-svn-id: https://wikiteam.googlecode.com/svn/trunk@731 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95 12 years ago
Hydriz b8b2dbcf4a Moving the collection parameter to the top of the script so as to allow the user to easily configure that setting.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@666 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis cc459f1685 identifier pattern for the record
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@653 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
Hydriz a8f2cb283b Adding comments and making file look nicer. The response to archive.org's S3 is okay though
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@647 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 1aebf77afa error
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@632 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis fd219ecb8d Some missing apex; more comments.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@631 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago