Commit Graph

  • e3295a7564 fix: cannot retrieve all titles using the --index method yzqzss 2023-05-22 23:23:03 +0800
  • 3d0520abb0 tool: Extracts all titles from a XML dump yzqzss 2023-05-19 15:56:04 +0800
  • 68d275282c doc: `API:Allpages` requires MW >= 1.8, not 1.18 yzqzss 2023-05-09 19:00:33 +0800
  • d95a1eb2d3 fix exporting via --xmlreisions_page yzqzss 2023-05-08 20:14:37 +0800
  • 621b052020 getXMLPageWithAPI(): pass `contentmodel` to rvprop for future purposes yzqzss 2023-05-08 16:49:43 +0800
  • f01b860576 fix: `lxml.etree._Element`: FutureWarning. yzqzss 2023-05-08 16:33:15 +0800
  • c03ebadc4c fix: `--xmlapiexport` fails to get `rvcontinue` yzqzss 2023-05-08 02:13:15 +0800
  • 0621adf0a3
    Merge pull request #463 from Pokechu22/broken-http_method-fallback nemobis 2023-05-07 21:51:23 +0300
  • aac816e315 Fix broken http_method fallback Pokechu22 2023-05-07 11:29:37 -0700
  • e339927cc3
    Merge pull request #462 from Pokechu22/fix-prop-revisions nemobis 2023-05-07 20:25:05 +0300
  • df230a96c9 Fix exporting via prop=revisions Pokechu22 2023-05-07 08:39:44 -0700
  • 00b47646e8 fix: modify_metadata() not work yzqzss 2023-04-30 13:39:53 +0800
  • 126e62ea35 fix: modify_metadata() not work yzqzss 2023-05-06 23:37:36 +0800
  • a5e9135d26 waiting for item to be created before modifying metadata yzqzss 2023-04-17 21:06:47 +0800
  • c23fc22934 waiting for item to be created before modifying metadata yzqzss 2023-04-17 20:53:50 +0800
  • 3fea83e91e fix: --append_date uploads to multiple IA items yzqzss 2023-04-17 12:02:15 +0800
  • f22787d2ac fix: --append_date uploads to multiple IA items yzqzss 2023-04-17 12:07:41 +0800
  • 56d632b801 fix: --append_date uploads to multiple IA items yzqzss 2023-04-17 11:43:24 +0800
  • 934161b6f9 exclude dist/ dir from repo yzqzss 2023-03-26 01:30:05 +0800
  • dc27532eb7 dependency: update internetarchive yzqzss 2023-03-26 01:28:11 +0800
  • 2a570720b0 apply Delay() to mwclient.Site.allpages() yzqzss 2023-03-23 21:12:15 +0800
  • 35fbe17369 images: handle `user` or `sha1` or `size` missing yzqzss 2023-03-16 00:43:58 +0800
  • fe0b726b0a fix: crash when images.txt is empty yzqzss 2023-03-15 23:54:51 +0800
  • e03ed88775 uploader.py: ref to MediaWiki-Scraper yzqzss 2023-03-15 13:24:21 +0800
  • 14acfd1a8e domain2prefix: rstrip("/") yzqzss 2023-03-15 09:43:59 +0800
  • 813fb00668 Add dump date append to item identifier option Liu 2023-03-14 16:58:49 -0400
  • b81e3585a7 enable flake8 basic check yzqzss 2023-02-18 21:31:12 +0800
  • 06da29ffb4 try to resolve all errors reported by flake8 yzqzss 2023-02-18 21:25:19 +0800
  • 152ab2839e fix: access_key and secret_key are not defined yzqzss 2023-02-18 20:57:34 +0800
  • df25bd42a1 fix: type hints error under py3.9 yzqzss 2023-02-18 18:09:02 +0800
  • ef0ac3ce7f Create test-dumogenerator.yml yzqzss 2023-02-18 18:00:18 +0800
  • dd0f4a4593
    350,000 emijrp 2023-02-26 19:31:18 +0100
  • de817f01da move parameter check to `checkParameters()` yzqzss 2023-02-20 18:48:13 +0800
  • 5f2df7e042 add `--insecure` option to disable verify yzqzss 2023-02-20 18:43:12 +0800
  • 2ff61926e0 not use `--user` and `--pass` for HTTPBasicAuth yzqzss 2023-02-20 18:33:09 +0800
  • ef03cff447
    Merge pull request #454 from yzqzss/patch-6 nemobis 2023-02-19 16:17:44 +0200
  • d7153f4c60
    Update uploader.py yzqzss 2023-02-19 01:33:25 +0800
  • a0aa9b301a fix: indexLogin is not called yzqzss 2023-02-16 01:21:26 +0800
  • 74ead81539 feat: Support various login methods. yzqzss 2023-02-15 12:52:01 +0800
  • 638c4df06f fix: #121 yzqzss 2023-02-14 18:16:30 +0800
  • 00c5326c8b docs: cli help yzqzss 2023-02-14 17:30:01 +0800
  • 16f708e144 handle sha1 missing in image metadata yzqzss 2023-01-27 03:06:58 +0800
  • 002fbdb391 fix: #107 yzqzss 2023-01-27 02:31:54 +0800
  • 5837e12607 deprecate: `fixBOM()` yzqzss 2023-01-27 00:03:50 +0800
  • 48670ab4db monkey patch `requests.Response.text` to remove BOM header yzqzss 2023-01-27 00:01:55 +0800
  • 20691b56c5 xmlrev: do not retrive namespace one by one Misty 2023-01-22 21:38:57 +0800
  • a5dcdb98f1 xmlexport: support export page using pure API (using --xml --xmlapiexport) Misty 2023-01-19 16:19:08 +0800
  • 710903f615
    Update README.md (#127) Rob Kam 2023-02-14 19:32:42 +0000
  • 3e11e952b8
    Delete ChangeLog (#126) Rob Kam 2023-02-13 19:56:15 +0000
  • 9e647fd2e5
    Update README.md (#125) Rob Kam 2023-02-13 19:55:52 +0000
  • 71aae07de6
    Update README.md (#120) Rob Kam 2023-02-13 00:25:24 +0000
  • 70f52c9731
    Bump oauthlib from 3.2.0 to 3.2.2 (#122) dependabot[bot] 2023-02-10 17:24:44 +0000
  • d989663b64
    Fix: `--xmlrevisions` and `--xmlrevisions_page` can't get any wikitext (#119) yzqzss 2023-01-28 00:40:06 +0800
  • b7b5f9be90
    Update README.md (#117) Rob Kam 2023-01-23 00:05:24 +0000
  • 8d4164ea84
    Speed up file scanning (#116) yzqzss 2023-01-19 22:14:36 +0800
  • 392fbce083
    speed up file scanning yzqzss 2023-01-19 21:18:59 +0800
  • dd619ebe6e
    Handle missing files with `sha1 == False`. (#114) yzqzss 2023-01-19 03:41:00 +0800
  • 0ad5475b56
    Catch `textmissing` in revision (#111) yzqzss 2023-01-18 21:10:04 +0800
  • 3ee31859a2
    Improve image dump logic (#112) yzqzss 2023-01-18 21:08:17 +0800
  • bee0a1b144
    network: more resillent and responsive to restrive websites (#110) NyaMisty 2023-01-17 17:35:39 +0800
  • 05bb04ad0a
    Fix some bugs in #103 (#108) yzqzss 2023-01-17 04:03:37 +0800
  • 7bf5628b85
    Deprecate `truncateFilename()` and increase filename length limit. (#104) yzqzss 2023-01-16 22:19:06 +0800
  • be983b0814
    Refactor xml dump related codes and improve xmlrevision logic (#103) NyaMisty 2023-01-16 20:04:33 +0800
  • 0fb53ffdde
    Fix line endings (#102) Janet Cobb 2023-01-15 18:50:55 -0500
  • 5810f9157a
    Update uses of and/or to proper ternary expressions (#98) Janet Cobb 2023-01-15 17:51:06 -0500
  • c0b55e4323
    Remove special characte from special_version.py (#97) Janet Cobb 2023-01-15 17:35:42 -0500
  • e40bf72252
    Fix: unable to get XML via `Special:Export` (--xml) (#96) yzqzss 2023-01-16 06:31:40 +0800
  • a25be5e1c0
    Properly synchronize Delay (#94) Janet Cobb 2023-01-15 17:15:31 -0500
  • eb479cf0b2
    `Special:Version.html` to `SpecialVersion.html` (#64) Rob Kam 2023-01-15 22:14:40 +0000
  • 163fd9677b
    Fix: `Delay()` stuck when `Ctrl+C` pressed (#92) yzqzss 2023-01-16 04:16:53 +0800
  • f57f50f7f2
    tests: add first unit test case with pytest (#91) NyaMisty 2023-01-16 03:42:56 +0800
  • 940d50bbac
    Update dumpgenerator.py yzqzss 2023-01-16 02:55:22 +0800
  • bd6fb48e6a
    Enhance the stability of the image dump and make it resumable (#88) yzqzss 2023-01-16 02:30:59 +0800
  • 9981ea3d29
    Merge pull request #83 from saveweb/config_refactor Rob Kam 2023-01-14 16:59:55 +0000
  • 231dbcf1df lint: fix all linting warnings Misty 2023-01-14 03:31:35 +0800
  • b04e6840b0 lint: added type hinting for dump & cli package Misty 2023-01-14 03:27:34 +0800
  • a405c03075 lint: added hints for wikiteam3.utils Misty 2023-01-14 03:25:50 +0800
  • 62ace721aa lint: annotated dumpgenerator.api Misty 2023-01-14 03:07:40 +0800
  • 2154ead2be refactor: convert config from dict to Config object for better type hinting Misty 2023-01-14 02:54:34 +0800
  • ebac66f557
    Update dumpgenerator.py yzqzss 2023-01-14 23:50:36 +0800
  • 0da98611b5
    Update image.py (#81) Rob Kam 2023-01-14 15:47:08 +0000
  • 19f4ae1daf
    Merge pull request #80 from saveweb/refactor Rob Kam 2023-01-14 15:30:17 +0000
  • 43791ea1c5 build: fix poetry package including Misty 2023-01-14 23:17:25 +0800
  • ac107b22e7
    Merge pull request #78 from saveweb/fix-75 Rob Kam 2023-01-14 14:54:38 +0000
  • 0be46c7427
    quote `title` yzqzss 2023-01-14 22:42:11 +0800
  • de35c6f4a4 quote title yzqzss 2023-01-14 22:34:53 +0800
  • 17f2446e0d
    Merge pull request #74 from saveweb/refactor Rob Kam 2023-01-14 12:55:17 +0000
  • e5194fe4e6
    Create changelog-ci.yml Rob Kam 2023-01-13 18:46:22 +0000
  • a33a5cd0b2 Refactor dumpgenerator into sub-packages Misty 2023-01-14 01:41:01 +0800
  • 121d2efb2d Move non-package files to outside folder (resources or tools) & Remove non-repo folder (tests, .vscode) Misty 2023-01-14 01:28:07 +0800
  • bb03e0467f
    Create ChangeLog (#72) Rob Kam 2023-01-13 16:01:09 +0000
  • 0c4c54dc9e
    Merge pull request #449 from yzqzss/patch-2 nemobis 2023-01-13 17:52:14 +0200
  • 90a64c6a22
    make `requests.session` to use `--retries` value yzqzss 2023-01-13 23:36:32 +0800
  • eff3a0d425
    Merge pull request #70 from saveweb/index-computation Rob Kam 2023-01-13 14:40:56 +0000
  • d3b10067c0
    Merge pull request #68 from saveweb/remove-dup-code Rob Kam 2023-01-13 14:39:41 +0000
  • aade74681f
    Merge pull request #67 from saveweb/logerror-to-stdout Rob Kam 2023-01-13 14:37:57 +0000
  • 0bb5e1eaed
    Merge pull request #69 from saveweb/redundant-retry Rob Kam 2023-01-13 14:27:49 +0000
  • 95dd2e8a8f
    Merge pull request #66 from saveweb/requests-session Rob Kam 2023-01-13 14:18:38 +0000
  • fa246d2df1 fix: index url computation fails on some wikis yzqzss 2023-01-11 04:16:04 +0800
  • 375e6ae2d0 remove redundant retry logic yzqzss 2023-01-11 07:04:55 +0800