arkiver
|
56571306dd
|
Use default upload concurrent of 2.
|
4 years ago |
arkiver
|
40063adcaf
|
Use wget-at with ZSTD.
|
4 years ago |
Arkiver2
|
831f79f0d9
|
Do not import warcio. Update version to 20200102.03.
|
5 years ago |
Arkiver2
|
cf3f6c7af9
|
Skip URL on status code 204. Update version to 20200102.02.
|
5 years ago |
Arkiver2
|
ac65b0a818
|
Update version to 20200102.01.
|
5 years ago |
Arkiver2
|
4cf7bd18f0
|
Version 20190729.01; do not get page requisites from outlinks; do not pip install warcio.
|
5 years ago |
Arkiver2
|
8902255c76
|
Version 20190405.01; support www.reddit.com; support videos; support outlinks
|
6 years ago |
Arkiver2
|
9d1ea0c688
|
rewrite
|
6 years ago |
Arkiver2
|
11aef69a32
|
pipeline.py: cookies!
|
9 years ago |
Arkiver2
|
9f531c900f
|
pipeline.py: use redd.it to discover comments
|
9 years ago |
Arkiver2
|
61dd537f15
|
Update pipeline.py
|
9 years ago |
Arkiver2
|
ff1bb532c6
|
pipeline.py
|
9 years ago |