arkiver
|
b2654e9317
|
Version 20230509.01. Support for new design.
|
1 year ago |
|
arkiver
|
7f4db17348
|
Version 20221021.01. Ignore /tailwind-build.css URL from comment in HTML.
|
2 years ago |
|
arkiver
|
8a27002fd3
|
Version 20221005.01. Max tries for backfeed to 10.
|
2 years ago |
|
arkiver
|
35e31af37f
|
Queue redditstatic.com URLs as outlinks.
|
2 years ago |
|
arkiver
|
bab4b4dcd2
|
Version 20220729.05. Fix aborting item on bad status code on url: item. Keep old retry code otherwise.
|
2 years ago |
|
arkiver
|
8c45a263aa
|
Version 20220729.04. Queue extra found URLs on media URLs to backfeed.
|
2 years ago |
|
arkiver
|
e8fe03fbd0
|
Version 20220729.03. Add url: prefix to url item.
|
2 years ago |
|
arkiver
|
f81b2ce97e
|
Version 20220729.01. Queue media URLs back to reddit project and download individually.
|
2 years ago |
|
arkiver
|
cc83009a94
|
Version 20220605.01. Support GNU Wget 1.21.3-at.20220503.02. Fix killing crawl when items cannot be queued.
|
2 years ago |
|
arkiver
|
0ce1c59ca4
|
Version 20220415.01. Do not queue /r/undefined/ URLs.
|
2 years ago |
|
arkiver
|
da28d3c902
|
Version 20220323.03. Fix items to maxtries variable name. Fix backfeed key name.
|
2 years ago |
|
arkiver
|
8944cf1fc6
|
Version 20220323.02. Fix items to maxtries variable name.
|
2 years ago |
|
arkiver
|
10eaa7c50c
|
Version 20220323.01. Fix backfeed. Fix maxtries use.
|
2 years ago |
|
arkiver
|
28f132a052
|
Version 20220312.01. Fix backfeed.
|
2 years ago |
|
arkiver
|
4f50a0d699
|
Version 20220311.01. Use new backfeed endpoint for queuing.
|
2 years ago |
|
arkiver
|
383c101aef
|
Version 20220109.02. Cut off URL at space when found between brackets without href= in front.
|
2 years ago |
|
arkiver
|
df35317e0c
|
Version 20220109.01. Add codepoint to utf8 support. Percent encode outlinks correctly.
|
2 years ago |
|
arkiver
|
ed80cb5a9d
|
Version 20210707.01. Do not get media for cross posts.
|
3 years ago |
|
arkiver
|
4b976e2ea7
|
Version 20210521.01. Use TLS 1.2.
|
3 years ago |
|
arkiver
|
6e15841550
|
Version 20210407.01. Improve video archiving. Detect if video is still being processed by reddit.
|
3 years ago |
|
arkiver
|
1b3690d994
|
Version 20210330.04. Only decode unicode characters in URLs on v.redd.it URLs.
|
3 years ago |
|
arkiver
|
ce7fff480d
|
Version 20210330.03. Unescape unicode characters. Do not HLS for video.
|
3 years ago |
|
arkiver
|
ad04f45d4f
|
Fix typo.
|
3 years ago |
|
arkiver
|
adc7f9c6fb
|
Version 20210330.02. Skip images that are only in JSON and not on web page.
|
3 years ago |
|
arkiver
|
07ed16c44b
|
Version 20210330.01. Handle 403 on v.redd.it on deleted post.
|
3 years ago |
|
arkiver
|
8849165130
|
Version 20210321.01. Do not get all video sizes.
|
3 years ago |
|
arkiver
|
d3b6659419
|
Version 20210312.01. Get URLs with utm_* and context params.
|
3 years ago |
|
arkiver
|
11d5777391
|
Version 20210130.01. Support & in URL. Properly abort selected items.
|
3 years ago |
|
arkiver
|
0be16f775a
|
Version 20210114.04. Support cookies.
|
3 years ago |
|
arkiver
|
0d0e824421
|
Version 20210114.03. Do not accept 403.
|
3 years ago |
|
arkiver
|
2911934fd4
|
Version 20210108.09. Ignore over18 URLs on old.reddit.com (cookie fix coming up, not a problem on www.reddit.com).
|
4 years ago |
|
arkiver
|
f3d41ea2e1
|
Version 20210108.08. Do not archive URLs with utm_source for old.reddit.com.
|
4 years ago |
|
arkiver
|
1b220e014b
|
Fix for archiving videos.
|
4 years ago |
|
arkiver
|
3d20ca90af
|
Handle NULL byte seperated multi items. Support unicode chars in JSON permalink.
|
4 years ago |
|
arkiver
|
16836ba201
|
Support single comment and post items. Queue outlinks to URLs project.
|
4 years ago |
|
arkiver
|
2087174a5c
|
Version 20200821.01. Ignore comment URL with utm_source param.
|
4 years ago |
|
arkiver
|
23bfe8b12c
|
Version 20200730.01. Support /user/ post better (like /r/).
|
4 years ago |
|
arkiver
|
450d4e0413
|
Version 20200728.01. Ignore non-reddit URLs. Fix extraction of tokens for morecomments.
|
4 years ago |
|
arkiver
|
9a6417ecbc
|
Version 20200727.03. Fix handling video URLs without extension.
|
4 years ago |
|
arkiver
|
147c6416ed
|
Version 20200727.01. Use trackerproxy for dictionaries. Ignore irc: URLs.
|
4 years ago |
|
arkiver
|
23fec56409
|
Version 20200726.03. Support galleries and comments.
|
4 years ago |
|
arkiver
|
2f6a602313
|
Version 20200726.01. Fully support new and old design for posts.
|
4 years ago |
|
Arkiver2
|
cf3f6c7af9
|
Skip URL on status code 204. Update version to 20200102.02.
|
5 years ago |
|
Arkiver2
|
0eb4b6205a
|
Fix string joining.
|
5 years ago |
|
Arkiver2
|
ad2cf89404
|
Split off checking if URL was processed. Do not add URL without trailing / already added with trailing /.
|
5 years ago |
|
Arkiver2
|
d4d5c9a93f
|
Skip amp.reddit.com post pages.
|
5 years ago |
|
Arkiver2
|
4cf7bd18f0
|
Version 20190729.01; do not get page requisites from outlinks; do not pip install warcio.
|
5 years ago |
|
Arkiver2
|
8902255c76
|
Version 20190405.01; support www.reddit.com; support videos; support outlinks
|
5 years ago |
|
Arkiver2
|
9d1ea0c688
|
rewrite
|
5 years ago |
Arkiver2
|
c08fd59a29
|
reddit.lua: ignore urls, fixes
|
9 years ago |