Archives/reddit-grab
2
0
Fork 0
mirror of https://github.com/ArchiveTeam/reddit-grab synced 2024-11-16 06:13:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
85 Commits 1 Branch 0 Tags 423 KiB
4f50a0d699
Commit Graph

85 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
arkiver
4f50a0d699 Version 20220311.01. Use new backfeed endpoint for queuing. 2022-03-11 03:52:49 +01:00
arkiver
383c101aef Version 20220109.02. Cut off URL at space when found between brackets without href= in front. 2022-01-09 17:19:29 +01:00
arkiver
df35317e0c Version 20220109.01. Add codepoint to utf8 support. Percent encode outlinks correctly. 2022-01-09 17:15:10 +01:00
arkiver
8a3f8cd1de Version 20211004.02. Fix incomplete facebook.com fix. 2021-10-04 21:09:21 +02:00
arkiver
d0070db67a Version 20211004.01. Do not check facebook.com while down at the moment. 2021-10-04 21:04:03 +02:00
arkiver
0c5e8cd3bd Version 20211001.01. Use GNU Wget 1.20.3-at.20211001.01. 2021-10-01 02:44:01 +02:00
arkiver
ed80cb5a9d Version 20210707.01. Do not get media for cross posts. 2021-07-07 00:12:56 +02:00
arkiver
4b976e2ea7 Version 20210521.01. Use TLS 1.2. 2021-05-21 22:37:19 +02:00
Katie Holly
f4619bb17f use onbuild-based image 2021-05-16 21:05:18 +00:00
km09
e6b876e9e6
New day.. new wget-at 1.20.3-at.20210504.01 2021-05-06 00:07:16 +01:00
Thomas Glass
1f9e995b4e
20210410.01 - New day, new wget-at 2021-04-10 15:20:27 +01:00
arkiver
6e15841550 Version 20210407.01. Improve video archiving. Detect if video is still being processed by reddit. 2021-04-07 00:38:20 +02:00
arkiver
1b3690d994 Version 20210330.04. Only decode unicode characters in URLs on v.redd.it URLs. 2021-03-30 22:20:43 +02:00
arkiver
ce7fff480d Version 20210330.03. Unescape unicode characters. Do not HLS for video. 2021-03-30 20:57:31 +02:00
arkiver
ad04f45d4f Fix typo. 2021-03-30 16:11:12 +02:00
arkiver
adc7f9c6fb Version 20210330.02. Skip images that are only in JSON and not on web page. 2021-03-30 02:21:55 +02:00
arkiver
07ed16c44b Version 20210330.01. Handle 403 on v.redd.it on deleted post. 2021-03-30 01:49:48 +02:00
arkiver
8849165130 Version 20210321.01. Do not get all video sizes. 2021-03-21 02:21:41 +01:00
arkiver
d3b6659419 Version 20210312.01. Get URLs with utm_* and context params. 2021-03-12 21:36:32 +01:00
arkiver
a5c798945c Version 20210306.01. Remove some AppleWebKir user-agents for getting 403s. 2021-03-06 00:27:31 +01:00
Katie Holly
eaad7cd7e7
add 1.20.3-at.20210212.02 as supported wget-at version 2021-02-25 03:01:34 +01:00
Katie Holly
3b4a2ef5a7
20210225.01: update dict url 2021-02-25 02:58:24 +01:00
Thomas Glass
e6c33f9433
Updated warrior support 2021-02-03 13:56:26 +00:00
Thomas Glass
261a7f76d2
Update tracker host 2021-02-03 13:31:32 +00:00
km09
3d8f85a08a
Support new wget-at location 2021-02-03 01:18:34 +00:00
arkiver
ac59cfa3ed Version 20210130.02. Fix merge conflict. 2021-01-30 03:02:18 +01:00
arkiver
11d5777391 Version 20210130.01. Support & in URL. Properly abort selected items. 2021-01-30 03:01:06 +01:00
Katie Holly
053de36287
bump version number 2021-01-27 06:13:25 +01:00
Katie Holly
68b4dd7a21
use gnutls base image 2021-01-27 06:12:58 +01:00
arkiver
2f96fa399c Version 20210115.01. Use Connection: Close header. 2021-01-15 14:52:09 +01:00
arkiver
0be16f775a Version 20210114.04. Support cookies. 2021-01-14 16:54:55 +01:00
arkiver
0d0e824421 Version 20210114.03. Do not accept 403. 2021-01-14 01:53:08 +01:00
arkiver
94d8b551f8 Version 20210114.02. Actually add the user-agents file. 2021-01-14 01:38:31 +01:00
arkiver
bc94cf036f Version 20210114.01. Use a random user-agent. 2021-01-14 01:34:07 +01:00
arkiver
df1f60079d Version 20210109.01. Use browser user-agent. 2021-01-09 14:02:03 +01:00
arkiver
2911934fd4 Version 20210108.09. Ignore over18 URLs on old.reddit.com (cookie fix coming up, not a problem on www.reddit.com). 2021-01-09 01:01:44 +01:00
arkiver
f3d41ea2e1 Version 20210108.08. Do not archive URLs with utm_source for old.reddit.com. 2021-01-09 00:55:58 +01:00
arkiver
992fb6b953 Version 20210108.07. Use tracker reddit. 2021-01-08 23:41:15 +01:00
arkiver
6a8d5a62ac Version 20210108.06. 2021-01-08 23:40:31 +01:00
arkiver
1b220e014b Fix for archiving videos. 2021-01-08 23:40:14 +01:00
arkiver
4a371be167 Version 20210108.05. 2021-01-08 23:21:35 +01:00
arkiver
3d20ca90af Handle NULL byte seperated multi items. Support unicode chars in JSON permalink. 2021-01-08 23:18:48 +01:00
arkiver
7c5ea717a8 Version 20210108.03. 2021-01-08 22:42:48 +01:00
arkiver
5f3958c282 Merge branch 'master' of https://github.com/ArchiveTeam/reddit-grab 2021-01-08 22:42:24 +01:00
arkiver
1924d5217e Version 20210108.02. 2021-01-08 22:42:03 +01:00
arkiver
16836ba201 Support single comment and post items. Queue outlinks to URLs project. 2021-01-08 22:40:49 +01:00
arkiver
ae57a81baf Use multi items. 2021-01-08 22:40:09 +01:00
km09
eb945d2470
Use updated grab-base 2020-10-31 10:49:34 +00:00
arkiver
4284d24b47 Version 20201031.01. Support Wget-AT version 1.20.3-at.20201030.01. 2020-10-31 01:20:27 +01:00
arkiver
9ecf9a3a30 Version 20200902.01. Support Wget-AT version 1.20.3-at.20200902.01. 2020-09-02 09:46:17 -04:00