Aloïs Micard
|
5491f5c3e7
|
Use my personal docker account
|
11 months ago |
Aloïs Micard
|
6f79af997f
|
s/creekorful/darkspot(-org)/
|
3 years ago |
|
Aloïs Micard
|
97c48d7177
|
remove scale.sh script
|
3 years ago |
|
Aloïs Micard
|
72a198cccd
|
Fix README.md
|
3 years ago |
|
Aloïs Micard
|
d7e663fef6
|
Add back continuous delivery
|
3 years ago |
|
Aloïs Micard
|
96c75a85b1
|
Rename project
|
3 years ago |
|
Aloïs Micard
|
ec3357be5d
|
Big improvements
- Reduce debug noise
- Create scripts to blacklist 'famous' legit hostnames
- Make blacklister more resilient
- Merge archiver & indexer together
- Better prefix for cache key
- Rework scheduling process
- Update architecture.png
- Remove trandoshanctl
- Improve testing
|
3 years ago |
|
Aloïs Micard
|
f067104d1f
|
Add docs for ACL
|
3 years ago |
Aloïs Micard
|
4350c26c09
|
architecture.svg -> architecture.png
|
4 years ago |
|
Aloïs Micard
|
a2deb6e637
|
Add architecture diagram
|
4 years ago |
|
Aloïs Micard
|
cf92b5ff31
|
s/process/component
|
4 years ago |
|
Aloïs Micard
|
3ac0520aca
|
Release executables using CD pipeline
Closes: #28
|
4 years ago |
|
Aloïs Micard
|
914663ed94
|
Last update to README.md
|
4 years ago |
|
Aloïs Micard
|
6876463ba5
|
Explain how to speed up crawling
|
4 years ago |
|
Aloïs Micard
|
8231edf6ce
|
Update README.md
|
4 years ago |
|
Aloïs Micard
|
9387061780
|
Update README.md
|
4 years ago |
|
Aloïs Micard
|
e61dc42d3c
|
Some cleanup
|
4 years ago |
|
Aloïs Micard
|
fa348dca5d
|
Last cleanups
- API: implement pagination for search endpoints
- Crawler: do not save body when code > 302
- Scripts: add stop.sh
|
4 years ago |
|
Aloïs Micard
|
742ccbaa79
|
Finalize whole implementation
|
4 years ago |
|
Aloïs Micard
|
230dc550c1
|
Add badge
|
4 years ago |
|
Aloïs Micard
|
52c2bc2ded
|
Create docker subfolder in build/ & deployments/
|
4 years ago |
|
Aloïs Micard
|
de231a851a
|
Update README.md
|
4 years ago |
|
Aloïs Micard
|
599e6ef4d3
|
Fix wrong endpoint being used by scheduler
Also b64 encode the URL.
Closes #6
|
4 years ago |
FFrozTT
|
4160f69d68
|
Update README.md
|
4 years ago |
|
Aloïs Micard
|
06f31f8d9c
|
Implement crawler process
- Also change module URL.
- Create natsutil package
|
4 years ago |
|
Aloïs Micard
|
2f17ee088a
|
Initial commit
|
4 years ago |