24 Commits

Author	SHA1	Message	Date
Pavel	54d187a0ad	Fixing ingestion metadata grouping	2024-02-28 19:52:58 +03:00
Alex	0cb3d12d94	Refactor loader classes to accept inputs directly	2024-02-14 15:17:56 +00:00
Pavel	030c2a740f	upload_remote class	2024-02-13 23:41:36 +03:00
Alex	2e14dec12d	Merge pull request #849 from arc53/main ... Sync	2024-02-09 14:05:39 +00:00
Arnav Kohli	4c6b8b4173	Update worker.py ... Added comments in difficult to understand areas	2023-10-31 20:00:07 +05:30
Pavel	381a2740ee	change input	2023-10-13 21:52:56 +04:00
Alex	8b3b16bce4	inputs	2023-10-13 08:46:35 +01:00
Pavel	658867cb46	No crawler, no sitemap	2023-10-12 01:03:40 +04:00
Robbie Walmsley	57fb29b600	Update worker.py	2023-10-09 10:55:34 +01:00
Alex	d85eb83ea2	elastic search fixes	2023-09-30 15:25:31 +01:00
Alex	347cfe253f	elastic2	2023-09-29 17:17:48 +01:00
Alex	8fa9657ba6	working full	2023-09-27 16:25:57 +01:00
Anton Larin	98a97f34f5	fix packaging and imports and introduce tests with pytest. ... still issues with celery worker.	2023-08-14 18:20:25 +02:00
Anton Larin	968849e52b	code readability, formatting, minor version bump	2023-06-17 12:42:05 +02:00
Alex	e49dd0cc6a	metadata on ingestion	2023-05-17 21:41:24 +01:00
Anton Larin	962becb9a5	Linting ... * validate python formatting on every build with Ruff * fix lint warnings	2023-05-13 10:36:17 +02:00
Serj	8742cdae0a	Refactored url join	2023-04-30 10:46:52 +01:00
Serj	2d92e95c8a	Added settings usage to the worker	2023-04-29 15:56:32 +01:00
Alex	d5522e7c08	prep things	2023-03-27 19:29:10 +01:00
Alex	92993ee105	Small fixes + polishing	2023-03-21 22:16:09 +00:00
Alex	8e477c9d16	update worker	2023-03-15 00:23:51 +00:00
Alex	c4464455a1	cors + dependencies	2023-03-14 14:29:36 +00:00
Alex	c297e076e6	folders	2023-03-13 21:56:09 +00:00
Alex	1d2162705d	uploads backend first	2023-03-13 14:20:03 +00:00