lemmy

Commit Graph

Author	SHA1	Message	Date
phiresky	375d9a2a3c	Persistent, performant, reliable federation queue (#3605 ) * persistent activity queue * fixes * fixes * make federation workers function callable from outside * log federation instances * dead instance detection not needed here * taplo fmt * split federate bin/lib * minor fix * better logging * log * create struct to hold cancellable task for readability * use boxfuture for readability * reset submodule * fix * fix lint * swap * remove json column, use separate array columns instead * some review comments * make worker a struct for readability * minor readability * add local filter to community follower view * remove separate lemmy_federate entry point * fix remaining duration * address review comments mostly * fix lint * upgrade actitypub-fed to simpler interface * fix sql format * increase delays a bit * fixes after merge * remove selectable * fix instance selectable * add comment * start federation based on latest id at the time * rename federate process args * dead instances in one query * filter follow+report activities by local * remove synchronous federation remove activity sender queue * lint * fix federation tests by waiting for results to change * fix fed test * fix comment report * wait some more * Apply suggestions from code review Co-authored-by: SorteKanin <sortekanin@gmail.com> * fix most remaining tests * wait until private messages * fix community tests * fix community tests * move arg parse * use instance_id instead of domain in federation_queue_state table --------- Co-authored-by: Dessalines <dessalines@users.noreply.github.com> Co-authored-by: SorteKanin <sortekanin@gmail.com>	8 months ago
cetra3	9256895635	Cache & Optimize Woodpecker CI (#3450 ) * Try using drone cache plugin * Try another path * Include volume * Fix formatting * Include fmt * Exclude cargo dir from prettier * Don't override cargo * Just do check * Add cache key * Use different cache plugin * Add clippy * Try minio * Add quotes * Try adding secrets * Try again * Again * Use correct secret formation * Add back clippy * Use secret for the root bucket name * Try drone cache instead * Add region * Add path-style option * Include cargo clippy * Include everything again * Fix formatting * Don't run clippy twice * Add `allow` statements for tests to pass * Adjust endpoint to be a secret * Fix prettier * Merge & fix tests * Try to restart the woodpecker test * Change the ENV var name --------- Co-authored-by: Dessalines <dessalines@users.noreply.github.com>	10 months ago
Nutomic	e9e76549a8	Split activity table into sent and received parts (fixes #3103 ) (#3583 ) * Split activity table into sent and received parts (fixes #3103) The received activities are only stored in order to avoid processing the same incoming activity multiple times. For this purpose it is completely unnecessary to store the data. So we can split the table into sent_activity and received_activity parts, where only sent_activity table needs to store activity data. This should reduce storage use significantly. Also reduces activity storage duration to three months, we can reduce this further if necessary. Additionally the id columns of activity tables are removed because they are completely unused and risk overflowing (fixes #3560). * address review * move insert_received_activity() methods to verify handlers * remove unnecessary conflict line * clippy * use on conflict, add tests	10 months ago
dullbananas	1d38aad9d3	Make functions work with both connection and pool (#3420 ) * a lot * merge * Fix stuff broken by merge * Get rid of repetitive `&mut context.conn().await?` Add blank lines under each line with `conn =` * Fix style mistakes (partial) * Revert "Fix style mistakes (partial)" This reverts commit `48a033b87f`. * Revert "Add blank lines under each line with `conn =`" This reverts commit `773a6d3beb`. * Revert "Get rid of repetitive `&mut context.conn().await?`" This reverts commit `d2c6263ea1`. Use DbConn for CaptchaAnswer methods * DbConn trait * Remove more `&mut ` Fix stuff * Re-run CI * try to make ci start * fix * fix * Fix api_common::utils * Fix apub::activities::block * Fix apub::api::resolve_object * Fix some things * Revert "Fix some things" This reverts commit `2bf8574bc8`. * Revert "Fix apub::api::resolve_object" This reverts commit `3e4059aabb`. * Revert "Fix apub::activities::block" This reverts commit `3b02389abd`. * Revert "Fix api_common::utils" This reverts commit `7dc73de613`. * Revert "Revert "Fix api_common::utils"" This reverts commit `f740f115e5`. * Revert "Revert "Fix apub::activities::block"" This reverts commit `2ee206af7c`. * Revert "Revert "Fix apub::api::resolve_object"" This reverts commit `96ed8bf2e9`. * Fix fetch_local_site_data * Fix get_comment_parent_creator * Remove unused perma deleted text * Fix routes::feeds * Fix lib.rs * Update lib.rs * rerun ci * Attempt to create custom GetConn and RunQueryDsl traits * Start over * Add GetConn trait * aaaa * Revert "aaaa" This reverts commit `acc9ca1aed`. * Revert "Revert "aaaa"" This reverts commit `443a2a00a5`. * still aaaaaaaaaaaaa * Return to earlier thing Revert "Add GetConn trait" This reverts commit `ab4e94aea5`. * Try to use DbPool enum * Revert "Try to use DbPool enum" This reverts commit `e4d1712646`. * DbConn and DbPool enums (db_schema only fails to compile for tests) * fmt * Make functions take `&mut DbPool<'_>` and make db_schema tests compile * Add try_join_with_pool macro and run fix-clippy on more crates * Fix some errors * I did it * Remove function variants that take connection * rerun ci * rerun ci * rerun ci	10 months ago
Dessalines	d8722b6e91	Adding diesel enums for SortType and ListingType (#2808 ) * Adding diesel enums for SortType and ListingType - Uses diesel-derive-enum. - Adds diesel.toml , so we can again use the auto-generated schema.rs - Fixes a lot of DB null issues and column ordering issues. - Fixes #1136 - Also replaces RegistrationMode boilerplate. * Fixing unit tests 1. * Remove comment line. * Before patch. * Before again. * Using patch file to fix diesel_ltree issue with diesel.toml * Adding some yalc ignores * Fixing RegistrationMode enums * Adding woodpecker diesel schema check. * Try adding openssl 1. * Try using diesel-cli image 1 * Try using diesel-cli image 2 * Try using diesel-cli image 3 * Try using diesel-cli image 4 * Try using diesel-cli image 5 * Try using diesel-cli image 6 * Try using diesel-cli image 7 * Try using diesel-cli image 8 * Try using diesel-cli image 9 * Try using diesel-cli image 10 * Try using diesel-cli image 11 * Try using diesel-cli image 12 * Try using diesel-cli image 13	1 year ago
Nutomic	6f513793cb	Activitypub crate rewrite (#2782 ) * update activitypub-federation crate to 0.4.0 * fixes * apub compiles! * everything compiling! * almost done, federated follow failing * some test fixes * use release * add code back in	1 year ago
Nutomic	d9e7f0100a	Dont upsert Instance row every apub fetch (#2771 ) This is not necessary because the domain cant change, so we only need to insert if no row exists for this domain. Also fetch instance actor when parsing person, not only community Co-authored-by: Dessalines <dessalines@users.noreply.github.com>	1 year ago
Nutomic	6f3bf4634b	Various pedantic clippy fixes (#2568 ) * Various pedantic clippy fixes * more clippy pedantic fixes * try to fix ci * add fix clippy script, use rust 1.65 * fix clippy	2 years ago
Dessalines	5d837780f5	Add diesel_async, get rid of blocking function (#2510 ) * Moving settings to Database. - Moves many settings into the database. Fixes #2285 - Adds a local_site and instance table. Fixes #2365 . Fixes #2368 - Separates SQL update an insert forms, to avoid runtime errors. - Adds TypedBuilder to all the SQL forms, instead of default. * Fix weird clippy issue. * Removing extra lines. * Some fixes from suggestions. * Fixing apub tests. * Using instance creation helper function. * Move forms to their own line. * Trying to fix local_site_data, still broken. * Testing out async * Testing out async 2 * Fixing federation tests. * Trying to fix check features 1. * Starting on adding diesel async. 1/4th done. * Added async to views and schema. * Adding some more async * Compiling now. * Added diesel async. Fixes #2465 * Running clippy --fix * Trying to fix cargo test on drone. * Trying new muslrust. * Trying a custom dns * Trying a custom dns 2 * Trying a custom dns 3 * Trying a custom dns 4 * Trying a custom dns 5 * Trying a custom dns 6 * Trying a custom dns 7 * Addressing PR comments. * Adding check_apub to all verify functions. * Reverting back drone. * Fixing merge * Fix docker images. * Adding missing discussion_languages. * Trying to fix federation tests. * Fix site setup user creation. * Fix clippy * Fix clippy 2 * Test api faster * Try to fix 1 * Try to fix 2 * What are these lines about * Trying to fix 3 * Moving federation test back to top. * Remove logging cat.	2 years ago
Dessalines	235cc8b228	Moving settings to Database. (#2492 ) * Moving settings to Database. - Moves many settings into the database. Fixes #2285 - Adds a local_site and instance table. Fixes #2365 . Fixes #2368 - Separates SQL update an insert forms, to avoid runtime errors. - Adds TypedBuilder to all the SQL forms, instead of default. * Fix weird clippy issue. * Removing extra lines. * Some fixes from suggestions. * Fixing apub tests. * Using instance creation helper function. * Move forms to their own line. * Trying to fix local_site_data, still broken. * Fixing federation tests. * Trying to fix check features 1. * Addressing PR comments. * Adding check_apub to all verify functions.	2 years ago
Dessalines	c9f1407429	Diesel 2.0.0 upgrade (#2452 ) * Initial commit to bump diesel to 2.0.0-rc.0 and see what happens * Add chrono feature from diesel * db_schema crate is close to building? * Upgrade diesel-derive-newtype * Mostly modifying references to connections to be mutable ones; also used new way to do migrations as suggested by the migration guide; a lot more compiles now, though I can't figure out this tricky ToSql issue at the moment * Running clippy --fix * Trying to fix drone clippy 1 * Fix clippy * Upgrade clux-musl * Trying to fix drone clippy 2 * Trying to fix drone clippy 3 * Trying to fix drone clippy 5 * Adding diesel table aliases, removing sql view hack. Fixes #2101 Co-authored-by: Steven Chu <stevenc1@gmail.com> Co-authored-by: Nutomic <me@nutomic.com>	2 years ago
Nutomic	63fff96275	Fix problem where actors can have empty public key (fixes #2347 ) (#2348 )	2 years ago
Nutomic	3aa3d75a1e	Add cargo feature for building lemmy_api_common with mininum deps (#2243 )	2 years ago
Nutomic	b406342a14	Dont log error if duplicate activity is received (fixes #2146 ) (#2148 )	2 years ago
Dessalines	3d08e6c1fc	Adding unique constraint for activity ap_id. Fixes #1878 (#1935 ) * Adding unique constraint for activity ap_id. Fixes #1878 * Removing is_activity_already_known	3 years ago
Nutomic	1b9414f292	More federation compat (#1894 ) * Make HTTP signatures compatible with Pleroma * Send Announce/Page, Announce/Note for Pleroma compatibility * remove unused code	3 years ago
Felix Ableitner	0bde2d595e	Add tests for parsing activities and collections	3 years ago
Felix Ableitner	f24999027e	Merge crates db_schema and db_queries	3 years ago

18 Commits (375d9a2a3cf9c023ac6ac832d98f1b456fb9e2ce)