lemmy

Commit Graph

Author	SHA1	Message	Date
phiresky	375d9a2a3c	Persistent, performant, reliable federation queue (#3605 ) * persistent activity queue * fixes * fixes * make federation workers function callable from outside * log federation instances * dead instance detection not needed here * taplo fmt * split federate bin/lib * minor fix * better logging * log * create struct to hold cancellable task for readability * use boxfuture for readability * reset submodule * fix * fix lint * swap * remove json column, use separate array columns instead * some review comments * make worker a struct for readability * minor readability * add local filter to community follower view * remove separate lemmy_federate entry point * fix remaining duration * address review comments mostly * fix lint * upgrade actitypub-fed to simpler interface * fix sql format * increase delays a bit * fixes after merge * remove selectable * fix instance selectable * add comment * start federation based on latest id at the time * rename federate process args * dead instances in one query * filter follow+report activities by local * remove synchronous federation remove activity sender queue * lint * fix federation tests by waiting for results to change * fix fed test * fix comment report * wait some more * Apply suggestions from code review Co-authored-by: SorteKanin <sortekanin@gmail.com> * fix most remaining tests * wait until private messages * fix community tests * fix community tests * move arg parse * use instance_id instead of domain in federation_queue_state table --------- Co-authored-by: Dessalines <dessalines@users.noreply.github.com> Co-authored-by: SorteKanin <sortekanin@gmail.com>	8 months ago
Nutomic	366d9d1e2e	Get rid of remaining Perform/SendActivity traits (fixes #3670 ) (#3926 ) * Get rid of remaining Perform/SendActivity traits (fixes #3670) * fix api tests * ci	9 months ago
Dessalines	56e26fc3d4	Adding a post_view mode. Fixes #3730 (#3731 ) * Adding a post_view mode. Fixes #3730 * Fix test. * Addressing PR comments. * Adding a post_view mode. Fixes #3730 * Fix test. * Addressing PR comments. * Fixing column order. * Fix default Ok returns. * Removing return Err(... where feasible.	9 months ago
Nutomic	7fd14b3d2a	Make remove content optional during account deletion (fixes #1617 ) (#3817 ) * Make remove content optional during account deletion (fixes #1617) * simplify purge params by passing context * update js client * add delete content * update woodpecker config --------- Co-authored-by: Dessalines <dessalines@users.noreply.github.com>	9 months ago
Freakazoid182	ee7b35a04a	Add person name to PersonIsBannedFromSite error (#3786 ) (#3855 ) * Add person name to PersonIsBannedFromSite error (#3786) * Log PersonId instead of Person name (#3850) * Log actor_id for PersonIsBannedFromSite (#3850) --------- Co-authored-by: Freek van Zee <freek.van.zee@mediamonks.com>	9 months ago
Dessalines	70fae9d68d	Fixing broken SQL migration formatting. (#3800 ) * Fixing SQL format. * Fixing clippy lints. * Fixing clippy lint 2.	10 months ago
Nutomic	27be1efb74	Rewrite remaining federation actions, get rid of PerformCrud trait (#3794 ) * Rewrite ban actions * Rewrite delete/remove actions * Rewrite remove/delete community * Rewrite report actions * Rewrite feature/lock post * Rewrite update community actions * Rewrite remaining federation actions * Get rid of PerformCrud trait * clippy	10 months ago
Louis GERARD	7bc64ab91a	Remove follow community traits (#3737 ) * chore(FollowCommunity): remove Perform and Send Activity traits * chore(FollowCommunity): avoid fetching community and person from db	10 months ago
Nutomic	d82194cfe9	Rewrite some federation actions to remove Perform/SendActivity (ref #3670 ) (#3758 )	10 months ago
Nutomic	37998b3398	Rewrite some API handlers to remove Perform trait (#3735 ) * Rewrite some API handlers to remove Perform trait * Convert CreateComment * ci	10 months ago
Nutomic	5d23ef960e	Remove SendActivity and Perform traits, rely on channel (#3596 ) * Remove SendActivity and Perform traits, rely on channel These traits arent necessary anymore now that websocket is removed. Removing them allows us to use normal actix http handler methods which are much more flexible, and allow using different middlewares as well as setting response attributes. * compiling and create post federating * clippy * rename methods, join outgoing activities task * fix api tests * no unwrap * conditional compile * add back getrandom * make crates optional * fmt	10 months ago
Nutomic	e9e76549a8	Split activity table into sent and received parts (fixes #3103 ) (#3583 ) * Split activity table into sent and received parts (fixes #3103) The received activities are only stored in order to avoid processing the same incoming activity multiple times. For this purpose it is completely unnecessary to store the data. So we can split the table into sent_activity and received_activity parts, where only sent_activity table needs to store activity data. This should reduce storage use significantly. Also reduces activity storage duration to three months, we can reduce this further if necessary. Additionally the id columns of activity tables are removed because they are completely unused and risk overflowing (fixes #3560). * address review * move insert_received_activity() methods to verify handlers * remove unnecessary conflict line * clippy * use on conflict, add tests	10 months ago
Nutomic	7d8cb93b53	Check for dead federated instances (fixes #2221 ) (#3427 ) * Check for dead federated instances (fixes #2221) * move to apub crate, use timestamp * make it compile * clippy * use moka to cache blocklists, dead instances, restore orig scheduled tasks * remove leftover last_alive var * error handling * wip * fix alive check for instances without nodeinfo, add coalesce * clippy * move federation blocklist cache to #3486 * unused deps	10 months ago
dullbananas	1d38aad9d3	Make functions work with both connection and pool (#3420 ) * a lot * merge * Fix stuff broken by merge * Get rid of repetitive `&mut context.conn().await?` Add blank lines under each line with `conn =` * Fix style mistakes (partial) * Revert "Fix style mistakes (partial)" This reverts commit `48a033b87f`. * Revert "Add blank lines under each line with `conn =`" This reverts commit `773a6d3beb`. * Revert "Get rid of repetitive `&mut context.conn().await?`" This reverts commit `d2c6263ea1`. Use DbConn for CaptchaAnswer methods * DbConn trait * Remove more `&mut ` Fix stuff * Re-run CI * try to make ci start * fix * fix * Fix api_common::utils * Fix apub::activities::block * Fix apub::api::resolve_object * Fix some things * Revert "Fix some things" This reverts commit `2bf8574bc8`. * Revert "Fix apub::api::resolve_object" This reverts commit `3e4059aabb`. * Revert "Fix apub::activities::block" This reverts commit `3b02389abd`. * Revert "Fix api_common::utils" This reverts commit `7dc73de613`. * Revert "Revert "Fix api_common::utils"" This reverts commit `f740f115e5`. * Revert "Revert "Fix apub::activities::block"" This reverts commit `2ee206af7c`. * Revert "Revert "Fix apub::api::resolve_object"" This reverts commit `96ed8bf2e9`. * Fix fetch_local_site_data * Fix get_comment_parent_creator * Remove unused perma deleted text * Fix routes::feeds * Fix lib.rs * Update lib.rs * rerun ci * Attempt to create custom GetConn and RunQueryDsl traits * Start over * Add GetConn trait * aaaa * Revert "aaaa" This reverts commit `acc9ca1aed`. * Revert "Revert "aaaa"" This reverts commit `443a2a00a5`. * still aaaaaaaaaaaaa * Return to earlier thing Revert "Add GetConn trait" This reverts commit `ab4e94aea5`. * Try to use DbPool enum * Revert "Try to use DbPool enum" This reverts commit `e4d1712646`. * DbConn and DbPool enums (db_schema only fails to compile for tests) * fmt * Make functions take `&mut DbPool<'_>` and make db_schema tests compile * Add try_join_with_pool macro and run fix-clippy on more crates * Fix some errors * I did it * Remove function variants that take connection * rerun ci * rerun ci * rerun ci	10 months ago
Nutomic	93225e5ddf	Error enum fixed (#3487 ) * Create error type enum * Replace magic string slices with LemmyErrorTypes * Remove unused enum * Add rename snake case to error enum * Rename functions * clippy * Fix merge errors * Serialize in PascalCase instead of snake_case * Revert src/lib * Add serialization tests * Update translations * Fix compilation error in test * Fix another compilation error * Add code for generating typescript types * Various fixes to avoid breaking api * impl From<LemmyErrorType> for LemmyError * with_lemmy_type * trigger ci --------- Co-authored-by: SleeplessOne1917 <abias1122@gmail.com>	11 months ago
Nutomic	6f513793cb	Activitypub crate rewrite (#2782 ) * update activitypub-federation crate to 0.4.0 * fixes * apub compiles! * everything compiling! * almost done, federated follow failing * some test fixes * use release * add code back in	1 year ago
Nutomic	62663a9f2e	Implement separate mod activities for feature, lock post (#2716 ) * Implement separate mod activities for feature, lock post Also includes collection for featured posts. Later we also need to do the same for Comment.distinguished * some changes --------- Co-authored-by: Dessalines <dessalines@users.noreply.github.com>	1 year ago
Felix Ableitner	c6c52ab9cc	Add SendActivity trait so that api crates compile in parallel with lemmy_apub	1 year ago
Felix Ableitner	201fa97769	Move code to generate apub urls into lemmy_api_common	1 year ago
Felix Ableitner	030afbc2e7	Merge websocket crate into api_common	1 year ago
Nutomic	bcf5c91f81	Use audience field to federate items in groups (fixes #2464 ) (#2584 )	1 year ago
Dessalines	5d837780f5	Add diesel_async, get rid of blocking function (#2510 ) * Moving settings to Database. - Moves many settings into the database. Fixes #2285 - Adds a local_site and instance table. Fixes #2365 . Fixes #2368 - Separates SQL update an insert forms, to avoid runtime errors. - Adds TypedBuilder to all the SQL forms, instead of default. * Fix weird clippy issue. * Removing extra lines. * Some fixes from suggestions. * Fixing apub tests. * Using instance creation helper function. * Move forms to their own line. * Trying to fix local_site_data, still broken. * Testing out async * Testing out async 2 * Fixing federation tests. * Trying to fix check features 1. * Starting on adding diesel async. 1/4th done. * Added async to views and schema. * Adding some more async * Compiling now. * Added diesel async. Fixes #2465 * Running clippy --fix * Trying to fix cargo test on drone. * Trying new muslrust. * Trying a custom dns * Trying a custom dns 2 * Trying a custom dns 3 * Trying a custom dns 4 * Trying a custom dns 5 * Trying a custom dns 6 * Trying a custom dns 7 * Addressing PR comments. * Adding check_apub to all verify functions. * Reverting back drone. * Fixing merge * Fix docker images. * Adding missing discussion_languages. * Trying to fix federation tests. * Fix site setup user creation. * Fix clippy * Fix clippy 2 * Test api faster * Try to fix 1 * Try to fix 2 * What are these lines about * Trying to fix 3 * Moving federation test back to top. * Remove logging cat.	2 years ago
Dessalines	235cc8b228	Moving settings to Database. (#2492 ) * Moving settings to Database. - Moves many settings into the database. Fixes #2285 - Adds a local_site and instance table. Fixes #2365 . Fixes #2368 - Separates SQL update an insert forms, to avoid runtime errors. - Adds TypedBuilder to all the SQL forms, instead of default. * Fix weird clippy issue. * Removing extra lines. * Some fixes from suggestions. * Fixing apub tests. * Using instance creation helper function. * Move forms to their own line. * Trying to fix local_site_data, still broken. * Fixing federation tests. * Trying to fix check features 1. * Addressing PR comments. * Adding check_apub to all verify functions.	2 years ago
Nutomic	74bc1198ce	Dont try to send activities if federation is disabled (fixes #2499 ) (#2500 )	2 years ago
Nutomic	ec5e63b5a9	Fix check for federated mod actions (#2489 )	2 years ago
Dessalines	c9f1407429	Diesel 2.0.0 upgrade (#2452 ) * Initial commit to bump diesel to 2.0.0-rc.0 and see what happens * Add chrono feature from diesel * db_schema crate is close to building? * Upgrade diesel-derive-newtype * Mostly modifying references to connections to be mutable ones; also used new way to do migrations as suggested by the migration guide; a lot more compiles now, though I can't figure out this tricky ToSql issue at the moment * Running clippy --fix * Trying to fix drone clippy 1 * Fix clippy * Upgrade clux-musl * Trying to fix drone clippy 2 * Trying to fix drone clippy 3 * Trying to fix drone clippy 5 * Adding diesel table aliases, removing sql view hack. Fixes #2101 Co-authored-by: Steven Chu <stevenc1@gmail.com> Co-authored-by: Nutomic <me@nutomic.com>	2 years ago
Nutomic	fcaf7a084c	Upgrade activitypub_federation to 0.2.0, add setting federation.debug (#2300 )	2 years ago
Nutomic	a2a594b763	Extract Activitypub logic into separate library (#2288 ) * Create example for apub lib * some rewriting of apub lib * Add LocalInstance struct for apub lib to avoid using Lemmy Settings * Move ActorType trait to lemmy_apub, because its not needed in library * Use reqwest_retry instead of custom impl, dont specify timeout on every send() * Some improvements to example * Moved inbox handling to library * bug fixes * Move context and serde helpers into library * wip: example changes * Add lemmy_utils feature to build only LemmyError * Rename to activitypub_federation * Remove lemmy_utils dep from activitypub_federation using generic error type * Finish activitypub example * Cleanup and fix tests * Reorganize library files * Remove ApubObject.to_tombstone() * Extract activitypub library into separate git repository	2 years ago
Nutomic	3aa3d75a1e	Add cargo feature for building lemmy_api_common with mininum deps (#2243 )	2 years ago
Nutomic	65cac21713	Fix verify_mod_action check for remote admin actions (#2190 ) * Fix verify_mod_action check for remote admin actions * fix federation test	2 years ago
Nutomic	166ec196b0	Rework error handling (fixes #1714 ) (#2135 )	2 years ago
Nutomic	7d61616dff	Revert "Add logging to debug federation issues (ref #2096 ) (#2099 )" (#2130 ) This reverts commit `e094989a4c`.	2 years ago
Nutomic	e094989a4c	Add logging to debug federation issues (ref #2096 ) (#2099 )	2 years ago
Nutomic	788924d7ff	Merge different delete activities for better compatibility (fixes #2066 ) (#2073 )	2 years ago
Nutomic	dd865c5af5	Implement instance actor (#1798 ) * Implement instance actor * wip: make site bans federate * finish implementation and unit tests for federated bans * start adding api tests * fix api test * remve site from GetCommunityResponse * only federate site bans originating from user's home instance * dont expose site.private_key in api	2 years ago
Aode (lion)	97ebf2f6f3	Consolidate reqwest clients, use reqwest-middleware for tracing	2 years ago
Riley	35cbae61bc	Don't drop error context when adding a message to errors (#1958 ) * Respond directly with LemmyError Instrument Perform implementations for more precise traces Use ApiError to format JSON errors when messages are present Keep SpanTrace output in LemmyError Display impl * Hide SpanTrace debug output from LemmyError * Don't log when entering spans, only when leaving * Update actix-web * Update actix-rt * Add newline after error info in LemmyError Display impl * Propogate span information to blocking operations * Instrument apub functions * Use skip_all for more instrument attributes, don't skip 'self' in some api actions * Make message a static string * Send proper JSON over websocket * Add 'message' to LemmyError display if present * Use a quieter root span builder, don't pretty-print logs * Keep passwords and emails out of logs * Re-enable logging Login * Instrument feeds * Emit our own errors * Move error log after status code recording * Make Sensitive generic over the inner type * Remove line that logged secrets	2 years ago
Riley	3fea5645f8	Add tracing (#1942 )	3 years ago
Felix Ableitner	afccd5cf69	Replace activitystreams crate with activitystreams-kinds	3 years ago
Aode (lion)	20cddf5e81	Support mastodon deletes	3 years ago
Felix Ableitner	579ca37ddf	Make webfinger standard compliant	3 years ago
Dessalines	23641fcd06	Use serde_json::to_value	3 years ago
Nutomic	1b9414f292	More federation compat (#1894 ) * Make HTTP signatures compatible with Pleroma * Send Announce/Page, Announce/Note for Pleroma compatibility * remove unused code	3 years ago
Felix Ableitner	888e683856	For verify_is_public() we also need to check cc field	3 years ago
Felix Ableitner	2edf8ba157	Move ObjectId to library	3 years ago
Felix Ableitner	bd3352423a	Remove ActivityFields trait, deserialize into another struct instead	3 years ago
Felix Ableitner	03d8ac75ef	Move activity structs to protocol folder	3 years ago
Felix Ableitner	d89156810d	Move @context out of object/activity definitions	3 years ago
Felix Ableitner	2d04ff93f5	Change activity.cc to Vec<Url> in public activities	3 years ago
Felix Ableitner	271785b7fb	When receiving activity, dont read community from cc (for pleroma compat and better verification)	3 years ago

1 2

67 Commits (375d9a2a3cf9c023ac6ac832d98f1b456fb9e2ce)