lemmy

Commit Graph

Author	SHA1	Message	Date
phiresky	375d9a2a3c	Persistent, performant, reliable federation queue (#3605 ) * persistent activity queue * fixes * fixes * make federation workers function callable from outside * log federation instances * dead instance detection not needed here * taplo fmt * split federate bin/lib * minor fix * better logging * log * create struct to hold cancellable task for readability * use boxfuture for readability * reset submodule * fix * fix lint * swap * remove json column, use separate array columns instead * some review comments * make worker a struct for readability * minor readability * add local filter to community follower view * remove separate lemmy_federate entry point * fix remaining duration * address review comments mostly * fix lint * upgrade actitypub-fed to simpler interface * fix sql format * increase delays a bit * fixes after merge * remove selectable * fix instance selectable * add comment * start federation based on latest id at the time * rename federate process args * dead instances in one query * filter follow+report activities by local * remove synchronous federation remove activity sender queue * lint * fix federation tests by waiting for results to change * fix fed test * fix comment report * wait some more * Apply suggestions from code review Co-authored-by: SorteKanin <sortekanin@gmail.com> * fix most remaining tests * wait until private messages * fix community tests * fix community tests * move arg parse * use instance_id instead of domain in federation_queue_state table --------- Co-authored-by: Dessalines <dessalines@users.noreply.github.com> Co-authored-by: SorteKanin <sortekanin@gmail.com>	8 months ago
Nutomic	71d61138bc	Replace ammonia lib with manual html escaping (fixes #3774 ) (#3938 ) * Replace ammonia lib with manual html escaping (fixes #3774) * prettier * clippy * remove sanitize unit test * fix tests * fix schema	9 months ago
Dessalines	56e26fc3d4	Adding a post_view mode. Fixes #3730 (#3731 ) * Adding a post_view mode. Fixes #3730 * Fix test. * Addressing PR comments. * Adding a post_view mode. Fixes #3730 * Fix test. * Addressing PR comments. * Fixing column order. * Fix default Ok returns. * Removing return Err(... where feasible.	9 months ago
dullbananas	969f8b2ce9	Replace TypedBuilder with Default in update forms (#3814 ) * Update comment.rs * Update community.rs * Update local_site.rs * Update local_site_rate_limit.rs * Update local_user.rs * Update person.rs * Update comment.rs * Update community.rs * Update local_site.rs * Update local_site_rate_limit.rs * Update local_user.rs * Update post.rs * Update private_message.rs * Update site.rs * Update post.rs * Update person.rs * Update private_message.rs * Update comment.rs * Update create.rs * Update leave_admin.rs * Update update.rs * Update remove.rs * Update add_admin.rs * Update verify_email.rs * Update mod.rs * Update mod.rs * Update undo_delete.rs * Update undo_delete.rs * Update utils.rs * Update feature.rs * Update delete.rs * Update lock.rs * Update create.rs * Update approve.rs * Update update.rs * Update lock_page.rs * Update block_user.rs * Update delete.rs * Update undo_block_user.rs * Update collection_remove.rs * Update post.rs * Update hide.rs * Update person.rs * Update remove.rs * Update post_view.rs * Update create.rs * Update remove.rs * Update collection_add.rs * Update community.rs * Update update.rs * Update post_aggregates.rs * Update update.rs * Update comment.rs * Update code_migrations.rs * Update registration_application_view.rs * Update update.rs * Update ban_person.rs * Update community.rs * Update delete.rs * Update delete.rs * Update delete.rs * Update person_aggregates.rs * Update save_settings.rs * Update distinguish.rs * Update mark_read.rs * Update site_aggregates.rs * Update create.rs * Fix * rerun ci * Update comment.rs * rerun ci * Update create.rs * Update create.rs * Update post_view.rs * rerun ci * Update undo_delete.rs * rerun ci	10 months ago
Nutomic	27be1efb74	Rewrite remaining federation actions, get rid of PerformCrud trait (#3794 ) * Rewrite ban actions * Rewrite delete/remove actions * Rewrite remove/delete community * Rewrite report actions * Rewrite feature/lock post * Rewrite update community actions * Rewrite remaining federation actions * Get rid of PerformCrud trait * clippy	10 months ago
Nutomic	3471f3533c	Sanitize html (#3708 ) * HTML sanitization in apub code * Sanitize API inputs * fmt * Dont allow html a, img tags --------- Co-authored-by: Dessalines <dessalines@users.noreply.github.com>	10 months ago
Nutomic	102124b6d2	Change logic for determining comment default language (fixes #3451 ) (#3672 )	10 months ago
Nutomic	5d23ef960e	Remove SendActivity and Perform traits, rely on channel (#3596 ) * Remove SendActivity and Perform traits, rely on channel These traits arent necessary anymore now that websocket is removed. Removing them allows us to use normal actix http handler methods which are much more flexible, and allow using different middlewares as well as setting response attributes. * compiling and create post federating * clippy * rename methods, join outgoing activities task * fix api tests * no unwrap * conditional compile * add back getrandom * make crates optional * fmt	10 months ago
dullbananas	1d38aad9d3	Make functions work with both connection and pool (#3420 ) * a lot * merge * Fix stuff broken by merge * Get rid of repetitive `&mut context.conn().await?` Add blank lines under each line with `conn =` * Fix style mistakes (partial) * Revert "Fix style mistakes (partial)" This reverts commit `48a033b87f`. * Revert "Add blank lines under each line with `conn =`" This reverts commit `773a6d3beb`. * Revert "Get rid of repetitive `&mut context.conn().await?`" This reverts commit `d2c6263ea1`. Use DbConn for CaptchaAnswer methods * DbConn trait * Remove more `&mut ` Fix stuff * Re-run CI * try to make ci start * fix * fix * Fix api_common::utils * Fix apub::activities::block * Fix apub::api::resolve_object * Fix some things * Revert "Fix some things" This reverts commit `2bf8574bc8`. * Revert "Fix apub::api::resolve_object" This reverts commit `3e4059aabb`. * Revert "Fix apub::activities::block" This reverts commit `3b02389abd`. * Revert "Fix api_common::utils" This reverts commit `7dc73de613`. * Revert "Revert "Fix api_common::utils"" This reverts commit `f740f115e5`. * Revert "Revert "Fix apub::activities::block"" This reverts commit `2ee206af7c`. * Revert "Revert "Fix apub::api::resolve_object"" This reverts commit `96ed8bf2e9`. * Fix fetch_local_site_data * Fix get_comment_parent_creator * Remove unused perma deleted text * Fix routes::feeds * Fix lib.rs * Update lib.rs * rerun ci * Attempt to create custom GetConn and RunQueryDsl traits * Start over * Add GetConn trait * aaaa * Revert "aaaa" This reverts commit `acc9ca1aed`. * Revert "Revert "aaaa"" This reverts commit `443a2a00a5`. * still aaaaaaaaaaaaa * Return to earlier thing Revert "Add GetConn trait" This reverts commit `ab4e94aea5`. * Try to use DbPool enum * Revert "Try to use DbPool enum" This reverts commit `e4d1712646`. * DbConn and DbPool enums (db_schema only fails to compile for tests) * fmt * Make functions take `&mut DbPool<'_>` and make db_schema tests compile * Add try_join_with_pool macro and run fix-clippy on more crates * Fix some errors * I did it * Remove function variants that take connection * rerun ci * rerun ci * rerun ci	10 months ago
Nutomic	93225e5ddf	Error enum fixed (#3487 ) * Create error type enum * Replace magic string slices with LemmyErrorTypes * Remove unused enum * Add rename snake case to error enum * Rename functions * clippy * Fix merge errors * Serialize in PascalCase instead of snake_case * Revert src/lib * Add serialization tests * Update translations * Fix compilation error in test * Fix another compilation error * Add code for generating typescript types * Various fixes to avoid breaking api * impl From<LemmyErrorType> for LemmyError * with_lemmy_type * trigger ci --------- Co-authored-by: SleeplessOne1917 <abias1122@gmail.com>	10 months ago
phiresky	b35757b429	Improve api response times by doing send_activity asynchronously (#3493 ) * do send_activity after http response * move to util function * format * fix prometheus * make synchronous federation configurable * cargo fmt * empty * empty --------- Co-authored-by: Dessalines <dessalines@users.noreply.github.com>	11 months ago
Nutomic	00f9f79a44	Only allow http(s) scheme for urls (ref #3505 ) (#3508 ) With this change only http(s) schemes are allowed for post.url field. This is checked for incoming api and federation requests. Existing posts in database which are sent to clients are not checked. Neither does it check urls in markdown.	11 months ago
Nutomic	e1494d4683	Dont compare db string errors (fixes #1393 ) (#3424 ) * Dont compare db string errors (fixes #1393) * cargo fmt --------- Co-authored-by: Dessalines <dessalines@users.noreply.github.com>	11 months ago
Lemmus.org	810762762f	Update federated posts to not cache sensitive images if not allow by local site (#3253 ) * Update federated posts to not cache sensitive images if not allow by local site * Refactor thumbnail match to simplify logic	11 months ago
Neshura	203e35899e	Add separate Post check for is_valid_body_field (#3263 ) * Add separate Post check for is_valid_body_field * Modify is_valid_body_check for posts only * Fix check var reinit in validation.rs * Extra empty line to rerun woodpecker with changes * Change Option to bool, add false to non-post calls * Woodpecker trick.. again * Probable rust_fmt fail fixed * cargo_clippy changes * Missing space between = and if * Remove ; after body length checks	11 months ago
Nutomic	3565ad984a	Remove chatserver (#2919 ) * Remove chatserver * fix clippy * Remove captchas (fixes #2922) * fix prettier * fix api_common build * cargo fmt	12 months ago
Nutomic	a5707328cf	Dont return error in case optional auth is invalid (#2879 ) * Dont return error in case optional auth is invalid * fixes	1 year ago
Dessalines	38d4429ae7	Adding check to description and body length fields. (#2805 ) * Adding check to description and body length fields. - Also making the checks return `LemmyError` - Fixes #1747 * Address PR comments. * PR comments 2	1 year ago
Dessalines	63f54a3103	Making the chat server an actor. (#2793 ) * Making the chat server an actor. - Fixes #2778 - #2787 * Forgot to add handlers folder. * Some cleanup. * Forgot to remove a comment. * Address PR comments. * Using ToString for enum operations.	1 year ago
Dessalines	36aaa50644	Organize utils into separate files. Fixes #2295 (#2736 ) * Organize utils into separate files. Fixes #2295 * Moving tests. * Fix test. * Fix test 2	1 year ago
Felix Ableitner	c6c52ab9cc	Add SendActivity trait so that api crates compile in parallel with lemmy_apub	1 year ago
Felix Ableitner	201fa97769	Move code to generate apub urls into lemmy_api_common	1 year ago
Felix Ableitner	030afbc2e7	Merge websocket crate into api_common	1 year ago
Nutomic	bcf5c91f81	Use audience field to federate items in groups (fixes #2464 ) (#2584 )	1 year ago
Nutomic	6f3bf4634b	Various pedantic clippy fixes (#2568 ) * Various pedantic clippy fixes * more clippy pedantic fixes * try to fix ci * add fix clippy script, use rust 1.65 * fix clippy	2 years ago
Dessalines	5d837780f5	Add diesel_async, get rid of blocking function (#2510 ) * Moving settings to Database. - Moves many settings into the database. Fixes #2285 - Adds a local_site and instance table. Fixes #2365 . Fixes #2368 - Separates SQL update an insert forms, to avoid runtime errors. - Adds TypedBuilder to all the SQL forms, instead of default. * Fix weird clippy issue. * Removing extra lines. * Some fixes from suggestions. * Fixing apub tests. * Using instance creation helper function. * Move forms to their own line. * Trying to fix local_site_data, still broken. * Testing out async * Testing out async 2 * Fixing federation tests. * Trying to fix check features 1. * Starting on adding diesel async. 1/4th done. * Added async to views and schema. * Adding some more async * Compiling now. * Added diesel async. Fixes #2465 * Running clippy --fix * Trying to fix cargo test on drone. * Trying new muslrust. * Trying a custom dns * Trying a custom dns 2 * Trying a custom dns 3 * Trying a custom dns 4 * Trying a custom dns 5 * Trying a custom dns 6 * Trying a custom dns 7 * Addressing PR comments. * Adding check_apub to all verify functions. * Reverting back drone. * Fixing merge * Fix docker images. * Adding missing discussion_languages. * Trying to fix federation tests. * Fix site setup user creation. * Fix clippy * Fix clippy 2 * Test api faster * Try to fix 1 * Try to fix 2 * What are these lines about * Trying to fix 3 * Moving federation test back to top. * Remove logging cat.	2 years ago
Dessalines	235cc8b228	Moving settings to Database. (#2492 ) * Moving settings to Database. - Moves many settings into the database. Fixes #2285 - Adds a local_site and instance table. Fixes #2365 . Fixes #2368 - Separates SQL update an insert forms, to avoid runtime errors. - Adds TypedBuilder to all the SQL forms, instead of default. * Fix weird clippy issue. * Removing extra lines. * Some fixes from suggestions. * Fixing apub tests. * Using instance creation helper function. * Move forms to their own line. * Trying to fix local_site_data, still broken. * Fixing federation tests. * Trying to fix check features 1. * Addressing PR comments. * Adding check_apub to all verify functions.	2 years ago
Nutomic	2ef0f8f5f8	implement language tags for site/community in db and api (#2434 ) * implement language tags for site/community in db and api * add api checks for valid languages * during db migration, update existing users, sites, communities to have all languages enabled * init new users/communities with site languages (not all languages) * federate site/community languages * fix tests * when updating site languages, limit community languages to this subset also, when making a new post and subset of user lang, community lang contains only one item, use that as post lang * add tests for actor_language db functions * include language list in siteview/communityview * Fix some of the review comments * Some more review changes * Add todo about boxed query * Add default_post_language to GetCommunityResponse	2 years ago
Dessalines	c9f1407429	Diesel 2.0.0 upgrade (#2452 ) * Initial commit to bump diesel to 2.0.0-rc.0 and see what happens * Add chrono feature from diesel * db_schema crate is close to building? * Upgrade diesel-derive-newtype * Mostly modifying references to connections to be mutable ones; also used new way to do migrations as suggested by the migration guide; a lot more compiles now, though I can't figure out this tricky ToSql issue at the moment * Running clippy --fix * Trying to fix drone clippy 1 * Fix clippy * Upgrade clux-musl * Trying to fix drone clippy 2 * Trying to fix drone clippy 3 * Trying to fix drone clippy 5 * Adding diesel table aliases, removing sql view hack. Fixes #2101 Co-authored-by: Steven Chu <stevenc1@gmail.com> Co-authored-by: Nutomic <me@nutomic.com>	2 years ago
Felix Ableitner	d058e2217a	api changes for comment language tagging	2 years ago
Nutomic	e4a49b6eab	Tag posts and comments with language (fixes #440 ) (#2269 ) * Tag posts and comments with language (fixes #440) * Untangle PostView tests * Implement test for PostView language query * Store languages directly in database * finish moving languages into db, it compiles * update post_view * serde skip Language.id field * add local_user_language table, other changes suggested in review * add code for local_user_discussion_language_view * Remove unnecessary clones in db view converteres * Fixing up some table and join issues. * Clearing the current languages. * Fix formatting. * update user languages in single transaction * proper test for user language queries * Some fixes for all / missing user languages. (#2404) * Some fixes for all / missing user languages. * Adding back in transaction. * fix test Co-authored-by: Dessalines <tyhou13@gmx.com> Co-authored-by: Dessalines <dessalines@users.noreply.github.com>	2 years ago
Dessalines	8bfeb4b627	Fix a few form options for diesel. Fixes #2287 (#2376 ) * Fix a few form options for diesel. Fixes #2287 * Adding TODO comment.	2 years ago
Dessalines	a745fa6f43	Remove update and read site config. Fixes #2306 (#2329 ) * Remove update and read site config. Fixes #2306 * Removing lazy_static, removing Settings::get()	2 years ago
Nutomic	339eab01fd	Embed Peertube videos (#2261 ) * Use og:video attribute for embeds, change Post.embed_html to embed_url * fix clippy	2 years ago
Nutomic	a2a594b763	Extract Activitypub logic into separate library (#2288 ) * Create example for apub lib * some rewriting of apub lib * Add LocalInstance struct for apub lib to avoid using Lemmy Settings * Move ActorType trait to lemmy_apub, because its not needed in library * Use reqwest_retry instead of custom impl, dont specify timeout on every send() * Some improvements to example * Moved inbox handling to library * bug fixes * Move context and serde helpers into library * wip: example changes * Add lemmy_utils feature to build only LemmyError * Rename to activitypub_federation * Remove lemmy_utils dep from activitypub_federation using generic error type * Finish activitypub example * Cleanup and fix tests * Reorganize library files * Remove ApubObject.to_tombstone() * Extract activitypub library into separate git repository	2 years ago
Nutomic	3aa3d75a1e	Add cargo feature for building lemmy_api_common with mininum deps (#2243 )	2 years ago
Nutomic	7058cfa1cf	Implement restricted community (only mods can post) (fixes #187 ) (#2235 ) * Implement restricted community (only mods can post) (fixes #187) * review fixes * fix tests	2 years ago
Nutomic	9ac1f46a2b	Dont federate initial upvote (#2196 )	2 years ago
Nutomic	166ec196b0	Rework error handling (fixes #1714 ) (#2135 )	2 years ago
Dessalines	19ccaf767c	Cleaning optional post bodies. Fixes #2039 (#2043 ) * Cleaning optional post bodies. Fixes #2039 * Only trim once. * Using .map() instead.	2 years ago
Riley	3032a2745b	Opentelemetry (#1992 ) * Add otlp export * Add jaeger to dev docker * More instrument * Update deps * Merge from main. * Add comment about viewing traces * Fixing reqwest-tracing dep. * Update pre-commit regex * Move imports to top Co-authored-by: Dessalines <tyhou13@gmx.com> Co-authored-by: Dessalines <dessalines@users.noreply.github.com>	2 years ago
Riley	35cbae61bc	Don't drop error context when adding a message to errors (#1958 ) * Respond directly with LemmyError Instrument Perform implementations for more precise traces Use ApiError to format JSON errors when messages are present Keep SpanTrace output in LemmyError Display impl * Hide SpanTrace debug output from LemmyError * Don't log when entering spans, only when leaving * Update actix-web * Update actix-rt * Add newline after error info in LemmyError Display impl * Propogate span information to blocking operations * Instrument apub functions * Use skip_all for more instrument attributes, don't skip 'self' in some api actions * Make message a static string * Send proper JSON over websocket * Add 'message' to LemmyError display if present * Use a quieter root span builder, don't pretty-print logs * Keep passwords and emails out of logs * Re-enable logging Login * Instrument feeds * Emit our own errors * Move error log after status code recording * Make Sensitive generic over the inner type * Remove line that logged secrets	2 years ago
Riley	3fea5645f8	Add tracing (#1942 )	3 years ago
Dessalines	76220a4523	Fixing clippy lints. (#1885 ) * Fixing clippy lints. * Revert object id display * Trying to fix clippy again	3 years ago
Felix Ableitner	8ea21c39b7	Reduce stack memory usage in apub code - use our own, smaller Endpoints struct - wrap ObjectId.url in Box - adjust usage of Box in different places	3 years ago
Felix Ableitner	c725514841	Change to_apub and from_apub to take by value and avoid cloning	3 years ago
Felix Ableitner	2edf8ba157	Move ObjectId to library	3 years ago
Felix Ableitner	03d8ac75ef	Move activity structs to protocol folder	3 years ago
Felix Ableitner	614490d29b	Fix problem that prevented viewing of pleroma user profiles	3 years ago
Felix Ableitner	1aa0e1997b	Major refactor, adding newtypes for apub crate - this allows moving FromApub/ToApub traits into apub lib	3 years ago

1 2

71 Commits (375d9a2a3cf9c023ac6ac832d98f1b456fb9e2ce)