lemmy

Commit Graph

Author	SHA1	Message	Date
phiresky	375d9a2a3c	Persistent, performant, reliable federation queue (#3605 ) * persistent activity queue * fixes * fixes * make federation workers function callable from outside * log federation instances * dead instance detection not needed here * taplo fmt * split federate bin/lib * minor fix * better logging * log * create struct to hold cancellable task for readability * use boxfuture for readability * reset submodule * fix * fix lint * swap * remove json column, use separate array columns instead * some review comments * make worker a struct for readability * minor readability * add local filter to community follower view * remove separate lemmy_federate entry point * fix remaining duration * address review comments mostly * fix lint * upgrade actitypub-fed to simpler interface * fix sql format * increase delays a bit * fixes after merge * remove selectable * fix instance selectable * add comment * start federation based on latest id at the time * rename federate process args * dead instances in one query * filter follow+report activities by local * remove synchronous federation remove activity sender queue * lint * fix federation tests by waiting for results to change * fix fed test * fix comment report * wait some more * Apply suggestions from code review Co-authored-by: SorteKanin <sortekanin@gmail.com> * fix most remaining tests * wait until private messages * fix community tests * fix community tests * move arg parse * use instance_id instead of domain in federation_queue_state table --------- Co-authored-by: Dessalines <dessalines@users.noreply.github.com> Co-authored-by: SorteKanin <sortekanin@gmail.com>	9 months ago
Nutomic	b2aee565f3	Allow passing auth via header or cookie (#3725 ) * Allow passing auth via header or cookie * revert submodule * taplo * fix build * working * convert apub api methods * also set cache-control header * opt * clippy * deduplicate code, ignore invalid auth * clippy --------- Co-authored-by: Dessalines <dessalines@users.noreply.github.com>	9 months ago
Nutomic	ccc122100e	Fix process shutdown (#3673 ) I noticed that stopping the Lemmy process with ctrl+c wasnt working because the activity channel isnt properly closed. This is now fixed. Later we should also move the channel from static into LemmyContext, Im not doing that now to avoid conflicts with #3670.	11 months ago
Nutomic	5d23ef960e	Remove SendActivity and Perform traits, rely on channel (#3596 ) * Remove SendActivity and Perform traits, rely on channel These traits arent necessary anymore now that websocket is removed. Removing them allows us to use normal actix http handler methods which are much more flexible, and allow using different middlewares as well as setting response attributes. * compiling and create post federating * clippy * rename methods, join outgoing activities task * fix api tests * no unwrap * conditional compile * add back getrandom * make crates optional * fmt	11 months ago
cetra3	9256895635	Cache & Optimize Woodpecker CI (#3450 ) * Try using drone cache plugin * Try another path * Include volume * Fix formatting * Include fmt * Exclude cargo dir from prettier * Don't override cargo * Just do check * Add cache key * Use different cache plugin * Add clippy * Try minio * Add quotes * Try adding secrets * Try again * Again * Use correct secret formation * Add back clippy * Use secret for the root bucket name * Try drone cache instead * Add region * Add path-style option * Include cargo clippy * Include everything again * Fix formatting * Don't run clippy twice * Add `allow` statements for tests to pass * Adjust endpoint to be a secret * Fix prettier * Merge & fix tests * Try to restart the woodpecker test * Change the ENV var name --------- Co-authored-by: Dessalines <dessalines@users.noreply.github.com>	11 months ago
dullbananas	1d38aad9d3	Make functions work with both connection and pool (#3420 ) * a lot * merge * Fix stuff broken by merge * Get rid of repetitive `&mut context.conn().await?` Add blank lines under each line with `conn =` * Fix style mistakes (partial) * Revert "Fix style mistakes (partial)" This reverts commit `48a033b87f`. * Revert "Add blank lines under each line with `conn =`" This reverts commit `773a6d3beb`. * Revert "Get rid of repetitive `&mut context.conn().await?`" This reverts commit `d2c6263ea1`. Use DbConn for CaptchaAnswer methods * DbConn trait * Remove more `&mut ` Fix stuff * Re-run CI * try to make ci start * fix * fix * Fix api_common::utils * Fix apub::activities::block * Fix apub::api::resolve_object * Fix some things * Revert "Fix some things" This reverts commit `2bf8574bc8`. * Revert "Fix apub::api::resolve_object" This reverts commit `3e4059aabb`. * Revert "Fix apub::activities::block" This reverts commit `3b02389abd`. * Revert "Fix api_common::utils" This reverts commit `7dc73de613`. * Revert "Revert "Fix api_common::utils"" This reverts commit `f740f115e5`. * Revert "Revert "Fix apub::activities::block"" This reverts commit `2ee206af7c`. * Revert "Revert "Fix apub::api::resolve_object"" This reverts commit `96ed8bf2e9`. * Fix fetch_local_site_data * Fix get_comment_parent_creator * Remove unused perma deleted text * Fix routes::feeds * Fix lib.rs * Update lib.rs * rerun ci * Attempt to create custom GetConn and RunQueryDsl traits * Start over * Add GetConn trait * aaaa * Revert "aaaa" This reverts commit `acc9ca1aed`. * Revert "Revert "aaaa"" This reverts commit `443a2a00a5`. * still aaaaaaaaaaaaa * Return to earlier thing Revert "Add GetConn trait" This reverts commit `ab4e94aea5`. * Try to use DbPool enum * Revert "Try to use DbPool enum" This reverts commit `e4d1712646`. * DbConn and DbPool enums (db_schema only fails to compile for tests) * fmt * Make functions take `&mut DbPool<'_>` and make db_schema tests compile * Add try_join_with_pool macro and run fix-clippy on more crates * Fix some errors * I did it * Remove function variants that take connection * rerun ci * rerun ci * rerun ci	11 months ago
Pawan Hegde	ef9dc5d0b6	Fix #3366 : Wrap plain-text error responses from the API in JSON (#3559 ) * Fix #3366: API does return plain HTML errors * Fix Clippy errors * Improve api response times by doing send_activity asynchronously (#3493) * do send_activity after http response * move to util function * format * fix prometheus * make synchronous federation configurable * cargo fmt * empty * empty --------- Co-authored-by: Dessalines <dessalines@users.noreply.github.com> * Updating `login.rs` with generic `incorrect_login` response. (#3549) * Adding v0.18.1 and v0.18.0 release notes. (#3530) * Update RELEASES.md (#3556) added instruction to find the location of your docker directory (especially useful for those who used ansible since they never had to setup docker manually) * Use async email sender (#3554) * Upgrade all dependencies (#3526) * Upgrade all dependencies * as base64 * Adding phiresky to codeowners. (#3576) * Error enum fixed (#3487) * Create error type enum * Replace magic string slices with LemmyErrorTypes * Remove unused enum * Add rename snake case to error enum * Rename functions * clippy * Fix merge errors * Serialize in PascalCase instead of snake_case * Revert src/lib * Add serialization tests * Update translations * Fix compilation error in test * Fix another compilation error * Add code for generating typescript types * Various fixes to avoid breaking api * impl From<LemmyErrorType> for LemmyError * with_lemmy_type * trigger ci --------- Co-authored-by: SleeplessOne1917 <abias1122@gmail.com> * Only update site_aggregates for local site (#3516) * Fix #3501 - Fix aggregation counts for elements removed and deleted (#3543) Two bugs were found and fixed: - previously elements removal and deletion were counted as two separate disappearances - removing comments did not affect post aggregations * Use LemmyErrorType also make error_type compulsory * Add missing import for jsonify_plain_text_errors * Fix formatting * Trying to make woodpecker run again --------- Co-authored-by: phiresky <phireskyde+git@gmail.com> Co-authored-by: Dessalines <dessalines@users.noreply.github.com> Co-authored-by: rosenjcb <rosenjcb@gmail.com> Co-authored-by: nixoye <12674582+nixoye@users.noreply.github.com> Co-authored-by: dullbananas <dull.bananas0@gmail.com> Co-authored-by: Nutomic <me@nutomic.com> Co-authored-by: SleeplessOne1917 <abias1122@gmail.com> Co-authored-by: Sander Saarend <sander@saarend.com> Co-authored-by: Piotr Juszczyk <74842304+pijuszczyk@users.noreply.github.com>	11 months ago
phiresky	b35757b429	Improve api response times by doing send_activity asynchronously (#3493 ) * do send_activity after http response * move to util function * format * fix prometheus * make synchronous federation configurable * cargo fmt * empty * empty --------- Co-authored-by: Dessalines <dessalines@users.noreply.github.com>	11 months ago
Diamond	084f603745	Allow cross-origin requests (#3421 ) Co-authored-by: pfg <pfg@pfg.pw>	11 months ago
Andrew Fields	1e99e8b9dc	Add Prometheus endpoint (#3456 ) Add a server for serving Prometheus metrics. Include a configuration block in the config file. Provide HTTP metrics on the API, along with process-level metrics and DB pool metrics.	11 months ago
Lemmus.org	ff47d97bd3	Add feature for enabling json logging (#3462 )	11 months ago
dullbananas	b2a9d4a335	Use compression middleware (#3343 )	11 months ago
cetra3	9406c3ad2b	Adjust the config check to be a separate faster to compile binary (#3313 )	11 months ago
cetra3	d7da911a48	Remove `actix_rt` & use standard tokio spawn (#3158 ) * Remove `actix_rt` & use standard tokio spawn * Adjust rust log back down * Format correctly * Update cargo lock * Add DB settings * Change name and update to latest rev * Clean up formatting changes * Move `worker_count` and `worker_retry_count` to settings * Update defaults * Use `0.4.4` instead of git branch	11 months ago
Nutomic	ffce66abb8	Update apub library to 0.4.4 (#3258 ) Co-authored-by: Dessalines <dessalines@users.noreply.github.com>	12 months ago
Óliver García Albertos	985359918f	logger: Use forwarded instead of peer IP address (#3223 )	12 months ago
dullbananas	45818fb4c5	Reduce memory usage of rate limiting (#3111 ) * Reduce Vec allocations * Optimize stuff * Move embedded migrations to separate crate * Revert "Move embedded migrations to separate crate" This reverts commit `44b1049970`. * clippy, fmt * Shrink rate limit allowance to f32 * Initialize rate limit allowance directly * Add removal of old rate limit buckets * Improve readability * Remove usage of is_okay_and for Rust 1.67 compatibility * Add dhat-heap feature * Fix api_benchmark.sh and add run_and_benchmark.sh * Revert "Fix api_benchmark.sh and add run_and_benchmark.sh" This reverts commit `b4528e5b85`. * Revert "Add dhat-heap feature" This reverts commit `08e835d487`. * Manually revert remaining stuff * Use Ipv6Addr in RateLimitStorage * Shrink last_checked in RateLimitBucket to 32 bits * Fix rate_limit::get_ip * Stuff (#1) * Update rate_limiter.rs * Update mod.rs * Update scheduled_tasks.rs * Fix rate_limiter.rs * Dullbananas patch 1 (#2) * Update rate_limiter.rs * Update mod.rs * Update scheduled_tasks.rs * Fix rate_limiter.rs * Rate limit IPv6 addresses in groups * Fmt lib.rs * woodpicker trigger * Refactor and comment `check_rate_limit_full` * Add `test_split_ipv6` * Replace -2.0 with UNINITIALIZED_TOKEN_AMOUNT * Add `test_rate_limiter` --------- Co-authored-by: Dessalines <dessalines@users.noreply.github.com>	12 months ago
Dessalines	b214d3dc00	Adding current domain from settings to CORs. (#3231 )	12 months ago
Nutomic	b37c30ffae	Move cors default to source code (#3219 )	12 months ago
Andrew DeLisa	bfc0c0e7d3	fix: add CORS origin environment variable (#3191 ) * fix: add CORS origin environment variable * chore: formatting --------- Co-authored-by: Dessalines <dessalines@users.noreply.github.com>	12 months ago
Sander Saarend	68d814b9b1	Handle scheduled task errors (#3090 ) * Add --disable-scheduled-tasks CLI flag * Add error handling for scheduled tasks	12 months ago
Nutomic	3565ad984a	Remove chatserver (#2919 ) * Remove chatserver * fix clippy * Remove captchas (fixes #2922) * fix prettier * fix api_common build * cargo fmt	1 year ago
Dessalines	af3eb6e27b	Add CORS support for debug mode. (#2884 )	1 year ago
Nutomic	4240af86ca	Remove websocket code (#2878 ) Co-authored-by: Dessalines <dessalines@users.noreply.github.com>	1 year ago
Felix Ableitner	df57795595	Dont retry outgoing HTTP requests (ref #2865 )	1 year ago
Dessalines	63f54a3103	Making the chat server an actor. (#2793 ) * Making the chat server an actor. - Fixes #2778 - #2787 * Forgot to add handlers folder. * Some cleanup. * Forgot to remove a comment. * Address PR comments. * Using ToString for enum operations.	1 year ago
Nutomic	6f513793cb	Activitypub crate rewrite (#2782 ) * update activitypub-federation crate to 0.4.0 * fixes * apub compiles! * everything compiling! * almost done, federated follow failing * some test fixes * use release * add code back in	1 year ago
Dessalines	209c8a9185	Switch from bb8 to deadpool. Fixes #2765 (#2768 ) * Switch from bb8 to deadpool. Fixes #2765 * Remove unecessary deadpool dependency. * Ignoring nodeinfo test.	1 year ago
Dessalines	8c0c1628e0	Adding a vector indexing check to prevent panics. Fixes #2753 (#2754 ) * Adding a vector indexing check to prevent panics. Fixes #2753 * Fixing for new clippy lint. * Externalizing get_top_mod check. Adding get_first clippy lint * Removing unit tests get(0)s * Fixing some firsts manually	1 year ago
Dessalines	3735c6fabf	Adding instance software and version. Fixes #2222 (#2733 ) * Adding instance software and version. Fixes #2222 * Fix clippy. * Fix clippy 2 * Fixing some more issues.	1 year ago
Nutomic	c3fbb7702f	Allow embedding Lemmy, fix setup error (#2618 ) * Fix error during site creation due to empty LocalSiteRateLimit update * Move main function into lib.rs, to allow calling from other crates Co-authored-by: Dessalines <dessalines@users.noreply.github.com>	1 year ago
Nutomic	2732a5bf07	Rework websocket (#2598 ) * Merge websocket crate into api_common * Add SendActivity trait so that api crates compile in parallel with lemmy_apub * Rework websocket code * fix websocket heartbeat	2 years ago
Dessalines	235cc8b228	Moving settings to Database. (#2492 ) * Moving settings to Database. - Moves many settings into the database. Fixes #2285 - Adds a local_site and instance table. Fixes #2365 . Fixes #2368 - Separates SQL update an insert forms, to avoid runtime errors. - Adds TypedBuilder to all the SQL forms, instead of default. * Fix weird clippy issue. * Removing extra lines. * Some fixes from suggestions. * Fixing apub tests. * Using instance creation helper function. * Move forms to their own line. * Trying to fix local_site_data, still broken. * Fixing federation tests. * Trying to fix check features 1. * Addressing PR comments. * Adding check_apub to all verify functions.	2 years ago
Nutomic	d0a3d99636	Config changes, remove unused image purge function (#2343 ) * Throw error if old pictrs config item is used, make api key optional * use doku url feature * fix doku version * fix clippy * remove unused image purge function, remove config migration	2 years ago
Nutomic	a2a594b763	Extract Activitypub logic into separate library (#2288 ) * Create example for apub lib * some rewriting of apub lib * Add LocalInstance struct for apub lib to avoid using Lemmy Settings * Move ActorType trait to lemmy_apub, because its not needed in library * Use reqwest_retry instead of custom impl, dont specify timeout on every send() * Some improvements to example * Moved inbox handling to library * bug fixes * Move context and serde helpers into library * wip: example changes * Add lemmy_utils feature to build only LemmyError * Rename to activitypub_federation * Remove lemmy_utils dep from activitypub_federation using generic error type * Finish activitypub example * Cleanup and fix tests * Reorganize library files * Remove ApubObject.to_tombstone() * Extract activitypub library into separate git repository	2 years ago
Felix Ableitner	80684de7da	Make opentelemetry dependency optional	2 years ago
Aode (lion)	2e5746b74f	Add console feature flag, not default The most recent tracing-core changed the number of variants on metadata::Kind, which broke console-api 0.1.1, and no fix has been applied yet. To avoid build failures, disable console-subscriber for now	2 years ago
Riley	41b90bb162	Add console-subscriber (#2003 ) * Add console-subscriber * Add larg event buffer capacity * Add console port to lemmy prod container * Expose pict-rs console port * Update pictrs	2 years ago
Riley	3032a2745b	Opentelemetry (#1992 ) * Add otlp export * Add jaeger to dev docker * More instrument * Update deps * Merge from main. * Add comment about viewing traces * Fixing reqwest-tracing dep. * Update pre-commit regex * Move imports to top Co-authored-by: Dessalines <tyhou13@gmx.com> Co-authored-by: Dessalines <dessalines@users.noreply.github.com>	2 years ago
Riley	35cbae61bc	Don't drop error context when adding a message to errors (#1958 ) * Respond directly with LemmyError Instrument Perform implementations for more precise traces Use ApiError to format JSON errors when messages are present Keep SpanTrace output in LemmyError Display impl * Hide SpanTrace debug output from LemmyError * Don't log when entering spans, only when leaving * Update actix-web * Update actix-rt * Add newline after error info in LemmyError Display impl * Propogate span information to blocking operations * Instrument apub functions * Use skip_all for more instrument attributes, don't skip 'self' in some api actions * Make message a static string * Send proper JSON over websocket * Add 'message' to LemmyError display if present * Use a quieter root span builder, don't pretty-print logs * Keep passwords and emails out of logs * Re-enable logging Login * Instrument feeds * Emit our own errors * Move error log after status code recording * Make Sensitive generic over the inner type * Remove line that logged secrets	3 years ago
Riley	3fea5645f8	Add tracing (#1942 )	3 years ago
Felix Ableitner	01fc1228d5	Fix API and clippy warnings	3 years ago
Felix Ableitner	999d9f4d6c	Move routes into separate crate to speed up compilation	3 years ago
Dessalines	0fd0279543	Adding some recurring lemmy tasks. (#1386 ) * Adding some recurring lemmy tasks. - Add active users by day, week, month, and half year to site and community. Fixes #1195 - Periodically re-index the aggregates tables that use hot_rank. Fixes #1384 - Clear out old activities (> 6 months). Fixes #1133 * Some cleanup, recalculating actives every hour.	3 years ago
Felix Ableitner	8920f439ce	Generate valid RSS feed (fixes #1274 )	4 years ago
nutomic	442369a041	Move websocket code into workspace (#107 ) Adjust dockerfiles, fix cargo.toml and remove unused deps Merge branch 'main' into move-websocket-to-workspace Move api code into workspace Move apub to separate workspace Move websocket code into separate workspace Some code cleanup Remove websocket dependency on API Co-authored-by: Felix Ableitner <me@nutomic.com> Reviewed-on: https://yerbamate.dev/LemmyNet/lemmy/pulls/107	4 years ago
Felix Ableitner	9d4973829b	Add integration test to ensure that signatures are verified	4 years ago
Felix Ableitner	98c086abb9	Move websocket structs into lemmy_structs (ref #1115 )	4 years ago
Dessalines	5c6258390c	Isomorphic docker (#1124 ) * Adding a way to GetComments for a community given its name only. * Adding getcomments to api docs. * A first pass at locally working isomorphic integration. * Testing out cargo-husky. * Testing a fail hook. * Revert "Testing a fail hook." This reverts commit `0941cf1736`. * Moving server to top level, now that UI is gone. * Running cargo fmt using old way. * Adding nginx, fixing up docker-compose files, fixing docs. * Trying to re-add API tests. * Fixing prod dockerfile. * Redoing nightly fmt * Trying to fix private message api test. * Adding CommunityJoin, PostJoin instead of joins from GetComments, etc. - Fixes #1122 * Fixing fmt. * Fixing up docs. * Removing translations. * Adding apps / clients to readme. * Fixing main image. * Using new lemmy-isomorphic-ui with better javascript disabled. * Try to fix image uploads in federation test * Revert "Try to fix image uploads in federation test" This reverts commit `a2ddf2a90b`. * Fix post url federation * Adding some more tests, some still broken. * Don't need gitattributes anymore. * Update local federation test setup * Fixing tests. * Fixing travis build. * Fixing travis build, again. * Changing lemmy-isomorphic-ui to lemmy-ui * Error in travis build again. Co-authored-by: Felix Ableitner <me@nutomic.com>	4 years ago

49 Commits (375d9a2a3cf9c023ac6ac832d98f1b456fb9e2ce)