lemmy

Commit Graph

Author	SHA1	Message	Date
flamingos-cant	19a1a077c5	Add a blocklist for URLs. (#4515 ) * Add a blocklist for URLs. * Fix SQL format * Make clippy happy. * Use regex for URL matching. * Escape regex chars in URLs. * Use post for modification. * Make URL block regex static and remove API routes. * Add date fields to table and use transaction. * Use Cache for blocklist. * Rename check_links + move list to parameters of process_markdown. * SQL format. * Format, again. * Remove println. * Add API test. * Set a shorter lifetime for regex in debug mode. * Add missing macro. * Update lemmy-js-client * Update api_test/pnpm-lock.yaml * Don't break other tests * Use different URL for test --------- Co-authored-by: Dessalines <dessalines@users.noreply.github.com> Co-authored-by: Nutomic <me@nutomic.com>	2 months ago
Nutomic	5859502a2a	Fix missing private key for signed fetch (#4516 ) * Fix missing private key for signed fetch (fixes #4451) * clippy * instance actor name and webfinger * better webfinger handling * upgrade lib * update test asset	2 months ago
Dessalines	f3d48f2c2c	Adding some recommended fixes from nightly clippy. (#4473 )	3 months ago
Nutomic	86b44c2a4d	Add site.content_warning, local_site.default_post_listing_mode (#4393 ) * Include local_site.content_warning setting for showing nsfw by default * Add community setting `only_followers_can_vote` * clippy * add auto_expand_images site setting * cleanup * add missing api params * postquery/communityquery changes * clippy * change error * replace auto_expand_images with default_site_post_listing_mode * change post/community query params * get rid of only_followers_can_vote * machete * fix * clippy * revert remaining vote changes * remove dead code * remove unused var * fmt	3 months ago
Nutomic	e8a52d3a5c	Rewrite images to use local proxy (#4035 ) * Add markdown rule to add rel=nofollow for all links * Add markdown image rule to add local image proxy (fixes #1036) * comments * rewrite markdown image links working * add comment * perform markdown image processing in api/apub receivers * clippy * add db table to validate proxied links * rewrite link fields for avatar, banner etc * sql fmt * proxy links received over federation * add config option * undo post.url rewriting, move http route definition * add tests * proxy images through pictrs * testing * cleanup request.rs file * more cleanup (fixes #2611) * include url content type when sending post over apub (fixes #2611) * store post url content type in db * should be media_type * get rid of cache_remote_thumbnails setting, instead automatically take thumbnail from federation data if available. * fix tests * add setting disable_external_link_previews * federate post url as image depending on mime type * change setting again * machete * invert * support custom emoji * clippy * update defaults * add image proxy test, fix test * fix test * clippy * revert accidental changes * address review * clippy * Markdown link rule-dess (#4356) * Extracting opengraph_data to its own type. * A few additions for markdown-link-rule. --------- Co-authored-by: Nutomic <me@nutomic.com> * fix setting * use enum for image proxy setting * fix test configs * add config backwards compat * clippy * machete --------- Co-authored-by: Dessalines <dessalines@users.noreply.github.com>	4 months ago
ALEX11BR	a5289dd4cf	Use `pretty_assertions` for assertions (#4347 ) * Use `pretty_assertions` for assertions * fixed ordering of `use`s * ci --------- Co-authored-by: Felix Ableitner <me@nutomic.com>	5 months ago
Nutomic	fc56d0aa05	Use result instead of unwrap in apub tests (#4168 )	6 months ago
Nutomic	6d27bfed08	Handle invalid ban expires values (fixes #4045 ) (#4046 ) * Handle invalid ban expires values (fixes #4045) * Adding a few missing expire time checks. Fixing up time conversions. (#4051) * Adding a few missing expire time checks. Fixing up time conversions. * Increase settings export wait time. * get rid of RemoveCommunity.expires * fmt * tests --------- Co-authored-by: Dessalines <dessalines@users.noreply.github.com>	7 months ago
Nutomic	291ff19718	Only sanitize strings when generating RSS feeds and emails (fixes #4003 ) (#4024 ) * Only sanitize strings when generating RSS feeds and emails (fixes #4003) * clippy * fix test	7 months ago
phiresky	375d9a2a3c	Persistent, performant, reliable federation queue (#3605 ) * persistent activity queue * fixes * fixes * make federation workers function callable from outside * log federation instances * dead instance detection not needed here * taplo fmt * split federate bin/lib * minor fix * better logging * log * create struct to hold cancellable task for readability * use boxfuture for readability * reset submodule * fix * fix lint * swap * remove json column, use separate array columns instead * some review comments * make worker a struct for readability * minor readability * add local filter to community follower view * remove separate lemmy_federate entry point * fix remaining duration * address review comments mostly * fix lint * upgrade actitypub-fed to simpler interface * fix sql format * increase delays a bit * fixes after merge * remove selectable * fix instance selectable * add comment * start federation based on latest id at the time * rename federate process args * dead instances in one query * filter follow+report activities by local * remove synchronous federation remove activity sender queue * lint * fix federation tests by waiting for results to change * fix fed test * fix comment report * wait some more * Apply suggestions from code review Co-authored-by: SorteKanin <sortekanin@gmail.com> * fix most remaining tests * wait until private messages * fix community tests * fix community tests * move arg parse * use instance_id instead of domain in federation_queue_state table --------- Co-authored-by: Dessalines <dessalines@users.noreply.github.com> Co-authored-by: SorteKanin <sortekanin@gmail.com>	8 months ago
Nutomic	71d61138bc	Replace ammonia lib with manual html escaping (fixes #3774 ) (#3938 ) * Replace ammonia lib with manual html escaping (fixes #3774) * prettier * clippy * remove sanitize unit test * fix tests * fix schema	9 months ago
phiresky	514f2222e0	Fix time zone handling (#3496 ) * convert naive time to utc time * compounding fixes * cargo fmt * fix the rest * fix down migration * fix migrations * fix after merge * clippy fix * ap-fed 0.5.0 --------- Co-authored-by: Nutomic <me@nutomic.com>	9 months ago
Nutomic	3471f3533c	Sanitize html (#3708 ) * HTML sanitization in apub code * Sanitize API inputs * fmt * Dont allow html a, img tags --------- Co-authored-by: Dessalines <dessalines@users.noreply.github.com>	10 months ago
cetra3	9256895635	Cache & Optimize Woodpecker CI (#3450 ) * Try using drone cache plugin * Try another path * Include volume * Fix formatting * Include fmt * Exclude cargo dir from prettier * Don't override cargo * Just do check * Add cache key * Use different cache plugin * Add clippy * Try minio * Add quotes * Try adding secrets * Try again * Again * Use correct secret formation * Add back clippy * Use secret for the root bucket name * Try drone cache instead * Add region * Add path-style option * Include cargo clippy * Include everything again * Fix formatting * Don't run clippy twice * Add `allow` statements for tests to pass * Adjust endpoint to be a secret * Fix prettier * Merge & fix tests * Try to restart the woodpecker test * Change the ENV var name --------- Co-authored-by: Dessalines <dessalines@users.noreply.github.com>	10 months ago
dullbananas	1d38aad9d3	Make functions work with both connection and pool (#3420 ) * a lot * merge * Fix stuff broken by merge * Get rid of repetitive `&mut context.conn().await?` Add blank lines under each line with `conn =` * Fix style mistakes (partial) * Revert "Fix style mistakes (partial)" This reverts commit `48a033b87f`. * Revert "Add blank lines under each line with `conn =`" This reverts commit `773a6d3beb`. * Revert "Get rid of repetitive `&mut context.conn().await?`" This reverts commit `d2c6263ea1`. Use DbConn for CaptchaAnswer methods * DbConn trait * Remove more `&mut ` Fix stuff * Re-run CI * try to make ci start * fix * fix * Fix api_common::utils * Fix apub::activities::block * Fix apub::api::resolve_object * Fix some things * Revert "Fix some things" This reverts commit `2bf8574bc8`. * Revert "Fix apub::api::resolve_object" This reverts commit `3e4059aabb`. * Revert "Fix apub::activities::block" This reverts commit `3b02389abd`. * Revert "Fix api_common::utils" This reverts commit `7dc73de613`. * Revert "Revert "Fix api_common::utils"" This reverts commit `f740f115e5`. * Revert "Revert "Fix apub::activities::block"" This reverts commit `2ee206af7c`. * Revert "Revert "Fix apub::api::resolve_object"" This reverts commit `96ed8bf2e9`. * Fix fetch_local_site_data * Fix get_comment_parent_creator * Remove unused perma deleted text * Fix routes::feeds * Fix lib.rs * Update lib.rs * rerun ci * Attempt to create custom GetConn and RunQueryDsl traits * Start over * Add GetConn trait * aaaa * Revert "aaaa" This reverts commit `acc9ca1aed`. * Revert "Revert "aaaa"" This reverts commit `443a2a00a5`. * still aaaaaaaaaaaaa * Return to earlier thing Revert "Add GetConn trait" This reverts commit `ab4e94aea5`. * Try to use DbPool enum * Revert "Try to use DbPool enum" This reverts commit `e4d1712646`. * DbConn and DbPool enums (db_schema only fails to compile for tests) * fmt * Make functions take `&mut DbPool<'_>` and make db_schema tests compile * Add try_join_with_pool macro and run fix-clippy on more crates * Fix some errors * I did it * Remove function variants that take connection * rerun ci * rerun ci * rerun ci	10 months ago
Nutomic	ebaf69bd70	Cache federation blocklist (#3486 ) * Cache federation blocklist * revert submodule change	11 months ago
cetra3	d7da911a48	Remove `actix_rt` & use standard tokio spawn (#3158 ) * Remove `actix_rt` & use standard tokio spawn * Adjust rust log back down * Format correctly * Update cargo lock * Add DB settings * Change name and update to latest rev * Clean up formatting changes * Move `worker_count` and `worker_retry_count` to settings * Update defaults * Use `0.4.4` instead of git branch	11 months ago
Nutomic	165b19e75c	Optimize federated language updates to avoid unnecessary db writes (#2786 ) * Optimize federated language updates to avoid unnecessary db writes (fixes #2772) * fix tests * fix test, rename functions --------- Co-authored-by: Dessalines <dessalines@users.noreply.github.com>	1 year ago
Nutomic	6f513793cb	Activitypub crate rewrite (#2782 ) * update activitypub-federation crate to 0.4.0 * fixes * apub compiles! * everything compiling! * almost done, federated follow failing * some test fixes * use release * add code back in	1 year ago
Nutomic	d9e7f0100a	Dont upsert Instance row every apub fetch (#2771 ) This is not necessary because the domain cant change, so we only need to insert if no row exists for this domain. Also fetch instance actor when parsing person, not only community Co-authored-by: Dessalines <dessalines@users.noreply.github.com>	1 year ago
Dessalines	36aaa50644	Organize utils into separate files. Fixes #2295 (#2736 ) * Organize utils into separate files. Fixes #2295 * Moving tests. * Fix test. * Fix test 2	1 year ago
Nutomic	0ecf256ce3	Remove federation backwards compatibility with 0.16.x (#2183 ) * Breaking: remove compatiblity with page.url field (ref #2182) * Breaking: change type of Instance to `Application` (ref #2200) Co-authored-by: Dessalines <dessalines@users.noreply.github.com>	1 year ago
Felix Ableitner	c6c52ab9cc	Add SendActivity trait so that api crates compile in parallel with lemmy_apub	1 year ago
Felix Ableitner	030afbc2e7	Merge websocket crate into api_common	1 year ago
Nutomic	6f3bf4634b	Various pedantic clippy fixes (#2568 ) * Various pedantic clippy fixes * more clippy pedantic fixes * try to fix ci * add fix clippy script, use rust 1.65 * fix clippy	2 years ago
Dessalines	5d837780f5	Add diesel_async, get rid of blocking function (#2510 ) * Moving settings to Database. - Moves many settings into the database. Fixes #2285 - Adds a local_site and instance table. Fixes #2365 . Fixes #2368 - Separates SQL update an insert forms, to avoid runtime errors. - Adds TypedBuilder to all the SQL forms, instead of default. * Fix weird clippy issue. * Removing extra lines. * Some fixes from suggestions. * Fixing apub tests. * Using instance creation helper function. * Move forms to their own line. * Trying to fix local_site_data, still broken. * Testing out async * Testing out async 2 * Fixing federation tests. * Trying to fix check features 1. * Starting on adding diesel async. 1/4th done. * Added async to views and schema. * Adding some more async * Compiling now. * Added diesel async. Fixes #2465 * Running clippy --fix * Trying to fix cargo test on drone. * Trying new muslrust. * Trying a custom dns * Trying a custom dns 2 * Trying a custom dns 3 * Trying a custom dns 4 * Trying a custom dns 5 * Trying a custom dns 6 * Trying a custom dns 7 * Addressing PR comments. * Adding check_apub to all verify functions. * Reverting back drone. * Fixing merge * Fix docker images. * Adding missing discussion_languages. * Trying to fix federation tests. * Fix site setup user creation. * Fix clippy * Fix clippy 2 * Test api faster * Try to fix 1 * Try to fix 2 * What are these lines about * Trying to fix 3 * Moving federation test back to top. * Remove logging cat.	2 years ago
Nutomic	6aa9bdebae	Fix limit_languages to operate on correct instance (fixes #2496 ) (#2518 ) * Fix limit_languages to operate on correct instance (fixes #2496) * cargo fmt	2 years ago
Dessalines	235cc8b228	Moving settings to Database. (#2492 ) * Moving settings to Database. - Moves many settings into the database. Fixes #2285 - Adds a local_site and instance table. Fixes #2365 . Fixes #2368 - Separates SQL update an insert forms, to avoid runtime errors. - Adds TypedBuilder to all the SQL forms, instead of default. * Fix weird clippy issue. * Removing extra lines. * Some fixes from suggestions. * Fixing apub tests. * Using instance creation helper function. * Move forms to their own line. * Trying to fix local_site_data, still broken. * Fixing federation tests. * Trying to fix check features 1. * Addressing PR comments. * Adding check_apub to all verify functions.	2 years ago
Nutomic	2ef0f8f5f8	implement language tags for site/community in db and api (#2434 ) * implement language tags for site/community in db and api * add api checks for valid languages * during db migration, update existing users, sites, communities to have all languages enabled * init new users/communities with site languages (not all languages) * federate site/community languages * fix tests * when updating site languages, limit community languages to this subset also, when making a new post and subset of user lang, community lang contains only one item, use that as post lang * add tests for actor_language db functions * include language list in siteview/communityview * Fix some of the review comments * Some more review changes * Add todo about boxed query * Add default_post_language to GetCommunityResponse	2 years ago
Dessalines	c9f1407429	Diesel 2.0.0 upgrade (#2452 ) * Initial commit to bump diesel to 2.0.0-rc.0 and see what happens * Add chrono feature from diesel * db_schema crate is close to building? * Upgrade diesel-derive-newtype * Mostly modifying references to connections to be mutable ones; also used new way to do migrations as suggested by the migration guide; a lot more compiles now, though I can't figure out this tricky ToSql issue at the moment * Running clippy --fix * Trying to fix drone clippy 1 * Fix clippy * Upgrade clux-musl * Trying to fix drone clippy 2 * Trying to fix drone clippy 3 * Trying to fix drone clippy 5 * Adding diesel table aliases, removing sql view hack. Fixes #2101 Co-authored-by: Steven Chu <stevenc1@gmail.com> Co-authored-by: Nutomic <me@nutomic.com>	2 years ago
Dessalines	a745fa6f43	Remove update and read site config. Fixes #2306 (#2329 ) * Remove update and read site config. Fixes #2306 * Removing lazy_static, removing Settings::get()	2 years ago
Nutomic	fcaf7a084c	Upgrade activitypub_federation to 0.2.0, add setting federation.debug (#2300 )	2 years ago
Nutomic	a2a594b763	Extract Activitypub logic into separate library (#2288 ) * Create example for apub lib * some rewriting of apub lib * Add LocalInstance struct for apub lib to avoid using Lemmy Settings * Move ActorType trait to lemmy_apub, because its not needed in library * Use reqwest_retry instead of custom impl, dont specify timeout on every send() * Some improvements to example * Moved inbox handling to library * bug fixes * Move context and serde helpers into library * wip: example changes * Add lemmy_utils feature to build only LemmyError * Rename to activitypub_federation * Remove lemmy_utils dep from activitypub_federation using generic error type * Finish activitypub example * Cleanup and fix tests * Reorganize library files * Remove ApubObject.to_tombstone() * Extract activitypub library into separate git repository	2 years ago
Nutomic	f0ec3015cd	Remove check that avatars/banners are locally hosted (fixes #2254 ) (#2255 )	2 years ago
Nutomic	7b86441bab	Federate with Peertube (#2244 )	2 years ago
Nutomic	3aa3d75a1e	Add cargo feature for building lemmy_api_common with mininum deps (#2243 )	2 years ago
Nutomic	bbd739af9b	Change Person, Instance types (#2200 )	2 years ago
Nutomic	bfae246734	Migrate towards using page.attachment field for url (ref #2144 ) (#2182 )	2 years ago
Dessalines	4cf0da7b60	Clippy fixes.	2 years ago
Nutomic	dfb0938738	GNU social compatibility (#2100 ) * Use SourceCompat everywhere (better compat with other software) * Name field should not be mandatory in Group * also check page.cc field for community id * add gnu social tests * better to use option<sourcecompat> * update gnu social tests, marked vote as "unlisted"	2 years ago
Nutomic	8112816e99	If viewed actor isnt in db, fetch it from other instance (#2145 )	2 years ago
Nutomic	bcf7ec6109	Forbid remote URLs for avatars/banners (fixes #1618 ) (#2132 )	2 years ago
Nutomic	ef1e164cc5	Make activity queue worker count configurable, log stats (#2113 )	2 years ago
Nutomic	762b85b27e	Reorganize federation tests (#2092 ) * Reorganize apub protocol tests * Reorder apub protocol struct members to clarify mandatory/optional fields	2 years ago
Nutomic	dd865c5af5	Implement instance actor (#1798 ) * Implement instance actor * wip: make site bans federate * finish implementation and unit tests for federated bans * start adding api tests * fix api test * remve site from GetCommunityResponse * only federate site bans originating from user's home instance * dont expose site.private_key in api	2 years ago

45 Commits (e84e25d8fa43fc57d590000cec3cd556ba129be2)