Conversation

Notices

Ji Fu (fu@libranet.de)'s status on Friday, 26-May-2023 13:09:26 EDT Ji Fu
Wow! I had no idea this had happened so recently

♲ @dessalines@lemmy.ml:
Lemmy Release v0.14.0: Federation with Mastodon and Pleroma 🥳

Today is an exciting day for the Lemmy project.
Almost one year after first enabling federation https://lemmy.ml/post/42833, we now federate with other projects for the first time! According to some people's definition, this finally makes us part of the Fediverse.
It took a lot of work to make this possible, so big thanks to https://nlnet.nl/ for funding our full time work on Lemmy, and to @lanodan https://queer.hacktivis.me/users/lanodan and https://masto.asonix.dog/@asonix for helping to figure out how Pleroma and Mastodon federation works (it's difficult because they have almost no documentation).
What is Lemmy?

https://join-lemmy.org/ is similar to sites like Reddit, Lobste.rs, or Hacker News: you subscribe to communities you're interested in, post links and discussions, then vote and comment on them. Lemmy isn't just a reddit alternative; its a network of interconnected communities ran by different people and organizations, all combining to create a single, personalized front page of your favorite news, articles, and memes.
Major Changes
Federation code rewrite

The rewrite of the federation code started by @nutomic in August is now mostly complete. As a result, the code is much cleaner, and has tests to guarantee no breaking changes between Lemmy versions. As a side effect of this rewrite, it was now relatively easy to enable federation with other projects.
Mastodon and Pleroma users can:
- View Lemmy communities, user profiles, posts and comments
- Follow Lemmy communities to receive new posts and comments
- Replies (mentions) work in both directions, including notifications
In addition, Pleroma users can exchange private messages with Lemmy users.
Note that Pleroma and Mastodon rely on a compatibility mode in Lemmy, which means that they won't receive events like Deletes or Votes. Other projects whose federation works similar to Pleroma/Mastodon will likely also federate.
Hardcoded slur filter removed

Lemmy finally has essential moderation tools (reporting, user/community blocking), so the hardcoded filter isn't necessary anymore. If you want to keep using the slur filter, copy these lines https://github.com/LemmyNet/lemmy/blob/b18ea3e0cc620c3f97f9804c09b92f193809b846/config/config.hjson#L8-L12 to your config file when upgrading, and adjust to your liking.
Upgrade notes

If you installed Lemmy without Ansible, you need to edit the nginx config file to follow this example https://github.com/LemmyNet/lemmy-ansible/blob/main/templates/nginx.conf#L63. Otherwise Mastodon won't be able to fetch objects or actors from Lemmy. Ansible applies this change automatically.
No other changes are necessary for federation with Mastodon/Pleroma. Just make sure your allowlist/blocklist allows it. Then get started by searching the URL of a Lemmy user or Community in Mastodon.
Note that Mastodon and Pleroma are much, much bigger than Lemmy at this point, with a combined 3 milion users and 4500 instances, compared to 20.000 users and 35 instances for Lemmy (source https://the-federation.info/). The existing mod tools in Lemmy might not be adequate to handle that at the moment.
Be aware that if you have federation enabled in the Lemmy config, Mastodon and Pleroma users can now fetch all posts and comments, to view them and share with their followers. The Lemmy blocklist/allowlist can not prevent this, it only prevents posts/comments from blocked instances to be shown on your own instance. The only solution to this problem is disabling federation, or waiting for signed fetch https://github.com/LemmyNet/lemmy/issues/868 to be implemented.
If you want to use federation, but review new instances before federating with them, use the allowlist. You can switch from open federation to allowlist federation by pasting the output of the command below into federation.allowed_instances in the Lemmy config.
```
curl https://your-instance.com/api/v3/site | jq -c .federated_instances.linked
```
The lemmy.hjson additional_slurs field has changed its name to slur_filter. https://github.com/LemmyNet/lemmy/blob/b18ea3e0cc620c3f97f9804c09b92f193809b846/config/config.hjson#L8-L12
Follow the Docker or Ansible upgrade instructions here. https://join-lemmy.org/docs/en/administration/administration.html
Lemmy-Ansible

We've now separated our ansible install method (the preferred way to deploy Lemmy) into its own repo, https://github.com/LemmyNet/lemmy-ansible. Let us know if you need help migrating existing installations over to it.
Changes
API
- There is now a GetUnreadCount in the API to check the count of your unread messages, replies, and mentions.
- A full list of the API changes can be seen on this diff of lemmy-js-client: 0.13.0 -> 0.14.0-rc.1 https://github.com/LemmyNet/lemmy-js-client/compare/0.13.0...0.14.0-rc.1 .
Lemmy Server
- More federation compat (#1894 https://github.com/LemmyNet/Lemmy/issues/1894)
- Adding clippy:unwrap to husky. Fixes #1892 https://github.com/LemmyNet/Lemmy/issues/1892 (#1893 https://github.com/LemmyNet/Lemmy/issues/1893)
- Remove header guard for activitypub routes
- Add federation test cases for Smithereen and Mastodon
- Reduce stack memory usage in apub code
- Remove ActivityFields trait, deserialize into another struct instead
- Check if post or comment are deleted first. Fixes #1864 https://github.com/LemmyNet/Lemmy/issues/1864 (#1867 https://github.com/LemmyNet/Lemmy/issues/1867)
- Correctly use and document check_is_apub_id_valid() param use_strict_allowlist
- Convert note.content and chat_message.content to html (fixes #1871 https://github.com/LemmyNet/Lemmy/issues/1871)
- Upgrade background_jobs to 0.9.1 #1820 https://github.com/LemmyNet/Lemmy/issues/1820 (#1875 https://github.com/LemmyNet/Lemmy/issues/1875)
- Fix husky fmt hook. (#1868 https://github.com/LemmyNet/Lemmy/issues/1868)
- Renaming to slur_filter. Fixes #1773 https://github.com/LemmyNet/Lemmy/issues/1773 (#1801 https://github.com/LemmyNet/Lemmy/issues/1801)
- Three instance inbox bug (#1866 https://github.com/LemmyNet/Lemmy/issues/1866)
- Remove ansible from this repo. (#1829 https://github.com/LemmyNet/Lemmy/issues/1829)
- Rewrite collections to use new fetcher (#1861 https://github.com/LemmyNet/Lemmy/issues/1861)
- Dont blank out post or community info. Fixes #1813 https://github.com/LemmyNet/Lemmy/issues/1813 (#1841 https://github.com/LemmyNet/Lemmy/issues/1841)
- Format config/defaults.hjson before committing (#1860 https://github.com/LemmyNet/Lemmy/issues/1860)
- Breaking apub changes (#1859 https://github.com/LemmyNet/Lemmy/issues/1859)
- Pleroma federation2 (#1855 https://github.com/LemmyNet/Lemmy/issues/1855)
- Create a custom pre-commit hook, generates config/defaults.hjson (#1857 https://github.com/LemmyNet/Lemmy/issues/1857)
- Add cargo metadata to all crates (#1853 https://github.com/LemmyNet/Lemmy/issues/1853)
- Add both (De)Serialize to all models (#1851 https://github.com/LemmyNet/Lemmy/issues/1851)
- Adding GetUnreadCount to the API. Fixes #1794 https://github.com/LemmyNet/Lemmy/issues/1794 (#1842 https://github.com/LemmyNet/Lemmy/issues/1842)
- Federate reports (#1830 https://github.com/LemmyNet/Lemmy/issues/1830)
- Fix saved posts and hide read posts issue. Fixes #1839 https://github.com/LemmyNet/Lemmy/issues/1839 (#1840 https://github.com/LemmyNet/Lemmy/issues/1840)
- Dont allow posts to deleted / removed communities. Fixes #1827 https://github.com/LemmyNet/Lemmy/issues/1827 (#1828 https://github.com/LemmyNet/Lemmy/issues/1828)
- Dont swallow API errors (fixes #1834 https://github.com/LemmyNet/Lemmy/issues/1834) (#1837 https://github.com/LemmyNet/Lemmy/issues/1837)
- Fix federation of initial post/comment vote (fixes #1824 https://github.com/LemmyNet/Lemmy/issues/1824) (#1835 https://github.com/LemmyNet/Lemmy/issues/1835)
- Fix clippy warnings added in nightly (#1833 https://github.com/LemmyNet/Lemmy/issues/1833)
- Admins can view all reports. Fixes #1810 https://github.com/LemmyNet/Lemmy/issues/1810 (#1825 https://github.com/LemmyNet/Lemmy/issues/1825)
- Adding a message_id to emails. Fixes #1807 https://github.com/LemmyNet/Lemmy/issues/1807 (#1826 https://github.com/LemmyNet/Lemmy/issues/1826)
- Generate config docs from code (#1786 https://github.com/LemmyNet/Lemmy/issues/1786)
- Trying a background_jobs fix. #1820 https://github.com/LemmyNet/Lemmy/issues/1820 (#1822 https://github.com/LemmyNet/Lemmy/issues/1822)
- mark parent as read on reply (#1819 https://github.com/LemmyNet/Lemmy/issues/1819)
- Move code to apub library (#1795 https://github.com/LemmyNet/Lemmy/issues/1795)
- Adding honeypot to user and post creation. Fixes #1802 https://github.com/LemmyNet/Lemmy/issues/1802 (#1803 https://github.com/LemmyNet/Lemmy/issues/1803)
- Add database host back into config file (#1805 https://github.com/LemmyNet/Lemmy/issues/1805)
Lemmy UI
- Updating translations.
- Fixing unload (#487 https://github.com/LemmyNet/lemmy-ui/issues/487)
- Fix setup password. Fixes #478 https://github.com/LemmyNet/lemmy-ui/issues/478 (#484 https://github.com/LemmyNet/lemmy-ui/issues/484)
- Adding post comment scrolling hack. Fixes #480 https://github.com/LemmyNet/lemmy-ui/issues/480 #486 https://github.com/LemmyNet/lemmy-ui/issues/486
- Navbar links (#476 https://github.com/LemmyNet/lemmy-ui/issues/476)
In conversation Friday, 26-May-2023 13:09:26 EDT from libranet.de permalink
Attachments
1. Invalid filename.
  
  the federation - a statistics hub
  
  Podlist and statistics for The Federation (diaspora*, Friendica, Hubzilla, GangGo, Socialhome).
2. File without filename could not get a thumbnail source.
  
  Federation is now enabled for https://lemmy.ml ! - Lemmy
3. Invalid filename.
  
  Shenzi thinker abouter (@asonix@masto.asonix.dog)
  
  from asonix.dog
  
  17K Toots, 1.47K Joined Packs, 739 Pack Members · 27, local liom, friend, rust (lang) stan, bi icon by @lalupine@furaffinity.net header by @tronixx@furaffinity.net Testimonials: Stand: LIONS Stand User: AODE - Keris (not on here)
4. Invalid filename.
  
  lemmy/config.hjson at b18ea3e0cc620c3f97f9804c09b92f193809b846 · LemmyNet/lemmy
  
  from GitHub
  
  🐀 A link aggregator and forum for the fediverse. Contribute to LemmyNet/lemmy development by creating an account on GitHub.
5. Invalid filename.
  
  lemmy-ansible/nginx.conf at main · LemmyNet/lemmy-ansible
  
  from GitHub
  
  A docker deploy for ansible. Contribute to LemmyNet/lemmy-ansible development by creating an account on GitHub.
6. Invalid filename.
  
  Fetching ActivityPub objects should be signed requests. · Issue #868 · LemmyNet/lemmy
  
  from GitHub
  
  Currently, the history / user / community fetching are unsigned requests from the server directly. It would be nice for these to be signed like the standard posts. Want to back this issue? Post a b...
7. Invalid filename.
  
  lemmy/config.hjson at b18ea3e0cc620c3f97f9804c09b92f193809b846 · LemmyNet/lemmy
  
  from GitHub
  
  🐀 A link aggregator and forum for the fediverse. Contribute to LemmyNet/lemmy development by creating an account on GitHub.
8. Invalid filename.
  
  GitHub - LemmyNet/lemmy-ansible: A docker deploy for ansible
  
  from GitHub
  
  A docker deploy for ansible. Contribute to LemmyNet/lemmy-ansible development by creating an account on GitHub.
9. Invalid filename.
  
  Comparing 0.13.0...0.14.0-rc.1 · LemmyNet/lemmy-js-client
  
  from GitHub
  
  A javascript / typescript http and websocket client and type system for Lemmy. - Comparing 0.13.0...0.14.0-rc.1 · LemmyNet/lemmy-js-client
10. Invalid filename.
  
  More federation compat by Nutomic · Pull Request #1894 · LemmyNet/lemmy
  
  from GitHub
  
  With these changes, new posts/comments from Lemmy get delivered successfully to Pleroma, which means we are ready to release 0.14! @asonix The last commit is causing a weird error in background-job...
11. Invalid filename.
  
  Add clippy:unwrap_used to husky: · Issue #1892 · LemmyNet/lemmy
  
  from GitHub
  
  https://cloud.drone.io/LemmyNet/lemmy/1893/1/5
12. Invalid filename.
  
  Adding clippy:unwrap to husky. Fixes #1892 by dessalines · Pull Request #1893 · LemmyNet/lemmy
  
  from GitHub
13. Invalid filename.
  
  old state isn't considered when updating comment count · Issue #1864 · LemmyNet/lemmy
  
  from GitHub
  
  Found a bug? Please fill out the sections below. 👍 For front end issues, use lemmy-ui Issue Summary old state isn't considered when updating comment count. this allows users to increase or decrease...
14. Invalid filename.
  
  Check if post or comment are deleted first. Fixes #1864 by dessalines · Pull Request #1867 · LemmyNet/lemmy
  
  from GitHub
  
  Check the apub sections, not sure if I did those correct. The bug almost certainly came in through apub.
15. Invalid filename.
  
  "content" field is markdown but is advertised as HTML · Issue #1871 · LemmyNet/lemmy
  
  from GitHub
  
  This was seen in #1220. Currently in lemmy, the content field contains markdown which is tolerable but sadly it's advertised as text/html. $ curl -s -H 'Accept: application/activity+json' https://d...
16. Invalid filename.
  
  background_jobs crashes makes other instances not receive federation updates · Issue #1820 · LemmyNet/lemmy
  
  from GitHub
  
  This seems to happen on lemmy intemittently, sometimes after a week or so of running fine. background_jobs will stop showing up in the logs. cc @asonix @Nutomic This issue happened again, twice in ...
17. Invalid filename.
  
  Upgrade background_jobs to 0.9.1 #1820 by dessalines · Pull Request #1875 · LemmyNet/lemmy
  
  from GitHub
18. Invalid filename.
  
  Fix husky fmt hook. by dessalines · Pull Request #1868 · LemmyNet/lemmy
  
  from GitHub
  
  This one shouldn't have slipped in. cargo-husky has no lint-staged like node, so running fmt on these doesn't stage the files at all, and will let you commit unformatted files. Making this a format...
19. Invalid filename.
  
  Change name of `additional_slurs` to `slur_filter` in config, remove existing wordlist. · Issue #1773 · LemmyNet/lemmy
  
  from GitHub
  
  This will functionally remove the slur filter, and leave it up to instance admins to set their own.
20. Invalid filename.
  
  Renaming to slur_filter. Fixes #1773 by dessalines · Pull Request #1801 · LemmyNet/lemmy
  
  from GitHub
21. Invalid filename.
  
  Three instance inbox bug by dessalines · Pull Request #1866 · LemmyNet/lemmy
  
  from GitHub
  
  If this passes, I'll do the cherry pick to release/0.13
22. Invalid filename.
  
  Remove ansible from this repo. by dessalines · Pull Request #1829 · LemmyNet/lemmy
  
  from GitHub
23. Invalid filename.
  
  Rewrite collections to use new fetcher by Nutomic · Pull Request #1861 · LemmyNet/lemmy
  
  from GitHub
  
  Need to rewrite community outbox, moderators, and tombstone so that they the same kind of structs as other objects. Then everything will be converted to the new style.
24. Invalid filename.
  
  Dont blank out info for removed content · Issue #1813 · LemmyNet/lemmy
  
  from GitHub
  
  I think that #1680 goes too far and hides too much information of removed content, making the mod log useless. For example, here is a removed post: This used to have the title, text and link still ...
25. Invalid filename.
  
  Dont blank out post or community info. Fixes #1813 by dessalines · Pull Request #1841 · LemmyNet/lemmy
  
  from GitHub
  
  Going on record saying I really don't like this, since the title of the post and community would still be in the modlog, and would also show the reason for it being removed. This PR will let you go...
26. Invalid filename.
  
  Format config/defaults.hjson before committing by Nutomic · Pull Request #1860 · LemmyNet/lemmy
  
  from GitHub
  
  Moved this logic from LemmyNet/lemmy-docs#102 to this repo, as people might look at config/defaults.hjson directly.
27. Invalid filename.
  
  Breaking apub changes by Nutomic · Pull Request #1859 · LemmyNet/lemmy
  
  from GitHub
  
  This applies all the pending activitypub migrations. Also cleans up the test cases so that they can be used nicely in documentation. Feel free to squash.
28. Invalid filename.
  
  Pleroma federation2 by Nutomic · Pull Request #1855 · LemmyNet/lemmy
  
  from GitHub
  
  Replaces #1852. Ready for review. Based on the tests, Lemmy can now handle users and comments from Pleroma. In practice there might still be problems with stuff like http signatures, webfinger etc.
29. Invalid filename.
  
  Create a custom pre-commit hook, generates config/defaults.hjson by Nutomic · Pull Request #1857 · LemmyNet/lemmy
  
  from GitHub
  
  This works fine in my testing. In particular, adding a new config value correctly adds it to config/defaults.hjson and commits that file. You probably have to rm target and then run tests in order ...
30. Invalid filename.
  
  Add cargo metadata to all crates by Tmpod · Pull Request #1853 · LemmyNet/lemmy
  
  from GitHub
  
  Closes #1849.
31. Invalid filename.
  
  Add both (De)Serialize to all models by Tmpod · Pull Request #1851 · LemmyNet/lemmy
  
  from GitHub
  
  As discussed in the dev Matrix channel, I'm adding both Serialize and Deserialize to all models, so that clients can pull them from these crates instead of implementing everything themselves.
32. Invalid filename.
  
  Add `GetUnreadCount` to API · Issue #1794 · LemmyNet/lemmy
  
  from GitHub
  
  I like the GetReportCount in the API, because the navbar can call it to get a count, without fetching the actual report content. Unfortunately in the UI, for the inbox, it has to fetch replies, mes...
33. Invalid filename.
  
  Adding GetUnreadCount to the API. Fixes #1794 by dessalines · Pull Request #1842 · LemmyNet/lemmy
  
  from GitHub
34. Invalid filename.
  
  Federate reports by Nutomic · Pull Request #1830 · LemmyNet/lemmy
  
  from GitHub
  
  Somehow I broke #1814 while trying to update it, so here are the same changes in a new PR.
35. Invalid filename.
  
  Saved posts section should ignore hide read posts setting · Issue #1839 · LemmyNet/lemmy
  
  from GitHub
  
  Is your proposal related to a problem? When "Show read posts" is unchecked ie. read posts are being hidden from view, the saved posts section is completely blank leading to confusion since there is...
36. Invalid filename.
  
  Fix saved posts and hide read posts issue. Fixes #1839 by dessalines · Pull Request #1840 · LemmyNet/lemmy
  
  from GitHub
37. Invalid filename.
  
  Posting to removed community isn't disallowed · Issue #1827 · LemmyNet/lemmy
  
  from GitHub
  
  Issue Summary At the moment, it is possible to post on removed communities through the API, even though lemmy-ui doesn't expose it. Steps to Reproduce Create a post through the /post endpoint. Note...
38. Invalid filename.
  
  Dont allow posts to deleted / removed communities. Fixes #1827 by dessalines · Pull Request #1828 · LemmyNet/lemmy
  
  from GitHub
39. Invalid filename.
  
  Don't swallow errors in API code · Issue #1834 · LemmyNet/lemmy
  
  from GitHub
  
  I am currently trying to help the admin of forum.nogafam.es to debug a problem on the instance. The problem is that fetching remote communities or other objects doesnt work, and it only returns "er...
40. Invalid filename.
  
  Dont swallow API errors (fixes #1834) by Nutomic · Pull Request #1837 · LemmyNet/lemmy
  
  from GitHub
41. Invalid filename.
  
  Initial comment and post upvotes failing to federate, stays at zero. · Issue #1824 · LemmyNet/lemmy
  
  from GitHub
  
  context: https://lemmy.ml/post/84444/comment/84588
42. Invalid filename.
  
  Fix federation of initial post/comment vote (fixes #1824) by Nutomic · Pull Request #1835 · LemmyNet/lemmy
  
  from GitHub
  
  It was missing this one line, which meant that it failed to parse the object json. The fix is working correctly in manual testing What i cant figure out is why the api test "create a comment" was s...
43. Invalid filename.
  
  Fix clippy warnings added in nightly by Nutomic · Pull Request #1833 · LemmyNet/lemmy
  
  from GitHub
  
  Latest rust nightly is showing some new warnings, which i fixed here.
44. Invalid filename.
  
  Let admins see every report on all communities? · Issue #1810 · LemmyNet/lemmy
  
  from GitHub
  
  Currently, reporting is only shown to mods of communities that have a report on that community. But it would probably be beneficial for admins to see every report for every community, since a lot o...
45. Invalid filename.
  
  Admins can view all reports. Fixes #1810 by dessalines · Pull Request #1825 · LemmyNet/lemmy
  
  from GitHub
46. Invalid filename.
  
  SMTP mails without Message-Id · Issue #1807 · LemmyNet/lemmy
  
  from GitHub
  
  With the current 0.13.0 version I added SMTP configuration in the config file. Running as docker compose stack. Sending eMails with these settings works. When I use the reset password functionality...
47. Invalid filename.
  
  Adding a message_id to emails. Fixes #1807 by dessalines · Pull Request #1826 · LemmyNet/lemmy
  
  from GitHub
48. Invalid filename.
  
  Generate config docs from code by Nutomic · Pull Request #1786 · LemmyNet/lemmy
  
  from GitHub
  
  This is pretty much ready to merge now, only waiting for upstream to make a new release. Output looks like the following, which we can include directly in the documentation. It is json (which is al...
49. Invalid filename.
  
  Trying a background_jobs fix. #1820 by dessalines · Pull Request #1822 · LemmyNet/lemmy
  
  from GitHub
50. Invalid filename.
  
  mark parent as read on reply by LunaticHacker · Pull Request #1819 · LemmyNet/lemmy
  
  from GitHub
  
  this works but we should probably mark mentions(if any ) as read too but I'm not sure how to do that.
51. Invalid filename.
  
  Move code to apub library by Nutomic · Pull Request #1795 · LemmyNet/lemmy
  
  from GitHub
  
  I moved a couple more things to the library (traits ApubObject, ActorType, also http signature handling and activity sending queue). This means that I had to move some trait impls into the db_schem...
52. Invalid filename.
  
  Add honeypot to user and post creation · Issue #1802 · LemmyNet/lemmy
  
  from GitHub
  
  Info here: LemmyNet/lemmy-ui#433
53. Invalid filename.
  
  Adding honeypot to user and post creation. Fixes #1802 by dessalines · Pull Request #1803 · LemmyNet/lemmy
  
  from GitHub
54. Invalid filename.
  
  Add database host back into config file by Nutomic · Pull Request #1805 · LemmyNet/lemmy
  
  from GitHub
  
  Fixes #1804
55. Invalid filename.
  
  Fixing unload by dessalines · Pull Request #487 · LemmyNet/lemmy-ui
  
  from GitHub
56. Invalid filename.
  
  Add correct password check to site setup · Issue #478 · LemmyNet/lemmy-ui
  
  from GitHub
  
  Its currently failing for passwords < 10 chars.
57. Invalid filename.
  
  Fix setup password. Fixes #478 by dessalines · Pull Request #484 · LemmyNet/lemmy-ui
  
  from GitHub
58. Invalid filename.
  
  Add max comment scrolling hack for posts. · Issue #480 · LemmyNet/lemmy-ui
  
  from GitHub
  
  Until comment tree threading is properly added, I'll need to hide comments until scrolled to the bottom, so that posts with thousands of comments aren't shown on page load.
59. Invalid filename.
  
  Issues · LemmyNet/lemmy-ui
  
  from GitHub
  
  The official web app for lemmy. Contribute to LemmyNet/lemmy-ui development by creating an account on GitHub.
60. Invalid filename.
  
  Navbar links by dessalines · Pull Request #476 · LemmyNet/lemmy-ui
  
  from GitHub

Public

Conversation

Notices

Lemmy Release v0.14.0: Federation with Mastodon and Pleroma 🥳

What is Lemmy?

Major Changes

Federation code rewrite

Hardcoded slur filter removed

Upgrade notes

Lemmy-Ansible

Changes

API

Lemmy Server

Lemmy UI