In the past few days, I’ve seen a number of people having trouble getting Lemmy set up on their own servers. That motivated me to create Lemmy-Easy-Deploy, a dead-simple solution to deploying Lemmy using Docker Compose under the hood.

To accommodate people new to Docker or self hosting, I’ve made it as simple as I possibly could. Edit the config file to specify your domain, then run the script. That’s it! No manual configuration is needed. Your self hosted Lemmy instance will be up and running in about a minute or less. Everything is taken care of for you. Random passwords are created for Lemmy’s microservices, and HTTPS is handled automatically by Caddy.

Updates are automatic too! Run the script again to detect and deploy updates to Lemmy automatically.

If you are an advanced user, plenty of config options are available. You can set this to compile Lemmy from source if you want, which is useful for trying out Release Candidate versions. You can also specify a Cloudflare API token, and if you do, HTTPS certificates will use the DNS challenge instead. This is helpful for Cloudflare proxy users, who can have issues with HTTPS certificates sometimes.

Try it out and let me know what you think!

https://github.com/ubergeek77/Lemmy-Easy-Deploy

  • JCreazy@midwest.social
    link
    fedilink
    English
    arrow-up
    4
    ·
    1 year ago

    I will definitely try this out. I already have my domain and SSL certificate. This will work on linode right?

    • ubergeek77@lemmy.ubergeek77.chatOP
      link
      fedilink
      English
      arrow-up
      3
      ·
      1 year ago

      It will work on pretty much anything that has a public IP and a domain pointing to that IP. The only thing that won’t work “out of the box” for most users is email, as most VPS providers block port 25. If you’ve requested access to port 25 and have been approved to use it, you can edit config.env to turn on the email service.

      As for your SSL certificate, unfortunately this does not support importing your own certificate. It’s made for beginners, after all :p

      But there should be no problems with Caddy simply requesting a new one for you!

          • JCreazy@midwest.social
            link
            fedilink
            English
            arrow-up
            0
            ·
            1 year ago

            Once I got it up and running, I had to figure out how to get my domain to redirect to it. Now I just gave to figure out how to start federating with other instances.

            • ubergeek77@lemmy.ubergeek77.chatOP
              link
              fedilink
              English
              arrow-up
              2
              ·
              1 year ago

              If your instance is fully reachable from the public, all you have to do is search for the community you want to federate with in your search bar. For example, if you wanted to federate with and subscribe to this community, put this in your search bar, then hit search:

              https://lemmy.world/c/selfhosted
              

              It works for kbin communities too!

              You might see some people say to search it like !selfhosted@lemmy.world, but I have way more success with doing it like that. After you’ve done that, you can click on Communities at the top of your instance’s page, click the All tab, then start subscribing with some of them.

              It will only start pulling “new” data though, you won’t get days or week old posts like this. But, if there is something you want to see/comment on from your instance, you can put the direct link to any post, comment, or user into your instance’s search bar, to make it “aware” of that post/comment/user. Then you can just interact like normal.

              Welcome to the self-hosted Fediverse!

              • monnui@waveform.social
                link
                fedilink
                English
                arrow-up
                0
                ·
                1 year ago

                Wait, so pardon my noobism, but does this mean you need to federate with communities manually? Don’t instances start out as already being federated with everything?

                • ubergeek77@lemmy.ubergeek77.chatOP
                  link
                  fedilink
                  English
                  arrow-up
                  3
                  ·
                  1 year ago

                  Yep. It’s all manual. There are hundreds of Lemmy instances out there, new instances have no way of discovering any of them unless you tell it how.

                  Federation with a community only has to happen once. After it’s connected, the instance will always receive new data and posts from that point forward. That is why the major public instances always have posts from a wide variety of instances.

                  But, only a single person needs to do the federation, it doesn’t have to be done by an admin. After the connection is made with a community, content from that community will start showing up on “All” for that instance for everyone.

                  • monnui@waveform.social
                    link
                    fedilink
                    English
                    arrow-up
                    1
                    ·
                    1 year ago

                    Oh, okay, fair. So this means that the search for new communities to browse/federate with is less troublesome, the more users populate an instance. On the flip side, if I’m considering self-hosting as one single user, I should anticipate:

                    • having a fairly long phase of community discovery, unless I already know which communities I’m interested in;
                    • that those communities that I do federate with will not give me any data prior to the moment I federated with them (is there a cache system to avoid this? can I go specifically retrieve older posts?)
                    • an important need for storage space, as I essentially become a duplicate of the server for every community I federated with, from that point on.

                    Is this correct?

        • ubergeek77@lemmy.ubergeek77.chatOP
          link
          fedilink
          English
          arrow-up
          2
          ·
          edit-2
          1 year ago

          I’m not sure what you mean? Most people are just self hosting instances for themselves, where email isn’t needed. My instance doesn’t have an email service.

          And as I explained, if email is something you want, I have an advanced option for this. It’s not the default because there is not a public VPS host out there that lets you use port 25 without special approval.

          • netburnr@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            1 year ago

            Email config is needed for lost passwords. It’s also needed for account verification, if you run without verification you could easily become a place for people to abuse other servers and get yourself defederated.

            Many web hosts have poisoned mail IPs, so setting up with a smtp config to a well known site server is required if you want your emails to be delivered.

            • ubergeek77@lemmy.ubergeek77.chatOP
              link
              fedilink
              English
              arrow-up
              4
              ·
              edit-2
              1 year ago

              And that is why I don’t advertise this as supporting email out of the box, and why it’s an advanced option without any support from me. The embedded postfix server is part of the official Docker Compose deployment from upstream Lemmy, and it’s part of the officially supported Ansible deployment too. Those deployment methods are what this is modeled after. That is as far as I go on email support. If upstream Lemmy started including some automatic AWS SNS configuration, I would adopt it, but they have not done so.

              Everyone who has reported success to me so far are running single user instances for themselves. That is my target audience, and for that audience (and myself), email is not even close to being a hard requirement.

              However, if you would like to improve this script by adding support for more robust and secure email systems, I would be happy if you submitted a PR to do just that :)

            • 8565@lemmy.quad442.com
              link
              fedilink
              English
              arrow-up
              1
              arrow-down
              1
              ·
              1 year ago

              Don’t lose your passwords and leave closed registration so only people you actually want on your instance are on it. You absolutely do not need email.

              • netburnr@lemmy.world
                link
                fedilink
                English
                arrow-up
                2
                ·
                1 year ago

                You can’t have the checkbox for federation and private, the server will crash and tell you that in the lemmy log. Had that happen when I did thy to setup without email the first time.

                • degrix@hqueue.dev
                  link
                  fedilink
                  English
                  arrow-up
                  2
                  ·
                  1 year ago

                  Private and federation are mutually exclusive concepts. Private instances are ones that intentionally don’t federate - like a private company community that’s locked to their intranet. For self hosted Lemmy instances you just need to close registration. Then since no one can apply, the only use case for email becomes the Forgot Password button for if you forget your password and at that point you’re better served with a password manager.

                • 8565@lemmy.quad442.com
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  ·
                  1 year ago

                  Weird. I used this script with no working email. How’s it going from my private instance that is federated?

                • ubergeek77@lemmy.ubergeek77.chatOP
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  ·
                  1 year ago

                  “Private instance” and “disable registration” are not the same thing. There are separate options for both. It is possible to run a federated single-user instance with registrations disabled. That’s how I run mine.

      • b3nsn0w@pricefield.org
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 year ago

        how well do those email servers work to begin with? i just flat out disabled the postfix relay on my instance and simply configured sendgrid, which works perfectly, no delays or spam folder issues (although i did have to disable a bunch of tracking bullshit). doing so with similar services has been my go-to card in freelance webdev, because getting other mail servers to trust you can be hard, so i’m interested in the experience people are having with those. (i’d much prefer to self-host email too, but providing a good experience is the primary goal)

        • ubergeek77@lemmy.ubergeek77.chatOP
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 year ago

          I haven’t actually used the embedded postfix server at all, I keep mine disabled. I only include it because it’s “included” in the official Docker deployment files, and I try to keep this deployment as close to that as possible.

          I’m considering adding support for an external email service, as you mentioned, but I have nearly zero experience in using managed email services, and I’m not sure if non-technical users would be able to navigate the configuration of things I can’t do for them (i.e. on a web dashboard somewhere). And if I can’t do it for them, it means more issues for me, so I hesitate to add support for it at all.

          I’d love to hear your experience in setting up sendgrid and how easy that was. And the tracking stuff you mentioned as well.

          • b3nsn0w@pricefield.org
            link
            fedilink
            English
            arrow-up
            0
            ·
            1 year ago

            On the surface, setting up an external mail server is actually super easy. Pretty much every service supports SMTP, so all you need is to find your credentials (an endpoint, a username, and a password) and input that in your lemmy.hjson file, along with a sender address. There is a verification process with every email provider, you will usually have to set some DNS records to prove you own the domain you’re trying to send from, but once you do these two things, emails will just start flying out.

            The actual process tends to be a little more tedious though. Pretty much every mail provider wants to sell you on their specific super awesome API and only mentions SMTP as a footnote, for reasons that I can only parse as an attempted vendor lock-in. They also sometimes make the verification process difficult. SendGrid, for example, immediately redirects you to their “sender identities” which are more useful for their marketing automation tooling than they are for automated emails from a website, and you also have to dig a fair bit to find the SMTP credentials. (The endpoint is smtp.sendgrid.net, apikey on the username, and whatever your API key is for the password, you’ll need to set one of those up.) They also have a number of different tracking things that you’ll have to find and turn off in the UI (luckily all of them can be toggled in the same place), which would normally actually help you by providing you statistics about how many emails were opened and how many people clicked on links, but for the emails Lemmy sends, it’s useless and I didn’t want SendGrid to collect that data on my instance users, so I shut that off.

            Initially, I wanted to use Amazon SES, but they have an even more tedious setup: you have to talk to an actual human to have them turn it on for you, otherwise you’re stuck in sandbox mode and can only send email to verified receiver addresses. Their service works well though, I used it a lot in my freelancer days, and they do make it fairly straightforward to find the SMTP credentials, but the verification process can be slow.

            I also remember using Mailgun for some project ages ago, it was pretty much the same deal as all the others: you have to pry the SMTP details out of their docs, but once you do and you verify your stuff, it works well.

            Ultimately, I think the best you could do to help out users here is to provide them with documentation for a few of these services: exactly where to go, which buttons to click and whatnot. Or just stick to the embedded service for a bit, but the real issue there is the bounce rates from spammers. They made my instance send out like 60-70 verification emails for bogus addresses on gmail, yahoo, hotmail, and live.com on the first day I got federation working, and if you don’t already have a good reputation – which is what these third parties help you with – then you can easily get yourself blacklisted, either internally or externally.

            • ubergeek77@lemmy.ubergeek77.chatOP
              link
              fedilink
              English
              arrow-up
              0
              ·
              1 year ago

              I see. Thanks a lot for this!

              I really don’t have the capacity to support a bunch of different email services, so it sounds like the best I can do right now is make the SMTP settings accessible without also running the postfix server. So if someone wants to run their own email somewhere else, they can configure it. But otherwise, I’ll leave it to the user to figure out what happens after an email request leaves Lemmy.

              Does that sound fair, and like something you would have used? Essentially just an interface in config.env that puts the right SMTP address/credentials in lemmy.hjson.