I’m aware that some of you have been getting some errors loading this instance. This was a configuration that I needed to be adjusted which has since been.

Do be patient if we run into other issues, I’ll be continuously working in the back-end with others to better your overall experience.

Still a lot of capacity available!

edit: For those that are interested in the configuring changes. I was using the default lemmy configuration for the nginx worker_connections value. This value needed to be raised. Shout out to @ruud@lemmy.world over at lemmy.world for helping me out.

  • Whooping_Seal@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    7
    ·
    1 year ago

    Just out of curiosity, would it help if when posting images we use services such as imgur (or alternatives)? I’m assuming if there is storage issues those type of posts are the biggest culprit.

    Thank you for hosting this server @TheDude :)

      • csm10495@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        3
        ·
        1 year ago

        Would be cool if there was a plugin or something to link with imgur, etc.

        Have you considered disabling image upload?

        • TheDude@sh.itjust.worksOPM
          link
          fedilink
          English
          arrow-up
          3
          ·
          1 year ago

          yes this is an option however the lemmy-ui which is responsible for displaying this page would still show the option. It could be manually removed and might be something I look more into at a later time.

      • PCChipsM922U@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        3
        ·
        edit-2
        1 year ago

        As someone who is still hosting a forum, I would not suggest this. I have also tried to reduce footprint of the forum using external image hodting services and this has always ended up badly (images get lost as one hosting service changes policy and maybe disables direct linking or just closes it’s doors, whatever).

        This is one of the reasons why I’m not tempted to open up a lemmy server, even though my hosting plan allows 3 subdomains. Used space will rise quickly, even if it’s just images… if videos are allowed as well, than all hell will break loose, even if they are processed and reduced in quality and resolution server side. I’ve seen it happen before, it’s a nightmare to revert things afterwards (users complain), not to mention you can’t revert the damage, that space is taken and that’s that.

        My estimate is that, if only images are allowed and images are processed in webp, it’ll take about a week for a quite busy instance to reach the 1GB mark… probably a lot faster if it’s an NSFW instance (a few days). Think about this from a migration perspective after 1 year - it will be a nightmare.

  • Quazen@sh.itjust.worksB
    link
    fedilink
    English
    arrow-up
    6
    ·
    1 year ago

    first comment here after coming from reddit, this looks really clean and simple so good job :)

  • wia@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    4
    ·
    1 year ago

    my all/hot on here hasn’t updated in update 10 hours. Is that something with our instance?

    Checked on a different instance and it seems to work fine.

      • wia@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 year ago

        Yup, I’m stuck at 24 hours now.

        On desktop it will eventually load more stuff, after minutes if I just let it sit there. On Jerboa, nothing at all. Other sorting methods seem to work, but are weird or hard to use. New makes everything keep moving so I can’t keep my place. Active is just weird.

        I guess I can make an count on another instance as a backup.

  • TheDude@sh.itjust.worksOPM
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    if anyone starts getting any weird errors please do let me know but everything still seems to be running smoothly from my side.

        • csm10495@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 year ago

          Yeah still hanging for me (even on a different computer) :/ In looking at the dev tools, it doesn’t seem to do a POST or anything. The only thing it does is load the svg for the ‘thinking’ icon on the button.

  • manifex@sh.itjust.worksM
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    Thanks @TheDude! Scaling systems like this is always a challenge and you really get to learn the performance quirks of the code. Thanks for all your work.

  • agreenbhm@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    0
    ·
    edit-2
    1 year ago

    @TheDude@sh.itjust.works does Lemmy support a distributed configuration with multiple database and app servers, or are you limited to a single instance of everything?

    • TheDude@sh.itjust.worksOPM
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      The official supported deployments are single instance based, that being said things are already broken up into separate docker containers so it should be pretty easy to do. Would need to do some testing before hand. If this instance continues growing this way I’ll need to look into scaling horizontally instead of vertically

      • can@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 year ago

        If this instance continues growing this way I’ll need to look into scaling horizontally instead of vertically

        Could you elaborate what this means?

        • isildun@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          2
          ·
          edit-2
          1 year ago

          Better to have more servers as opposed to one ultra powerful server because the ultra powerful server tends to be more expensive than an equivalent strength collection of weaker servers. Also, you pay for all the power even during times you don’t need it whereas you can take down or add more weak servers as necessary.

  • can@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 year ago

    Are things scaling well then? Is it still alright to recommend new people come here or would you rather hold off for a bit now?

    • TheDude@sh.itjust.worksOPM
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      I figured out the storage issue last night, the instance is only at about 20% utilization so we should be good to take on a good amount more. We probably will need to do some more tweaking as we grow but for now its looking pretty good!

      • PCChipsM922U@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 year ago

        Think long term. Don’t take too many new users or you’ll end up with loads of new content (mainly images). Storage is not expensive nowadays, but you can’t load new disks to the arrays indefinitely.

          • PCChipsM922U@sh.itjust.works
            link
            fedilink
            English
            arrow-up
            2
            ·
            1 year ago

            We can, but then you might loose history. This is long known problem on forums. Trying to cut on disk space by linking to image hosts. Sometimes the images survive, most of the time they don’t. If that doesn’t bother most of the user base, fine, but certain communities would like to keep a history of the media, since sometimes they share valuabe information, like maybe schematics or art.

            • can@sh.itjust.works
              link
              fedilink
              English
              arrow-up
              2
              ·
              1 year ago

              I guess it’s a balance. I remember the imageshack purge but I also don’t want to overload the instance.

              • PCChipsM922U@sh.itjust.works
                link
                fedilink
                English
                arrow-up
                2
                ·
                1 year ago

                Photobucket was next after that, not to mention countless others. Imgur has been pretty consistent over the years, but after 2 purges and hundreds of lost images (schematics in most cases) on my forum, I’m scared to death of trusting another image hosting company.

                Basically, we still allow externally hosted images on the forum, but only for temp things, like buy/sell, stuff like that. Everything else is attached on the forum.

                • can@sh.itjust.works
                  link
                  fedilink
                  English
                  arrow-up
                  2
                  ·
                  1 year ago

                  Imgur is deleting all images that were uploaded without being signed into an account.

  • falkerie71@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 year ago

    Thanks for the update! Any plans for a separate channel outside of sh.itjust.works like Discord or Mastodon, just in case to give people a heads up if the server goes down or is in maintenance?