Sorry if this seems like a silly question but I have noticed over the last few months my feed(?) has started to act odd.

No matter what I do I don’t see any posts from .world. I checked and mander does not seem to block .world (kinda why I liked this instance) and even weirder is how my feed gets filled with mostly .ml posts with almost no activity no matter how I sort.

This did not happen before and got me thinking, I don’t even know how this works across federated instances.

Does anyone know:

  • How does the sorting work on an instance? Is it all the same no matter what instance it is?

  • Did anything change in the last few months, that would cause all .world (and I assume others) posts to not show?

  • Other then changing instances what can I do to mitigate the weird slanted results?

  • Salamander@mander.xyz
    link
    fedilink
    English
    arrow-up
    4
    ·
    edit-2
    5 months ago

    Yes, sorry, there was some serious lagg in fetching posts from Lemmy World that persisted for several days and accumulated a 1-week delay.

    But after upgrading Mander it is now fetching data from LW quite rapidly and it should be back in-sync in about a day and a half from now.

    If you are curious about the ranking algorithm, there is some info here: https://join-lemmy.org/docs/contributors/07-ranking-algo.html

    • M0oP0o@mander.xyzOP
      link
      fedilink
      English
      arrow-up
      3
      ·
      5 months ago

      Thanks, I have been watching the graph of the lag behind time and its nice to see it now at 6.1 days.

  • j4k3@lemmy.world
    link
    fedilink
    English
    arrow-up
    4
    ·
    edit-2
    5 months ago

    The Lemmy algorithm:

    https://join-lemmy.org/docs/contributors/07-ranking-algo.html

    The instances communicate between each other using special bots in the background that transport info between instances. Dot world is too big and makes too many requests to other instances. Most instances are reducing the number of transport bots back to dot world right now. There is supposed to be a fix in the next Lemmy version, but the code base is somewhat slow moving due to only two devs and it is written in Rust. Rust is a hard language like C, and not too many here are able to contribute to it, even though it is like the new gold standard of code.

    So you might see a delay between posting and replies or the interaction may come in bursts that correspond with the transport bots carrying content between instances as the host admin have configured their instance.

    • I believe there is some work being done on an alternative code base written in python with flask it has lots of promise and i recon with a bit of extra work it might allow for mastodon integration into one server which would be cool af.

      Really want to get to the stage where an account is just a private key I hold and all federated services can work with a single username.

      Imagine having a single username which is for all services.

      • Blaze@reddthat.com
        link
        fedilink
        English
        arrow-up
        2
        ·
        5 months ago

        I believe there is some work being done on an alternative code base written in python with flask it has lots of promise and i recon with a bit of extra work it might allow for mastodon integration into one server which would be cool af.

        https://piefed.social/ ?

        Otherwise, for Mastodon integration, there is mbin with https://kbin.run/ for instance

    • gravitas_deficiency@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      1
      ·
      5 months ago

      I’m actually mildly surprised it’s still only two devs. Are they treating it like a walled garden, or is there really a complete lack of interest in contributing to the codebase?

      • Blaze@reddthat.com
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        1
        ·
        5 months ago

        Rust is a niche language

        It’s like starting a book club in Esperanto compared to English. Sure, Esperanto is supposedly a better language, but very few people know about it

        • gravitas_deficiency@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          2
          ·
          5 months ago

          Rust is not a niche language. It’s a strict and strongly opinionated language by design. People with background in strongly typed languages, who additionally use opinionated linters and formatters have an easier time adjusting. JavaScript “devs” (note: distinct from “software engineers”) probably pull their hair out over a lot of stuff in because in my experience, many js devs know enough about the language to work proficiently in a couple of frameworks, but haven’t really dug into the nuances of the language, and also have limited experience with strong typing.

      • j4k3@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        5 months ago

        Not sure. There was some controversy with some of the devs making alt front ends and admins complaining about the slowness. I’ve seen mention of one of the two devs learning Rust just to participate. So it is not entirely a walled garden. The front end devs wanted to make an alt from scratch but in something like JavaScript although I don’t recall the details exactly. There were a lot of red flags related to privacy and understanding the community at large in the posts I saw from them. When asked why they weren’t adding pull requests with Rust in order to address their complaints I got no reply.

        All that said, I’m no dev. I can read in to around half the code I come across if I really try, and can successfully modify maybe half of that if I spend a few days on it, but I suck at clever code and the DRY cult types. I haven’t tried to look into Lemmy in any depth beyond figuring out the basics.

        • M0oP0o@lemmy.world
          link
          fedilink
          English
          arrow-up
          0
          ·
          5 months ago

          Hmmmm, and it does not help the controversy when this issue seems to happen to then fill smaller instances with .ml posts…

          • j4k3@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            5 months ago

            The .ml instance is run by the developers. If it isn’t well configured we would have no reason to be here.

  • PixelAlchemist@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    5 months ago

    Should be the same across any instance.

    Hot: calculated using the current score (up/down votes) in combination with how new it is.

    https://github.com/LemmyNet/lemmy/blob/main/migrations/2023-10-23-184941_hot_rank_greatest_fix/up.sql

    Active: calculated using current score in combination with the timestamp of the newest comment:

    https://github.com/LemmyNet/lemmy/blob/main/crates/db_schema/src/aggregates/post_aggregates.rs

  • M0oP0o@mander.xyzOP
    link
    fedilink
    English
    arrow-up
    1
    ·
    5 months ago

    I decided to do a bit more then just “hot” and “active” and its the same across all of them except “controversial” and “Most comments”.

    “Most comments” has some .world posts in it but does not match using another instance. The only one that seems to line up is ironically sorting by “controversial”,

    This is really getting weird and is making it hard to use Lemmy for me. Like I like some of the posts listed but I can not believe the largest instance is not posting anything. To make me more confused this also started at the same time Mander got really slow, and to add to the weirdness refreshing the page gives entirely different sorting of posts maybe one out of five times.