• 9 Posts
  • 3.49K Comments
Joined 3 years ago
cake
Cake day: June 22nd, 2023

help-circle





  • Basically, it’s really really expensive (from a compute standpoint, and more compute = money and energy) to train a decent LLM just using books and conversations etc. Anthropic, OpenAI, etc spend a truly insane amount of money doing this is in data centers.

    Running an LLM like that is also extremely expensive from a compute standpoint, and right now the true frontier models can basically only be run in datacenters.

    However, once you have a really good LLM, you can use it to train another LLM. Because it’s basically already refined all its original training data (and is capable of further refining it’d output on the fly), training a new LLM from it is vastly easier and cheaper.

    Additionally, you can use a much smaller and more efficient model, so it can run on less powerful hardware.

    So all local LLMs that are any good that exist right now, were trained using the outputs of existing super expensive frontier models. They could not exist without the frontier models to train them. This is also how OpenAI and Anthropic create their cheaper models. Mythos/Fable is anthropics current frontier model and they distill it into (use it to train) their cheaper models like Sonnet and Opus.





  • And somehow magically all corporate product names land the one you want

    No, it’s not magic, it’s called marketing, market research, and psychology. There are literally billions of dollars that go into advertising, do you think they just magically come up with names?

    all fediverse or FOSS inventions land the one you don’t

    Literally never once claimed that. Mastodon is a little long but at least it’s satisfying and conjures up images of a big fuzzy creature instead of a rodent.


  • I agree, Reddit’s name isn’t why people use it, but critically it doesn’t hold people back from using it.

    Reddit is a satisfying enough word, doesn’t disparage it’s users or sound like a childish joke, and doesn’t conjure images of rats or rodents.

    I don’t love it but it is a much better name than Lemmy.



  • masterspace@lemmy.catoFediverse@lemmy.world•Why Does Nobody Use Lemmy?
    link
    fedilink
    English
    arrow-up
    13
    arrow-down
    6
    ·
    6 days ago

    Just gonna throw this out there: Lemmy is a bad and dumb name.

    1. It’s a joke about users being lemmings
      • this subtly denegrates the user on every usage
      • this implies the app/product itself isn’t that serious and sounds kinda childish
    2. It’s not a satisfying word from a pronunciation standpoint. How many other company or product names can you think of that end with that ee sound? Reddit, Twitter, Threads, they all end with these conclusive consonant sounds. Lemmy sounds like it’s trailing off while whining.
    3. At best it conjures up images of rat like rodents.






  • Well, my tag on you is “Epic apologist.” That’s something I consider a negative. I can see how you would object to that and don’t mean to represent your opinion as invalid, just differing from mine.

    Lmfao, ok bud. You can’t see how that’s toxic?

    You’ve literally proven in this very conversation how that is toxic. You just used your previous arbitrary labels of epic apologist to dismiss what I had to say without considering it.

    It is intellectually lazy, and overconfident.

    I’m wiser now than I was 5 years ago, why would I trust a label that my self from 5 years ago slapped on someone? How do I know I wasn’t just in a bad mood when I did that and was mistaken? How do I know that conversation was even completely representative of that person’s views and not just a blip?

    You are taking a small snapshot of someone’s views (a single conversation), then boiling that down to a psnarky label that you apply to them forever.


  • Maybe I should slap a label on you based on your behaviour in this one conversation and dismiss everything you have to say forever because of that, that seem reasonable to you?

    The labelling feature existing in the client doesn’t mean you have to use it. It’s a fundamentally toxic form of interaction that people don’t do irl for a reason. People can be in bad moods, people can change, and people can be convinced and have their thoughts and beliefs shift. Slapping a label on them and ignoring what they have to say is intellectual laziness that just creates an even stricter filter bubble around you.