• BenevolentOne@infosec.pub
    link
    fedilink
    English
    arrow-up
    3
    arrow-down
    3
    ·
    3 days ago

    Someone will come up with a decent accelerator eventually. Right now we’re in the pre-soundblaster days where audio sythesis is being done by the CPU but for neural networks.

    We’re repurposing graphics hardware, these are primitive times.

    Also, there, I explained it for you.

    • Wildmimic@anarchist.nexus
      link
      fedilink
      English
      arrow-up
      6
      ·
      3 days ago

      I have to disagree here. We are on the absolute edge of current physics regarding miniaturization - without a massive breakthrough in quantum physics on how we can use subatomic particles for transistors we are nearing the maximum we can shrink these circuits. These are already optimized for exactly this kind of math - a Vera Rubin will never be able to render a game. Also, the mathematical basis (a ton of matrix multiplication) does not give much hope that we can replace all this math with something simpler. Maybe a radical redesign taking a completely different approach can help, but i wouldn’t count on that - it would mean reinventing the whole damn thing on a completely new base.

      I can’t really see any explanation when i take the above into account.

        • Wildmimic@anarchist.nexus
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 day ago

          This is not a “new approach”, it’s the same one but hardware-based. It also is wildly impractical. Models are only useful if they stay somewhat up to date. This way only produces a whole load of garbage everytime you want to update it. Probably useful in the industry or robotics, but not for an everyday LLM.

          • BenevolentOne@infosec.pub
            link
            fedilink
            English
            arrow-up
            1
            ·
            20 hours ago

            Today I learned every chip ever made and put into any device in any application is wildly impractical and produces a whole load of garbage any time you want to update it.

            You’re not wrong.

            • Wildmimic@anarchist.nexus
              link
              fedilink
              English
              arrow-up
              1
              ·
              20 hours ago

              Software based solutions will always have the advantage of being applicable to older hardware (maybe with a compatibility layer, but nontheless still viable). Something that should be up-to-date pretty much every day if we apply it to things like internet search simply cannot be solved in hardware alone.

              As i said, there are applications where a hardware-based approach is completely valid (like on a production line where nothing essential changes during the time where it is doing stuff), but for other approaches we would be fucked from here to Uranus if we solved everything in hardware.