Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

  • placebo@lemmy.zip
    link
    fedilink
    English
    arrow-up
    3
    arrow-down
    1
    ·
    4 days ago

    I tried Qwen 3.6 a3b and Gemma 4 a4b, but both were too stupid for everyday work.

    • fluxx@mander.xyz
      link
      fedilink
      English
      arrow-up
      1
      ·
      3 days ago

      IMO, qwen3.6 a3b is smarter seeming but gets stuck way too often, Gemma 4 is stupider, but doesn’t get stuck almost at all. I’m trying to find middle ground, but so far - no luck.