• SpaceCowboy@lemmy.ca
    link
    fedilink
    arrow-up
    1
    ·
    16 hours ago

    Yes! And the problem with decidability is you don’t which problem will be undecidable. You can only just try and they it’s like “well couldn’t find a solution, so it might be undecidable”. So we’ll need to put limits on how many tokens an AI should use before giving up, put limits on what it tries to do or we’ll be burning thousands of dollars on tokens and coming up with nothing. There will need to be a lot of judgement used on where we apply the algorithm.

    Judging when to use an algorithm and when not to use an algorithm based around how expensive it will be in terms of resources? That’s just another day for a software engineer.

    • Farooq@realbitcoin.cash
      link
      fedilink
      arrow-up
      1
      ·
      4 hours ago

      You have a valid point. I think currently there are assists which we know an LLM definitely can do for us. Like mechanical tasks. And tasks which we know LLM can never do. In between there is a gray area. I think we will learn about the gray area over time.

      Also I would like automatic generation of programs. But I don’t think an LLM is the last stop for it. I personally research in the field of Genetic Programming. I strongly believe in future we could have tools which generate or optimize programs when guided by a human. Currently we have Evolutionary Art and Music which do the same. Tho they are far from being actually usable, this is the same with every technology in the beginning.

      Also see this talk: https://cr.yp.to/talks/2015.04.16/slides-djb-20150416-a4.pdf