• 23 Posts
  • 209 Comments
Joined 2 years ago
cake
Cake day: July 13th, 2024

help-circle











  • BB84@mander.xyztoTechnology@beehaw.org*Permanently Deleted*
    link
    fedilink
    English
    arrow-up
    1
    ·
    4 months ago

    Reinforcement learning makes the model better over time, so why should there be fewer and fewer good results?

    If you’re talking about the rate of improvement going down, then yes, of course. That’s bound to happen (unless you have an actual intelligence explosion, but in that case you won’t know what “good results” even mean anyway).



  • BB84@mander.xyztoTechnology@beehaw.org*Permanently Deleted*
    link
    fedilink
    English
    arrow-up
    1
    ·
    4 months ago

    No one feeds random LLM output straight back though. The whole idea of reinforcement learning is you take some ML model output, check if it is good, and push the model in that direction if it is good.

    As long as you believe that e.g. it’s easier to verify a mathematical result than to come up with one, then RL should work.


  • BB84@mander.xyztoTechnology@beehaw.org*Permanently Deleted*
    link
    fedilink
    English
    arrow-up
    13
    arrow-down
    4
    ·
    4 months ago

    You took those quotes wildly out of context. Of course there is a hard limit on how much information can be extracted from data. Clever processing won’t break that limit. But only in basic cases have we seen proofs that certain statistical inference methods make optimal use of the data. In complicated systems like neural nets it is basically impossible to prove such optimality. In fact the models are almost definitely not using the data optimally. Processing can help. A lot.