I must confess I have a personal vendetta against Yudkowsky and his cult. I studied computer science in college. As an undergrad, I worked as an AI research assistant. I develop software for a living. This is my garden the LessWrong crowd is trampling.

  • GarbageShoot [he/him]@hexbear.net
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 years ago

    The normal refutation to this is that the LLM is not “telling” you anything, it is producing an output of characters that, according to its training on its data set, look like a plausible response to the given prompt. This is like using standard conditioning methods to teach a gorilla to make gestures corresponding to “please kill me now” in sign language and using that to justify killing it. They are not “communicating” with the symbols in the sense of the semantic meanings humans have assigned the symbols, because the context they have observed the symbols in and used them for is utterly divorced from those arbitrary meanings.