• CileTheSane@lemmy.ca
    link
    fedilink
    English
    arrow-up
    4
    arrow-down
    2
    ·
    2 months ago

    it is entirely and factually correct to state that an LLM is capable of reasoning

    Citation needed.

    If you’re going to tell me LLMs are modeled after biological brains and capable of reasoning then I call bullshit on your claims that you actually work in AI.

    Imagine you put a man in an enclosed room. There is a slot in the wall where messages get passed through written in Chinese. The man does not speak Chinese or even recognize the written language, he just thinks they’re weird symbols.
    First the man is shown examples of sequences of symbols to train him. Then he is shown incomplete sequences and asked which symbol comes next. If incorrect he is corrected, if correct he gets cookie. Eventually this man is able to carry on “conversations” with people in Chinese through continued practice.
    This man still does not speak Chinese, he is not having reasoned, rational arguments with the people he is conversing with, and if you told him it was a language he’s look at you like your crazy. “There’s no language here, just if I have these symbols and I next put the one that looks like a man wearing a hat they give me a cookie.”

    Thinking LLMs are capable of reasoning is the digital equivalent of putting eyes on a pencil then feeling bad when it gets broken in half.

    • CeeBee_Eh@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      2 months ago

      Citation needed.

      Certainly!

      In machine learning, a neural network (also artificial neural network or neural net, abbreviated ANN or NN) is a model inspired by the structure and function of biological neural networks in animal brains

      Source

      A neural network is a method in artificial intelligence that teaches computers to process data in a way that is inspired by the human brain.

      Source

      A neural network is a machine learning program, or model, that makes decisions in a manner similar to the human brain

      Source

      *A neural network, or artificial neural network, is a type of computing architecture that is based on a model of how a human brain functions *

      Source

      Would you like some more citations?

      Thinking LLMs are capable of reasoning is the digital equivalent of putting eyes on a pencil then feeling bad when it gets broken in half.

      In this paper, we present Reasoning via Planning (RAP), a novel LLM reasoning framework that equips LLMs with an ability to reason akin to human-like strategic planning

      Source - Reasoning with Language Model is Planning with World Model

      Motivated by the observation that adding more concise CoT examples in the prompt can improve LLM reasoning performance

      Source - Microsoft Research

      LegalBench - a tool to evaluate the reasoning performance of an LLM in the legal domain.

      A paper on benchmarking an LLMs temporal reasoning.

      Shall I provide some more?