≡ Menu

Understanding ChatGPT and Microsoft’s Chatbot

Ben Dickson sheds light on what is behind ChatGPT and Microsoft’s Bing Chatbot named Sydney. These large language models (LLMs) will likely find their way into our normal routines. It is important for us to understand their strengths and weaknesses before is gets your coffee order wrong and eloquently explains to you why it was right.

His well-written post “To understand language models, we must separate “language” from “thought” describes what these LLMs, created through machine learning of massive data sets, do well and what they struggle with. He cites a recent paper Dissociating language and thought in large language models: a cognitive perspective that found:

LLMs show impressive (although imperfect) performance on tasks requiring formal linguistic competence, but fail on many tests requiring functional competence.