In my previous blog post, I offered a background on large language models (LLMs) and some of their shortcomings and wrote of a recent breakthrough brought by new OpenAI models. Now, let’s take a deep dive into that paradigm shift. Going back to the quote from The Bitter Lesson: One thing that should be learned […]
A Breakthrough for Large Language Models Arrives
The OpenAI models released last week are a game changer for large language models (LLMs), which have for the last year-and-a-half been rather stable in performance. Some had caught up with OpenAI’s ChatGPT-4, but nobody had significantly surpassed it. The frontier had not advanced far. This had raised speculation, including my own, over whether the […]