In my previous blog post, I offered a background on large language models (LLMs) and some of their shortcomings and wrote of a recent breakthrough brought by new OpenAI models. Now, let’s take a deep dive into that paradigm shift. Going back to the quote from The Bitter Lesson: One thing that should be learned […]
A Breakthrough for Large Language Models Arrives
The OpenAI models released last week are a game changer for large language models (LLMs), which have for the last year-and-a-half been rather stable in performance. Some had caught up with OpenAI’s ChatGPT-4, but nobody had significantly surpassed it. The frontier had not advanced far. This had raised speculation, including my own, over whether the […]
The Open-Source AI Debate Pits Tech Leaders Against Each Other
The debate over open-source AI models will be a long and contentious one. On one side are people who argue that there is a big danger if the technology and its development are open since it could make it easier for people to misuse the models or for China to beat the US in a […]