Emergence and Reasoning in Large Language Models
Emergent capabilities are abilities that are not present in smaller models but are present in larger models. This is discussed in the video below by Jason Wei, a Google AI researcher. I had a prior article that discussed the summary from Alan Thompson on what capabilities emerged at what point for the large language models. …