"25 trillion tokens as training data, and out comes a 120 billion parameter AI assistant that roughly matches the best closed frontier models from about a year and a half ago. Note that those models cost billions of dollars to train and every detail about them was kept in secret. And now, we just get this kind of stuff for free."