The fact that AI models can be so easily distilled and replicated is such a stroke of luck.
Ten or 15 years ago, if one had asked me to envision a future in which a private company invents artificial intelligence, I'd have thought for sure that it would have a massive moat, be very difficult to catch, and create an almost instant monopoly.
Instead, it seems that selling intelligence might end up as a race to the bottom.
Who would've thought that having access to enough textual inputs and outputs, along with a vaguely similar transformer architecture, would be enough to copy rather useful intelligence?