Llama’s fall, Moonshot’s rise: a MoE Renaissance

How Moonshot AI is leading the charge in the next Generation of AI models — and how to use them.

Mooshot AI as a Chinese scholar, leading the AI future

Last week I wrote you about the latest Llama 4 models. Meta AI really didn’t care about making something usable without paying their services.

How can you even think about running a 109 billion parameter model?

Today we go back to China, and have a look to one promising (and quite good) new model, by .

Even though we are not yet at AGI level, and the Transformers architecture is not the one who will lead the way, AI labs are moving forward, not for the sake of their profits (at least not only for that) but for research.

China is one of the leading Community now, as I wrote several time.

Numbers matter

Just have a look at the amount of efforts and results done in one single month: