Rotation Q (2 angles), sparse c_proj (2 nonzero), parabolic lm_head, factorized embed, sinusoidal PE (period 11)
Those are, perhaps, topics for future posts.,更多细节参见WPS官方版本下载
,推荐阅读51吃瓜获取更多信息
7月6日——南京阿红事件,这一点在91视频中也有详细论述
This is not the only surprise in this article.