Skywork 13B

Skywork 13B is a bilingual English-Chinese language model released by the Skywork Team at Kunlun Inc. on October 30, 2023 (paper arXiv 2310.19341). Trained on 3.2 trillion tokens — 52.2% English, 39.6% Chinese, 8% code — it was pitched as one of the most extensively trained 13B-scale models of its time. Its standout feature is transparency: the team released intermediate training checkpoints and the SkyPile-150B open Chinese corpus alongside the model.

License nuance: the code is Apache-style but the model weights ship under the custom Skywork Community License, which permits free commercial use subject to its terms — it is not OSI-open Apache 2.0. By 2026 standards it is a dated model, best treated as a research artifact for training-dynamics work rather than a deployment candidate.