On May 18th, the National Supercomputing Center in Tianjin unveiled its new Chinese language model, "Tianhe Tianyuan," at the 2023 7th World Intelligence Conference. The model was trained on the Tianhe supercomputer, China's new generation of exascale supercomputers, which makes use of its computing power to drive AI application development and services. According to reports, the dataset for Chinese language models is scarce, so the National Supercomputing Center collected and organized various open-source training data, including web page data, Chinese novel data, encyclopedia data, news data, and professional domain data such as traditional Chinese medicine, diagnosis, pharmaceuticals, and law, totaling 350B tokens. The resulting Chinese language model, Tianhe Tianyuan, will support scientific engineering calculations and hybrid intelligent calculations, providing high-quality digital economic development and innovative applications.
