ThunderSoft achieves end-to-end operation of 13 billion parameter models

With the development of AI technology, traditional PCs need to be upgraded. Thundersoft uses model compression and other technologies to achieve stable operation of the LLaMA-2 13 billion parameter model on the Qualcomm 8 series 550 chip platform, improve the inference speed of end-side devices, and lay the foundation for the AI ​​PC era.