Qwen-7B-Chat-Int4 is a 7 billion parameter conversational model optimized with 4-bit quantization, specifically designed for efficient deployment on Huawei Ascend NPU infrastructure.
See Qwen-7B-Chat-Int4-detailed.md for comprehensive deployment instructions.
# Clone this repository
git clone https://gitcode.com/weixin_72661020/Qwen-7B-Chat-Int4.git
# Navigate to the project directory
cd Qwen-7B-Chat-Int4
# Check out the detailed documentation
cat Qwen-7B-Chat-Int4-detailed.mdREADME.md - This file (project overview)Qwen-7B-Chat-Int4-detailed.md - Complete deployment guideSKILL.md - Claude Code skill specificationinference.py - Inference script with NPU supportevaluation.md - Test results and compatibility reportmodel_info.json - Model specificationsThis project is licensed under the Apache License 2.0 - see the LICENSE file for details.
Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference