Replaced ChatGPT Plus with DeepSeek
Machine-translated from Chinese, so it may read oddly. Comments are left as members wrote them. Read the Chinese original
After a day of testing, I've already cancelled my ChatGPT Plus subscription. Currently DeepSeek has an iOS app and a web version, but it doesn't support Windows or MacOS yet (you can't even find DeepSeek in the Mac App Store).
For those who want to deploy it locally, you can find DeepSeek's source code repository: https://github.com/deepseek-ai/DeepSeek-V3
Currently it only supports Linux with Python 3.10 (Mac and Windows are not supported)
Here are the deployment steps:
# Download the code
git clone https://github.com/deepseek-ai/DeepSeek-V3.git
cd DeepSeek-V3/inference
# Install dependencies
pip install -r requirements.txt
# Download the model files
Download the pre-trained model from Hugging Face and put it in the model directory /path/to/DeepSeek-V3
# Model format conversion (I think this step is for setting model parameters and precision???)
python convert.py --hf-ckpt-path /path/to/DeepSeek-V3 --save-path /path/to/DeepSeek-V3-Demo --n-experts 256 --model-parallel 16
# Model inference
torchrun --nnodes 2 --nproc-per-node 8 --node-rank $RANK --master-addr $ADDR generate.py --ckpt-path /path/to/DeepSeek-V3-Demo --config configs/config_671B.json --interactive --temperature 0.7 --max-new-tokens 200
# Then you can start having fun chatting and asking questions with the DeepSeek model :)
Comments0