lakebbs
Back

Replaced ChatGPT Plus with DeepSeek

Yukin2025-01-28 02:10 EST

Machine-translated from Chinese, so it may read oddly. Comments are left as members wrote them. Read the Chinese original

After a day of testing, I've already cancelled my ChatGPT Plus subscription. Currently DeepSeek has an iOS app and a web version, but it doesn't support Windows or MacOS yet (you can't even find DeepSeek in the Mac App Store).

For those who want to deploy it locally, you can find DeepSeek's source code repository: https://github.com/deepseek-ai/DeepSeek-V3
Currently it only supports Linux with Python 3.10 (Mac and Windows are not supported)

Here are the deployment steps:
# Download the code
git clone https://github.com/deepseek-ai/DeepSeek-V3.git
cd DeepSeek-V3/inference

# Install dependencies
pip install -r requirements.txt

# Download the model files
Download the pre-trained model from Hugging Face and put it in the model directory /path/to/DeepSeek-V3

# Model format conversion (I think this step is for setting model parameters and precision???)
python convert.py --hf-ckpt-path /path/to/DeepSeek-V3 --save-path /path/to/DeepSeek-V3-Demo --n-experts 256 --model-parallel 16

# Model inference
torchrun --nnodes 2 --nproc-per-node 8 --node-rank $RANK --master-addr $ADDR generate.py --ckpt-path /path/to/DeepSeek-V3-Demo --config configs/config_671B.json --interactive --temperature 0.7 --max-new-tokens 200

# Then you can start having fun chatting and asking questions with the DeepSeek model :)

0
Sign in to join the discussionSign in
No comments yet · be the first

You might also like