LLM - GeneralFine-tune

DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8

by RedHatAI

Bronze25

5.2Kdownloads

5likes

25/100

mit

View on HuggingFace

Base Model

Fine-tuned from

deepseek-ai/DeepSeek-R1-Distill-Qwen-7B

Tags

transformerssafetensorsqwen2text-generationdeepseekint8vllmllmcompressorconversationalarxiv:2210.17323license:mittext-generation-inferenceendpoints_compatible8-bitcompressed-tensorsregion:us