LLM - GeneralFine-tune

DeepSeek-R1-Distill-Qwen-1.5B-quantized.w8a8

by RedHatAI

New

6.8Kdownloads

2likes

24/100

mit

View on HuggingFace

Base Model

Fine-tuned from

deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B

Tags

transformerssafetensorsqwen2text-generationdeepseekint8vllmllmcompressorconversationalarxiv:2210.17323license:mittext-generation-inferenceendpoints_compatible8-bitcompressed-tensorsregion:us