LLM - GeneralFine-tune

DeepSeek-R1-Distill-Qwen-14B-quantized.w8a8

by RedHatAI

New
3.8Kdownloads
2likes
22/100
mit

Base Model

Tags

transformerssafetensorsqwen2text-generationdeepseekint8vllmllmcompressorconversationalarxiv:2210.17323license:mittext-generation-inferenceendpoints_compatible8-bitcompressed-tensorsregion:us