LLM - GeneralFine-tune

DeepSeek-R1-Distill-Llama-8B-quantized.w8a8

by RedHatAI

New
4.7Kdownloads
2likes
23/100
mit

Base Model

Tags

transformerssafetensorsllamatext-generationdeepseekint8vllmllmcompressorconversationalarxiv:2210.17323license:mittext-generation-inferenceendpoints_compatible8-bitcompressed-tensorsregion:us