allenai
/

olmOCR-2-7B-1025-FP8

text-generation-inference

compressed-tensors

Model card Files Files and versions

olmOCR-2-7B-1025-FP8 / recipe.yaml

jakep-allenai's picture

Upload folder using huggingface_hub

550f2c7 verified 2 months ago

164 Bytes

	default_stage:
	default_modifiers:
	QuantizationModifier:
	targets: [Linear]
	ignore: ['re:.lm_head', 're:model.visual.']
	scheme: FP8_DYNAMIC