Working on Hopper?
#2
by
SuperbEmphasis
- opened
Might be a user error, but this does not work on my H100.
I was surprised to see:
Software Integration
Runtime Engine: Transformers
Recommended Hardware Microarchitecture Compatibility:
NVIDIA Ampere
NVIDIA Hopper
But I wasnt sure if hopper can somehow run NVFP4 in a less optimized way since it doesnt have tensor cores. I get an error about the cutlass backend not support compute capability 10.0.