Just came to say, thanks for making this FP8 quant! I'm able to run it without issue on an L40S with vLLM.
· Sign up or log in to comment
