Closed
Description
GPTQ is currently not available in llama-fast
@HDCharles can you please bring the GPTQ support from gpt-fast over to llama-fast?
x-ref: pytorch-labs/gpt-fast#148
Thanks so much!
@supriyar please re-assign if appropriate
Metadata
Metadata
Assignees
Labels
No labels