Skip to content

GPTQ enablement #78

Closed
Closed
@mikekgfb

Description

@mikekgfb

GPTQ is currently not available in llama-fast

@HDCharles can you please bring the GPTQ support from gpt-fast over to llama-fast?

x-ref: pytorch-labs/gpt-fast#148

Thanks so much!

@supriyar please re-assign if appropriate

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions