Skip to content

Rename llama_mxint4.toml to llama_mxint8.toml and use dtype= for from_pretrained - #4

Open
Shreyas8612 wants to merge 3 commits into
mainfrom
fix/mxint8-config-name-and-dtype-arg
Open

Rename llama_mxint4.toml to llama_mxint8.toml and use dtype= for from_pretrained#4
Shreyas8612 wants to merge 3 commits into
mainfrom
fix/mxint8-config-name-and-dtype-arg

Use dtype= in the remaining from_pretrained calls

57acf74
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar