again GGUF?
#46
by kalle07 - opened
at the moment this error:
Error converting to fp16: INFO:hf-to-gguf:Loading model: NV-Embed-v2
WARNING:hf-to-gguf:Failed to load model config from downloads/tmpto3redvv/NV-Embed-v2: The repository downloads/tmpto3redvv/NV-Embed-v2 contains custom code which must be executed to correctly load the model. You can inspect the repository content at /home/user/app/downloads/tmpto3redvv/NV-Embed-v2 .
You can inspect the repository content at https://hf.co/downloads/tmpto3redvv/NV-Embed-v2.
Please pass the argument trust_remote_code=True to allow custom code to be run.
WARNING:hf-to-gguf:Trying to load config.json instead
INFO:hf-to-gguf:Model architecture: MistralModel
ERROR:hf-to-gguf:Model MistralModel is not supported