Any-to-Any
Transformers
Safetensors
multilingual
minicpmo
feature-extraction
minicpm-o
omni
vision
ocr
multi-image
video
custom_code
audio
speech
voice cloning
live Streaming
realtime speech conversation
asr
tts
Instructions to use openbmb/MiniCPM-o-2_6 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use openbmb/MiniCPM-o-2_6 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("openbmb/MiniCPM-o-2_6", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
使用CPU加载报错
#16
pinned
by lanpangzi - opened
File "C:\Users\lanpangzi\AppData\Local\Programs\Python\Python39\lib\site-packages\torch\cuda_init_.py", line 284, in _lazy_init
raise AssertionError("Torch not compiled with CUDA enabled")
AssertionError: Torch not compiled with CUDA enabled
modeling_minicpmo.py 第187行,删除.to("cuda")
vocos = Vocos(feature_extractor, backbone, head).eval().to(torch.float32)
你好,目前默认是需要 cuda 进行推理,如果希望改造成 cpu 推理可以把一些 gpu 操作删除或者转移到 cpu 计算
bokesyo pinned discussion
bokesyo changed discussion status to closed