Instructions to use SulphurAI/Sulphur-2-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use SulphurAI/Sulphur-2-base with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("SulphurAI/Sulphur-2-base", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - llama-cpp-python
How to use SulphurAI/Sulphur-2-base with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="SulphurAI/Sulphur-2-base", filename="prompt_enhancer/mmproj-BF16.gguf", )
llm.create_chat_completion( messages = "\"A young man walking on the street\"" )
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- llama.cpp
How to use SulphurAI/Sulphur-2-base with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf SulphurAI/Sulphur-2-base:BF16 # Run inference directly in the terminal: llama-cli -hf SulphurAI/Sulphur-2-base:BF16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf SulphurAI/Sulphur-2-base:BF16 # Run inference directly in the terminal: llama-cli -hf SulphurAI/Sulphur-2-base:BF16
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf SulphurAI/Sulphur-2-base:BF16 # Run inference directly in the terminal: ./llama-cli -hf SulphurAI/Sulphur-2-base:BF16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf SulphurAI/Sulphur-2-base:BF16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf SulphurAI/Sulphur-2-base:BF16
Use Docker
docker model run hf.co/SulphurAI/Sulphur-2-base:BF16
- LM Studio
- Jan
- Ollama
How to use SulphurAI/Sulphur-2-base with Ollama:
ollama run hf.co/SulphurAI/Sulphur-2-base:BF16
- Unsloth Studio new
How to use SulphurAI/Sulphur-2-base with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for SulphurAI/Sulphur-2-base to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for SulphurAI/Sulphur-2-base to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for SulphurAI/Sulphur-2-base to start chatting
- Pi new
How to use SulphurAI/Sulphur-2-base with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf SulphurAI/Sulphur-2-base:BF16
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "SulphurAI/Sulphur-2-base:BF16" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use SulphurAI/Sulphur-2-base with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf SulphurAI/Sulphur-2-base:BF16
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default SulphurAI/Sulphur-2-base:BF16
Run Hermes
hermes
- Docker Model Runner
How to use SulphurAI/Sulphur-2-base with Docker Model Runner:
docker model run hf.co/SulphurAI/Sulphur-2-base:BF16
- Lemonade
How to use SulphurAI/Sulphur-2-base with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull SulphurAI/Sulphur-2-base:BF16
Run and chat with the model
lemonade run user.Sulphur-2-base-BF16
List all available models
lemonade list
someone copied your work
Ohh well, it's just duplicated. People generally do that, don't they
A couple people have done this I don't really care because this version has 150k downloads and theres has like 100
It's a Q8 quant, they just didn't bother to fix the model card or add the relationship.
This is normal stuff for Hugging Face, nobody's trying to rip anybody else off.
It's a Q8 quant,
It isn't their quant, that is FusionCow's one of the prompt enhancer
Yeah, it'd only be a ripoff attempt if they did something like changing the Kofi URL.
https://huggingface.co/botp/Sulphur-2-base/commit/ef1e188e841e9e9e4ead45d1e2282899205ceb8d
Okay so yeah they just used a space to duplicate the repo. It also literally backlinks here which I didn't even notice at the time
The copyright-brain involved here is... weird. This is a feature of the site. What it lets you do is experiment with alterations without having control of the original repository. It's like a fork on GitHub.
FusionCow has already said they don't care but I just wanted to like, clarify the misunderstanding that's happened here for the future. Apologies for my tone, I'm not trying to be argumentative, promise ;w;
https://huggingface.co/botp/Sulphur-2-base/commit/ef1e188e841e9e9e4ead45d1e2282899205ceb8d
Okay so yeah they just used a space to duplicate the repo. It also literally backlinks here which I didn't even notice at the time
The copyright-brain involved here is... weird. This is a feature of the site. What it lets you do is experiment with alterations without having control of the original repository. It's like a fork on GitHub.
FusionCow has already said they don't care but I just wanted to like, clarify the misunderstanding that's happened here for the future. Apologies for my tone, I'm not trying to be argumentative, promise ;w;
Yeah, well when I first posted this there was no link back. It was just a copy of what is found here. Nice try tho sport. It's cool though how you can't base something off a timestamp.
https://huggingface.co/botp/Sulphur-2-base/commit/ef1e188e841e9e9e4ead45d1e2282899205ceb8d
Okay so yeah they just used a space to duplicate the repo. It also literally backlinks here which I didn't even notice at the time
The copyright-brain involved here is... weird. This is a feature of the site. What it lets you do is experiment with alterations without having control of the original repository. It's like a fork on GitHub.
FusionCow has already said they don't care but I just wanted to like, clarify the misunderstanding that's happened here for the future. Apologies for my tone, I'm not trying to be argumentative, promise ;w;
You can't copyright a trained model when you aren't the owner of the source model that was used to train it. That's flawed logic. LTX is open-source. Anything trained on it also falls under that same licensing. The same thing goes for Github when some forks your repo.
Wait until you hear about forks on github lmao
Wait until you hear about forks on github lmao
As I'm rather new to hugging and git; it's rather disheartening to know the typical redditor mentality is here as well.
Wait until you hear about forks on github lmao
As I'm rather new to hugging and git; it's rather disheartening to know the typical redditor mentality is here as well.
Where do you think the majority of the userbase is from? Same age demographic as well.
