Instructions to use Vortex5/Dreamstar-12B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Vortex5/Dreamstar-12B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Vortex5/Dreamstar-12B")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Vortex5/Dreamstar-12B") model = AutoModelForCausalLM.from_pretrained("Vortex5/Dreamstar-12B") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use Vortex5/Dreamstar-12B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Vortex5/Dreamstar-12B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Vortex5/Dreamstar-12B", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/Vortex5/Dreamstar-12B
- SGLang
How to use Vortex5/Dreamstar-12B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Vortex5/Dreamstar-12B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Vortex5/Dreamstar-12B", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Vortex5/Dreamstar-12B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Vortex5/Dreamstar-12B", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use Vortex5/Dreamstar-12B with Docker Model Runner:
docker model run hf.co/Vortex5/Dreamstar-12B
| base_model: | |
| - Vortex5/Hollow-Aether-12B | |
| - Retreatcost/Darkstar-12B | |
| - SicariusSicariiStuff/Sweet_Dreams_12B | |
| library_name: transformers | |
| tags: | |
| - mergekit | |
| - merge | |
| - roleplay | |
| <section class="shell star-theme"> | |
| <div class="title-frame"> | |
| <div class="title-block wide"> | |
| <h2 class="hero-title">Dreamstar-12B</h2> | |
| </div> | |
| <div class="image-slot inset"> | |
| <img src="https://cdn-uploads.huggingface.co/production/uploads/6669a3a617b838fda45637b8/0qX5O2ZmcIi0-c0u3EuJW.png"> | |
| </div> | |
| </div> | |
| <div class="star-divider"></div> | |
| <section class="pane blended"> | |
| <h2 class="pane-title hover-glow">Overview<span class="underline"></span></h2> | |
| <p> | |
| <strong>Dreamstar-12B</strong> is made by merging | |
| <a href="https://huggingface.co/SicariusSicariiStuff/Sweet_Dreams_12B" target="_blank">Sweet_Dreams_12B</a>, | |
| <a href="https://huggingface.co/Retreatcost/Darkstar-12B" target="_blank">Darkstar-12B</a>, and | |
| <a href="https://huggingface.co/Vortex5/Hollow-Aether-12B" target="_blank">Hollow-Aether-12B</a> using a custom method. | |
| </p> | |
| <details class="expando nested" style="margin-top:12px;"> | |
| <summary>Show YAML Config</summary> | |
| <pre> | |
| models: | |
| - model: SicariusSicariiStuff/Sweet_Dreams_12B | |
| - model: Retreatcost/Darkstar-12B | |
| - model: Vortex5/Hollow-Aether-12B | |
| merge_method: smf | |
| parameters: | |
| strength: 1.0 | |
| smoothness: 0.6 | |
| uniqueness: 0.8 | |
| dtype: bfloat16 | |
| tokenizer: | |
| source: union | |
| </pre> | |
| </details> | |
| </details> | |
| </section> | |
| <section class="pane blended"> | |
| <h2 class="pane-title hover-glow">Intended Use<span class="underline"></span></h2> | |
| <div style="display:flex; gap:12px; margin:10px 0; flex-wrap:wrap;"> | |
| <div class="tagbox"> | |
| ⭐ Storytelling | |
| </div> | |
| <div class="tagbox"> | |
| 🎭 Roleplay | |
| </div> | |
| <div class="tagbox"> | |
| ✨ Creative Writing | |
| </div> | |
| </div> | |
| </section> | |
| <section class="pane blended"> | |
| <h2 class="pane-title hover-glow">Credits<span class="underline"></span></h2> | |
| <ul class="credits" style="list-style: none; padding-left: 0; margin-left: 0;"> | |
| <li><strong><a href="https://huggingface.co/mradermacher" target="_blank">Team Mradermacher</a></strong> — Static & imatrix quants</li> | |
| <li><strong><a href="https://huggingface.co/DeathGodlike" target="_blank">DeathGodlike</a></strong> — EXL3 quants</li> | |
| <li><strong>Original creators and model authors</strong></li> | |
| </ul> | |
| </section> | |
| <div class="star-divider"></div> | |
| </section> | |
| <style> | |
| .shell.star-theme { | |
| max-width: 1000px; | |
| margin: 40px auto; | |
| padding: 40px 24px; | |
| position: relative; | |
| background: radial-gradient( | |
| circle at 40% 60%, | |
| #e4ebff 0%, | |
| #c5cffb 40%, | |
| #9399ce 100% | |
| ); | |
| border: 3px solid #7a88d6; | |
| border-radius: 16px; | |
| box-shadow: none; | |
| color: #12152b; | |
| font-family: "Cinzel", "Inter", serif; | |
| overflow: visible; | |
| } | |
| .title-block.wide { | |
| width: fit-content; | |
| max-width: 100%; | |
| margin: 0 auto; | |
| padding: 18px 44px; | |
| position: relative; | |
| border-radius: 12px; | |
| background: linear-gradient( | |
| 135deg, | |
| rgba(235,240,255,0.96), | |
| rgba(215,220,255,0.92), | |
| rgba(190,195,245,0.90) | |
| ); | |
| border: 3px solid rgba(130,140,200,0.85); | |
| box-shadow: | |
| 0 6px 16px rgba(60,70,140,0.28), | |
| 0 0 0 2px rgba(100,110,170,0.35), | |
| inset 0 0 20px rgba(200,205,255,0.50), | |
| inset 0 0 10px rgba(150,160,220,0.35); | |
| display: flex; | |
| justify-content: center; | |
| align-items: center; | |
| text-align: center; | |
| backdrop-filter: blur(7px); | |
| } | |
| .title-block.wide::after { | |
| content: none; | |
| } | |
| .hero-title { | |
| margin: 0; | |
| font-weight: 700; | |
| font-family: "Cinzel Decorative", "Cormorant Garamond", serif; | |
| font-size: clamp(2.3rem, 5.5vw, 3.4rem); | |
| letter-spacing: 0.05em; | |
| text-transform: uppercase; | |
| color: #1a1845; | |
| text-shadow: | |
| 0 0 8px rgba(220,225,255,0.85), | |
| 0 0 18px rgba(150,155,200,0.55), | |
| 0 0 35px rgba(130,130,180,0.35); | |
| } | |
| .image-slot.inset img { | |
| display: block; | |
| margin: 24px auto; | |
| max-width: 94%; | |
| border-radius: 14px; | |
| border: 2px solid rgba(120,120,180,0.55); | |
| box-shadow: | |
| 0 0 25px rgba(100,100,160,0.35), | |
| inset 0 0 14px rgba(160,160,220,0.25), | |
| 0 0 45px rgba(170,170,230,0.20); | |
| } | |
| .star-divider { | |
| height: 18px; | |
| max-width: 900px; | |
| margin: 34px auto; | |
| background: linear-gradient( | |
| to bottom, | |
| rgba(240,240,255,0.95), | |
| rgba(215,215,245,0.90) | |
| ); | |
| border-radius: 50px; | |
| box-shadow: | |
| 0 0 20px rgba(140,140,200,0.35), | |
| inset 0 0 14px rgba(235,235,255,0.55); | |
| opacity: 0.97; | |
| } | |
| .pane { | |
| margin: 28px 0; | |
| padding: 26px; | |
| border-radius: 22px; | |
| border: 3px solid rgba(120,120,190,0.75); | |
| background: linear-gradient( | |
| 145deg, | |
| rgba(255,255,255,0.88), | |
| rgba(235,235,255,0.82), | |
| rgba(220,220,245,0.78) | |
| ); | |
| box-shadow: | |
| 0 4px 14px rgba(80,80,150,0.20), | |
| inset 0 0 20px rgba(180,180,230,0.32), | |
| inset 0 0 10px rgba(130,130,190,0.20), | |
| inset 0 2px 7px rgba(255,255,255,0.45); | |
| backdrop-filter: blur(6px); | |
| } | |
| .pane-title { | |
| font-family: "Cinzel Decorative", "Cormorant Garamond", serif; | |
| font-weight: 700; | |
| font-size: 2.1rem; | |
| letter-spacing: 0.035em; | |
| color: #1c1a55; | |
| text-shadow: | |
| 0 0 6px rgba(220,220,255,0.55), | |
| 0 0 12px rgba(160,160,210,0.42); | |
| position: relative; | |
| padding-bottom: 14px; | |
| } | |
| .pane-title::before { | |
| content: "★"; | |
| display: inline-block; | |
| margin-right: 10px; | |
| font-size: 1.35rem; | |
| color: #3a57ff; | |
| text-shadow: | |
| 0 0 6px rgba(120,140,255,0.85), | |
| 0 0 14px rgba(100,120,255,0.55); | |
| } | |
| .pane-title::after { | |
| content: ""; | |
| position: absolute; | |
| left: 0; | |
| bottom: 0; | |
| width: 100%; | |
| height: 2px; | |
| background: linear-gradient( | |
| to right, | |
| rgba(90,110,210,0.75), | |
| rgba(150,160,230,0.65), | |
| rgba(200,210,255,0) | |
| ); | |
| border-radius: 4px; | |
| } | |
| .tagbox { | |
| padding:10px 18px; | |
| font-size:1.3rem; | |
| font-family:'Cinzel','Inter',serif; | |
| background:rgba(240,245,255,0.85); | |
| border:2px solid rgba(130,150,210,0.55); | |
| border-radius:10px; | |
| white-space:nowrap; | |
| text-align:left; | |
| } | |
| .shell pre { | |
| background: rgba(6,10,18,0.85); | |
| color: #e4e8ff; | |
| border-left: 3px solid rgba(150,150,230,0.55); | |
| } | |
| .shell a { | |
| color: #4455bb; | |
| } | |
| .shell a:hover { | |
| color: #77aaff; | |
| text-shadow: 0 0 8px rgba(140,170,255,0.8); | |
| } | |
| .pane ul li, | |
| .pane ul li strong { | |
| color: #1d1f40 !important; | |
| } | |
| .pane p strong { | |
| color: #1d1f40 !important; | |
| } | |
| .shell.star-theme, | |
| .shell.star-theme .pane, | |
| .shell.star-theme .pane p, | |
| .shell.star-theme .pane ul li, | |
| .shell.star-theme .tagbox, | |
| .shell.star-theme details, | |
| .shell.star-theme pre { | |
| font-size: 1.1rem; | |
| } | |
| .shell.star-theme .tagbox { | |
| font-size: 1.25rem; | |
| } | |
| .shell.star-theme .pane-title { | |
| font-size: 2.25rem; | |
| } | |
| .shell.star-theme .pane { | |
| margin-left: auto; | |
| margin-right: auto; | |
| width: 92%; | |
| box-sizing: border-box; | |
| } | |
| .shell.star-theme .title-frame, | |
| .shell.star-theme .title-block { | |
| margin-left: auto; | |
| margin-right: auto; | |
| width: fit-content; | |
| max-width: 92%; | |
| } | |
| .shell.star-theme .image-slot.inset img { | |
| margin-left: auto; | |
| margin-right: auto; | |
| display: block; | |
| max-width: 92%; | |
| } | |
| .shell.star-theme .star-divider { | |
| margin-left: auto; | |
| margin-right: auto; | |
| width: 92%; | |
| } | |
| </style> |