Nick K. PRO

hexgridcloud

·

https://hexgrid.cloud

AI & ML interests

One-click deployment of Open-source LLMs, on managed and dedicated GPUs.

Recent Activity

upvoted an article about 11 hours ago

Deploying Qwen3.8-2.4T-A95B with vLLM: Verified GPU Pods, Quants, and Serving Recipes

published an article about 11 hours ago

Deploying Qwen3.8-2.4T-A95B with vLLM: Verified GPU Pods, Quants, and Serving Recipes

new activity about 21 hours ago

Qwen/Qwen3.8-2.4T-A95B:I researched the practical vLLM configs for Qwen3.8-2.4T-A95B — a few findings that surprised me more...

View all activity

Organizations

New activity in Qwen/Qwen3.8-2.4T-A95B about 21 hours ago

I researched the practical vLLM configs for Qwen3.8-2.4T-A95B — a few findings that surprised me more...

#35 opened about 21 hours ago by

New activity in google/gemma-4-31B-it about 2 months ago

Benchmarked on HexGrid Cloud : Gemma-4 31B + vLLM + RTX 6000 PRO : 1168 tokens/sec and still asking for more...

#123 opened about 2 months ago by

New activity in Qwen/Qwen3.5-9B about 2 months ago

Deployed on HexGrid Cloud: 1x RTX 5090 + Qwen3.5 9B BF16 — 1280 tok/s peak, then TTFT goes from 0.7s to 18s, ShareGPT, concurrency 16–128

#58 opened 2 months ago by

New activity in Qwen/Qwen3.5-9B 2 months ago

Deployed on HexGrid Cloud: 1x RTX 5090 + Qwen3.5 9B BF16 — 1280 tok/s peak, then TTFT goes from 0.7s to 18s, ShareGPT, concurrency 16–128

#58 opened 2 months ago by