Skip to content

Instantly share code, notes, and snippets.

View PierpaoloPernici's full-sized avatar
👋
Tweaks!

Pierpaolo 'pier' Pernici PierpaoloPernici

👋
Tweaks!
View GitHub Profile

RTX 5090 Power-Efficiency Tuning for LLM Inference

Benchmark notes from a tuning session on a single NVIDIA GeForce RTX 5090 running Qwen3.8-27B with two inference engines: q27 / Quasar and ninfer.

q27 (Quasar) is a specialized CUDA inference engine by signalnine targeting Qwen3.6/Qwen3.8-27B-MTP on a single RTX 5090 and related NVIDIA GPUs.

The goal was not maximum raw throughput, but finding the best operating point in terms of tokens per second per watt (tok/s/W).


@PierpaoloPernici
PierpaoloPernici / README.md
Last active August 26, 2026 08:15
vLLM vs NInfer — Qwen3.8-27B benchmark (RTX 5090): throughput sweeps (cold/warm) + 69-scenario tool-call suite, tool-eval-bench

Qwen3.8-27B on RTX 5090 — vLLM vs NInfer

Client-side benchmark of two inference engines serving the same model (Qwen3.8-27B, 262 K context) on a single NVIDIA GeForce RTX 5090 32 GB, measured with tool-eval-bench (v2.5.1.dev30+gded5b8f04, Python 3.14.7): a llama-bench-style pp/tg throughput sweep (depths 0–32 K, concurrency 1/2/4) and a 69-scenario tool-call quality suite.

Setup

@PierpaoloPernici
PierpaoloPernici / BENCH_Qwen3.8.md
Last active August 16, 2026 15:26
Qwen3.8-27B NVFP4-MTP benchmark on RTX 5090: tier comparison, n-max sweeps, long-context (real 70k doc), Q8attn vs felippeburk vs Avifenesh FR-Spec vs cross-file drafts, head precision curve + mtp-bench.py / longqa.py tools

Qwen3.8-27B NVFP4-MTP — Benchmark (RTX 5090, llama.cpp builds 10434 + 10752)

Hardware: RTX 5090 32GB (driver 610.88) · AMD Ryzen 7 9800X3D · 64GB RAM · Windows.

Repo: esatapedico/Qwen3.8-27B-NVFP4-MTP-GGUF


Server config (server2.ps1)

@PierpaoloPernici
PierpaoloPernici / llm_bench.py
Created April 12, 2026 16:12
LLM benchmark tool with provider support and accurate tokenization
import time
import openai
import argparse
import uuid
import tiktoken
# ---------------------------------------------------------------------------
# Configurazione provider
# ---------------------------------------------------------------------------
PROVIDERS = {
@PierpaoloPernici
PierpaoloPernici / openpgp.md
Last active November 20, 2022 00:21
Argon

$argon2id$v=19$m=64,t=512,p=2$oZ1WYUwDi9aEoNgliyaZqA$gNQ53QmkebhVTQ54/1R5eg

{
"order": -1,
"index_patterns": [
"pfsense_*"
],
"settings": {
"index": {
"analysis": {
"analyzer": {
"analyzer_keyword": {
@PierpaoloPernici
PierpaoloPernici / sundara-tdrnova.xml
Last active June 1, 2019 15:42
Hifiman Sundara TDR Nova EQ
<TDRNova bandSelected_1="On" bandActive_1="On" bandGain_1="2.1" bandQ_1="0.67" bandFreq_1="79" bandType_1="Low S" bandDynActive_1="Off" bandDynThreshold_1="0.0" bandDynRatio_1="2.0" bandDynSplit_1="On" bandDynAttack_1="20" bandDynRelease_1="200" bandSelected_2="Off" bandActive_2="On" bandGain_2="1.7" bandQ_2="1.50" bandFreq_2="1319" bandType_2="Bell" bandDynActive_2="Off" bandDynThreshold_2="0.0" bandDynRatio_2="2.0" bandDynSplit_2="On" bandDynAttack_2="10.0" bandDynRelease_2="180" bandSelected_3="Off" bandActive_3="On" bandGain_3="-1.1" bandQ_3="0.82" bandFreq_3="3100" bandType_3="High S" bandDynActive_3="Off" bandDynThreshold_3="0.0" bandDynRatio_3="2.0" bandDynSplit_3="On" bandDynAttack_3="5.0" bandDynRelease_3="160" bandSelected_4="Off" bandActive_4="Off" bandGain_4="0.0" bandQ_4="0.60" bandFreq_4="6000" bandType_4="High S" bandDynActive_4="Off" bandDynThreshold_4="0.0" bandDynRatio_4="2.0" bandDynSplit_4="On" bandDynAttack_4="4.0" bandDynRelease_4="23" hpSelected_master="Off" hpActive_master="Off" hpFreq
@PierpaoloPernici
PierpaoloPernici / multitail.conf
Created May 5, 2019 07:12
Multitail setup for home-assistant
#Possible colors: red, green, yellow, blue, magenta, cyan and white.
colorscheme:hass:Home Assistant
cs_re:blue:^.......... ..:..:..
cs_re:red:(\sERROR\s)
cs_re:yellow:(\sWARNING\s)
cs_re:blue:(\sDEBUG\s)
cs_re:cyan::
cs_re:green:\[
cs_re:green:\]
cs_re:green:\(
@PierpaoloPernici
PierpaoloPernici / slate.yaml
Created March 13, 2019 11:28
Slate Theme for HASS
slate:
# Main colors
primary-color: '#2980b9'
accent-color: '#2980b9'
dark-primary-color: 'var(--accent-color)'
light-primary-color: 'var(--accent-color)'
# Text colors
primary-text-color: '#FFFFFF'
text-primary-color: 'var(--primary-text-color)'
secondary-text-color: '#b58e31'
{
"interfaces": {
"ethernet": {
"eth0": {
"address": [
"10.0.0.10/24"
]
}
}
},