Skip to content

Instantly share code, notes, and snippets.

View Whamp's full-sized avatar

Will Hampson Whamp

View GitHub Profile
@Whamp
Whamp / PR-BUILD-SHA256SUMS
Created October 24, 2026 13:59
DeepSeek GSQ-RCO loader: pack audit and CUDA numerical evidence
0732074de4a7897de14100e949db8b883e43e661057026ccf3f16d0a71875bd8 build/loader-pr/maya-ds4
29b589c453dad68142f3f5c12b5a139f5a55a23972890798cae61c6580f6f518 build/loader-pr/ds4_gguf_test
@Whamp
Whamp / README.md
Created October 24, 2026 13:18
Project Maya IQ1_M AVX2 CPU optimization: clean-main CPU comparison and qualified full-model evidence

IQ1_M AVX2 CPU row benchmark evidence

Clean-main comparison

  • Baseline Maya commit f26d8bab43f9b10f0475986b541dc46ada45285e.
  • Candidate Maya commit 65b69edb4954256361289fd3e59db7d90ce73bac, four CPU files only.
  • AMD Ryzen Threadripper PRO 3945WX, 12 physical cores, 12 benchmark threads, Ubuntu GCC 15.2.0, Release builds. This CPU supports AVX2/FMA, not AVX-512.
  • Both builds use llama.cpp 3cf03257f219afbe7334045ff7c6a06ac68c627d. All 1,403 local ggml and gguf-py files matched that revision's Git blob hashes before building.
  • Existing tests/ds4_lane_bench.cpp, with 24 synthetic experts, seed 1234, 5,120 input/output dimensions and 2,304 intermediate dimensions. No model, CUDA build or GPU execution is needed.
  • Six independent processes in baseline/candidate/candidate/baseline/baseline/candidate order. Each process warms up, then reports the fastest of five rounds of four-call medians. The table takes the median of three processes per binary.
@Whamp
Whamp / code-like-luke.md
Created August 13, 2026 04:37 — forked from Hona/code-like-luke.md
OpenCode slash command for happy-path-first, use-case-oriented software design
description Implement with clear orchestration, strong interfaces, and happy-path-first design

Code like Luke.

Implement the requested change, but optimize the design for the normal user flow. If the happy path is 95% of runtime behavior, it should be approximately 95% of the code readers see.

Start with context:

  • inspect the existing code, callsites, data flow, and nearby conventions
@Whamp
Whamp / README.md
Created July 28, 2026 19:28
club-3090: official Gemma 4 31B Google QAT W4A16 TP=4 production gate

Official Gemma 4 31B Google QAT W4A16 — TP=4 production gate

Date: 2026-07-28 Issue: noonghunna/club-3090#814

Final profile

  • Slug: vllm/gemma-31b-multi-google-qat-w4a16
  • Target: google/gemma-4-31B-it-qat-w4a16-ct at 52f3f65bc7a02d555763bc923bd1d9094898219d
  • Drafter: google/gemma-4-31B-it-assistant, MTP n=2
@Whamp
Whamp / README.md
Created July 27, 2026 15:55
club-3090 TP=4 FP8/e4m3 vs INT8-PTH KV same-session A/B, vLLM 0.25.1, 4x RTX 3090

club-3090 TP=4 KV-cache A/B — 2026-07-27

Question

Does Whamp's old short-context throughput gain from int8_per_token_head KV survive on current vLLM, and how does it behave as context depth grows?

Fixed conditions

  • Repo commit: 86699d21b34f53c41ceb00357cb599f57523caa3
  • Slug: vllm/qwen-27b-multi-fast
@Whamp
Whamp / wayfinder-to-spec.md
Created July 11, 2026 13:45
Wayfinder to Spec — audit and hydrate a completed Wayfinder map before running /to-spec
description Turn a completed Wayfinder map into a hydrated specification
argument-hint <map-ref>

Wayfinder to Spec

Load and follow /to-spec using this Wayfinder map as the source:

  • Map: $1
@Whamp
Whamp / qwen-27b-multi-max-whamp.md
Created June 19, 2026 17:04
club-3090 qwen3.6-27b multi-max TP=4 report from Whamp 4x RTX 3090 PCIe rig

club-3090 rig report

Generated: 2026-06-19 16:15:21 UTC

Redacted output (paths, host, user, tokens). Re-run with --no-redact for full data.

System

  • OS: Ubuntu 26.04 LTS
  • Kernel: 7.0.0-22-generic
@Whamp
Whamp / coding-standards-draft.md
Created June 19, 2026 00:36 — forked from dmmulroy/coding-standards-draft.md
coding-standards-draft.md

TypeScript Coding Standards

These standards describe how to design and write TypeScript code in this codebase. They are especially intended for agents: before adding patterns, libraries, adapters, or abstractions, read the existing code and prefer the local convention unless it conflicts with the safety/correctness principles below.

Decision priority

When rules pull in different directions, use this order:

  1. Preserve correctness, safety, and debuggability.
  2. Follow established project architecture and conventions.
@Whamp
Whamp / README.md
Last active June 3, 2026 23:36
Minimal WebGL generateMipmap atlas repro for xterm.js PR 5987

WebGL generateMipmap atlas repro

Minimal standalone repro harness for the xterm.js glyph-atlas mipmap issue fixed in xtermjs/xterm.js#5987.

It does not import xterm.js. It creates separate canvases for WebGL2 and WebGL1 so the two context checks do not interfere with each other.

  1. creates a 512x512 canvas-backed RGBA texture, matching the glyph atlas shape;
  2. draws dense terminal-like monospace glyph/color churn into that atlas canvas;
  3. uploads it with gl.texImage2D(..., atlasCanvas);
  4. calls gl.generateMipmap(gl.TEXTURE_2D);
@Whamp
Whamp / imagewoof-train-LearnedRelu-size192.ipynb
Created April 26, 2019 02:38
Imagewoof Training with Learned ReLU size 192
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.