Tag · 8stories
Inference
Coverage tagged Inference. Pulled from across news, research, and tutorials.
News · Jun 19 · 5 min
KVarN Brings Calibration-Free KV-Cache Quantization to vLLM
Tutorial · Jun 4 · 11 min
Self-Hosted vLLM Inference with Audit-Grade OTel Spans on Hetzner
Tutorial · May 25 · 10 min
LiteLLM Proxy with vLLM Backend and OpenTelemetry Cost Attribution
Tutorial · May 25 · 13 min
Self-Hosted vLLM with OpenTelemetry Tracing for Production Inference
News · May 21 · 4 min
Mistral-Inference v1.4.0 Adds Vision via Pixtral-12B
Tutorial · May 14 · 13 min
Benchmarking LLM Guardrail Latency and Accuracy with a Custom Eval Harness
Tutorial · May 11 · 12 min
vLLM KV Cache Hit-Rate Monitoring for Agentic Workloads
[news · screenshot]
News · May 10 · 6 min