Tag: Inference

1. A proxy that turns your prompt into a PNG to cut token costs (github.com)
   Engineering · 1 week ago · July 4, 2026
2. A startup bets oscillator chips can cut AI inference power 1,000x (techcrunch.com)
   AI · 2 weeks ago · June 28, 2026
3. OpenAI shows its first custom chip, Jalapeño, built for inference (techcrunch.com)
   AI · 2 weeks ago · June 25, 2026
4. Moebius: a 0.2B inpainting model that keeps up with 12B ones (hustvl.github.io)
   AI · 3 weeks ago · June 23, 2026
5. DiffusionGemma trades quality for speed in open text generation (blog.google)
   AI · 1 month ago · June 11, 2026
6. NVIDIA's open diffusion LLMs run six times faster than autoregressive baselines (huggingface.co)
   AI · 1 month ago · May 23, 2026
7. Modal cuts serverless GPU cold starts by 40x (modal.com)
   Engineering · 1 month ago · May 19, 2026
8. Hugging Face cut 22 percent off generation time by overlapping CPU and GPU (huggingface.co)
   Engineering · 2 months ago · May 14, 2026
9. Fix the inference engine before you patch the RL objective (huggingface.co)
   Engineering · 2 months ago · May 6, 2026

← all tags