OpenAI's Jalapeño Chip Tops Inference Benchmarks in Debut↗
OpenAI's custom inference chip Jalapeño outperforms current state-of-the-art on both tokens-per-user and throughput-per-kilowatt in SemiAnalysis InferenceX benchmarks. This marks OpenAI's first serious step toward hardware independence from Nvidia, with direct implications for future API cost reductions.
