An open, Kubernetes-native serving stack with cache-aware routing, multi-tenant traffic control, tiered KV cache, and high availability ready for production on Google Kubernetes Engine
Source originale
cloud.google.com
Crossing the threshold to dependable open source AI serving ↗
redhat.com · 20 oct.