Kubernetes Inference

Some Excalidraw Diagram

Model:

• Image
• ModelDataUrl
• Environment

ModelVariant:

• Model
• CPU
• RAM
• Weight

EndpointConfig:

• ModelVariant1
• ModelVariant2

Endpoint:

• EndpointConfig