Tags → #serverless
-
Building a GPU SaaS Platform - Worker Sidecar
Part 15: add a serverless worker sidecar, define a UDS framework contract, and return results and metrics through NATS.
-
Building a GPU SaaS Platform - Activator Dispatch
Part 14: add a dedicated activator that consumes ingress invocations, selects or creates GPUUnit workers, and publishes worker-targeted dispatch messages.
-
Building a GPU SaaS Platform - Queue-First Ingress
Part 13: record the runtime-side serverless contract on GPU units and enqueue invocations durably through NATS JetStream before any worker executes them.
-
Building a GPU SaaS Platform - OverlayBD Cold Start
Part 12: explain how OverlayBD converts OCI images into a lazy-pullable block format and why that changes cold start for large GPU images.