Back to problems

Embedding Model Server

Object-Oriented Programming · Perplexity · Medium

Embedding Model Server Problem Overview Create a service around an EmbeddingModel class that accepts batches of text and produces embeddings while also supporting an orderly shutdown operation. The service must provide the following behavior: Batch Processing: Accept and process several text inputs together. Graceful Shutdown: Recognize the special shutdown command and terminate the server. Result Mapping: Associate every generated embedding with the input item's ID.…

Checking your access…