Architect Launches Liquid Inference Auction for AI Model Requests

Architect Financial Technologies launched Liquid Inference on Oct. 7, putting large language model serving requests through a live auction that compares provider bids for each job. The platform routes each request to the lowest-priced offer that meets the buyer’s requirements, applying competition to the serving stage after a model has been deployed. Buyers can set a maximum spend, specify model capabilities, and set response-time and throughput thresholds. They can also restrict approved regions, data retention, and the providers or models allowed to handle requests. A lower-priced offer does not qualify if it fails one of those conditions.

Source: TokenPost