As deployed
The AI processing node

As deployed

A node is a process that stays running on a machine that has a model server. On a Mac it runs as a launchd daemon called ai-processing-node, and its webhook receiver listens on port 22848. The backend registers that receiver as a webhook endpoint, and a delivery worker in the backend keeps retrying any event it could not deliver, from processing.webhook_deliveries.

Description

More than one node can run against one backend. When nodes ask for jobs at the same time, the database hands each a different one, so no job is worked twice. If a node dies, the leases it held run out and the reaper returns those jobs to the queue. Nothing else is lost.

Tech Detail
APIs & protocols
REST