• Decrease Text SizeIncrease Text Size

Does Centralpoint support batch inferencing?

Yes. Many tasks — classifying a backlog of documents, generating metadata for an archive, scoring a million records — run far cheaper in batch than synchronously. Centralpoint orchestrates batch inference jobs with retry, checkpointing, and progress reporting. The