• Decrease Text SizeIncrease Text Size

Why is the on-premise option important even for clients who use cloud LLMs?

Because not every workload should use cloud. Mixed deployments — most routine inference local, occasional heavy generative call to cloud — give clients the best of both. Without the on-premise option, the client is forced to either send everything to cloud or send nothing, and neither extreme is sensible. eratio