You can now use Amazon Bedrock to process prompts in batch to get responses for model evaluation, experimentation, and offline processing.ENnbsp;

Using batch API makes it more efficient to run inference with foundation models (FMs). It also allows you to aggregate responses and analyze them in batches.ENnbsp;

Batch processing is generally available in all regions where Amazon Bedrock is available. For more information, see AWS Services by Region.ENnbsp;

To learn more about batch inference in Amazon Bedrock, see Amazon Bedrock API reference. Pricing for batch mode is the same as pricing for On-Demand mode. For details, see the Amazon Bedrock pricing page.