Amazon Bedrock Support Added 😄 🚀

[JeremyJonas]

Amazon Bedrock preview access is required to invoke the service

To get started using Amazon Bedrock, you can:

1. Setup Bedrock integration through CLI
2. Via Dev Settings
3. Through the CDK infra code

1) CLI Integration

2) Dev Settings

3) CDK

new BedrockModel(this, "BedrockTitan", {
    modelUUID: "bedrock-titan",
    modelId:"amazon.titan-tg1-large",
    displayName: "Bedrock Titan",
    region:"us-east-1",
    // endpointUrl: <enter custom endpoint domain if needed>,
});

Since Bedrock is not actually deployed, the BedrockModel construct is actually just an integration point to register it with the model inventory. This is what if looks like under the hood:

/**
 * Bedrock service model integration, which does not actually deploy anything
 * but it wires up the model configuration into the inventory to integrate
 * with the rest of the application at runtime.
 */
export class BedrockModel extends Construct implements IModelInfoProvider {
  static formatUUID(modelId: string): string {
    return `bedrock::${modelId}`;
  }

  readonly modelInfo: IModelInfo;

  constructor(scope: IConstruct, id: string, props: BedrockModelProps) {
    super(scope, id);

    this.modelInfo = {
      uuid: props.modelUUID ?? props.modelId,
      modelId: props.modelId,
      framework: {
        type: ModelFramework.BEDROCK,
        modelId: props.modelId,
        region: props.region ?? BEDROCK_REGION,
        modelKwargs: props.modelKwargs,
        endpointUrl: props.endpointUrl,
      },
      adapter: props.adapter,
    };
  }
}