Code Monkey home page Code Monkey logo

bedrock-svls-sam's Introduction

Dynamic Amazon Bedrock model selection with API Gateway and Lambda

This pattern creates an API Gateway REST API with Lambda proxy integration which invokes Amazon Bedrock models for text and image generation.

Learn more about this pattern at Serverless Land Patterns: https://serverlessland.com/patterns/dynamic-bedrock-svls-sam

Important: this application uses various AWS services and there are costs associated with these services after the Free Tier usage - please see the AWS Pricing page for details. You are responsible for any AWS costs incurred. No warranty is implied in this example.

Requirements

Deployment Instructions

  1. Create a new directory, navigate to that directory in a terminal and clone the GitHub repository:

    git clone https://github.com/aws-samples/serverless-patterns
    
  2. Change directory to the pattern directory:

    cd dynamic-bedrock-svls-sam 
    
  3. From the command line, use AWS SAM to deploy the AWS resources for the pattern as specified in the template.yml file:

    sam build
    sam deploy --guided
    
  4. During the prompts:

    • Enter a stack name
    • Enter the desired AWS Region
    • Allow SAM CLI to create IAM roles with the required permissions.
    • Allow 'ApiFunction has no authentication. Is this okay?' for the time being, this can be modified as per requirement.

    Once you have run sam deploy --guided mode once and saved arguments to a configuration file (samconfig.toml), you can use sam deploy in future to use these defaults.

  • Note the outputs from the SAM deployment process. These contain the resource names and/or ARNs which are used for testing.

How it works

A REST API is created that has /image and /text resources associated with the available models in Amazon Bedrock for image and text generation respectively. All resources integrate with a Lambda function over proxy integration.

  • Place a request to /image over HTTP POST method with the required prompt as the request body to generate an image using StabilityAI stable diffusion XL model.
  • Place a request to /text/model* over HTTP POST method with the required prompt as the request body to generate a text output using various models offered by Anthropic, AI21 labs.

Testing

Once you place POST requests to the API endpoint's URL (invoke URL) with prompt in the request body (for example - via Postman client), you will receive an image or a text generated by the LLM models as the response.

Cleanup

sam delete

Copyright 2023 Amazon.com, Inc. or its affiliates. All Rights Reserved.

SPDX-License-Identifier: MIT-0

bedrock-svls-sam's People

Contributors

sushir-vr avatar

Stargazers

 avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.