What is Amazon Bedrock?

Amazon Bedrock is a platform that provides you the flexibility to choose from a wide range of FMs built by leading AI startups and Amazon so you can find the model that is best suited for what you are trying to get done. With the presence of Bedrock’s serverless experience, you can get started quickly, privately customize FMs with your own data, and easily integrate and deploy them into your applications using the AWS tools and capabilities you are familiar with (including integrations with Amazon SageMaker ML features like Experiments to test different models and Pipelines to manage your FMs at scale) without having to manage any infrastructure.

According to CNBC

The announcement indicates that the largest provider of cloud infrastructure won’t be leaving a trendy growth area to challengers such as Google and Microsoft, both of which have started offering developers large language models they can tap into. Generally speaking, large language models are AI programs trained with extensive amounts of data that can compose human-like text in response to prompts that people type in.

Through its Bedrock generative AI service, Amazon Web Services will offer access to its own first-party language models called Titan, as well as language models from startups AI21 and Google-backed Anthropic, and a model for turning text into images from startup Stability AI. One Titan model can generate text for blog posts, emails or other documents. The other can help with search and personalization.

People using ChatGPT and Microsoft’s Bing chatbot based on OpenAI language models have at times encountered inaccurate information, owing to a behavior called hallucination, where the output can appear convincing but actually has nothing to do with the training data. Amazon is “really concerned about” accuracy and ensuring its Titan models produce high-quality responses, Bratin Saha, an AWS vice president, told CNBC in an interview.

Clients will be able to customize Titan models with their own data. But that data will never be used to train the Titan models, ensuring that other customers, including competitors, don’t end up benefiting from that data, said another vice president.

According to TechCrunch

AWS today unveiled Amazon Bedrock, which provides a way to build generative AI-powered apps via pretrained models from startups including AI21 Labs, Anthropic and Stability AI. Available in a “limited preview,” Bedrock also offers access to Titan FMs (foundation models), a family of models trained in-house by AWS.

“Applying machine learning to the real world — solving real business problems at scale — is what we do best,” Vasi Philomin, VP of generative AI at AWS, told TechCrunch in a phone interview. “We think every application out there can be reimagined with generative AI.”

The debut of Bedrock was somewhat telegraphed by AWS’ recently inked partnerships with generative AI startups in the past few months, in addition to its growing investments in the tech required to build generative AI apps.

InfoWorld Explained

Training AI models without using enterprise data

“None of the customer’s data is used to train the underlying models, and since all data is encrypted and does not leave a customer’s Virtual Private Cloud (VPC), customers can trust that their data will remain private and confidential,” Sivasubramanian added.

In addition to the Titan foundation models, Bedrock includes the Jurassic-2 family of multilingual LLMs from AI21 Labs, which follow natural language instructions to generate text in Spanish, French, German, Portuguese, Italian, and Dutch.

Anthropic’s LLM, Claude, also included in Bedrock, can perform a wide variety of conversational and text processing tasks and is based on Anthropic’s extensive research into training honest and responsible AI systems, AWS said.

In addition, Bedrock gets a text-to-imaging foundation model in the form of Stability AI’s text-to-image suite.

Other updates to AWS’ arsenal of generative AI tools include making Amazon CodeWhisperer generally available for Python, Java, JavaScript, TypeScript, and C#.

CodeWhisperer, which is an AI-based code generator, competes with Microsoft-owned GitHub’s CoPilot, which recently added AI features to aid developers.

AWS also has announced the general availability of Inf2 cloud instances powered by AWS Inferentia2. These instances, according to the company, are “optimized specifically for large-scale generative AI applications with models containing hundreds of billions of parameters.”