AWS Goodies - August 1, 2024

I am writing today's post from the AWS office in Tokyo, where the temperature and the humidity are in the mid-90's:

Here are the most recent goodies from my collection:

GenAI and AI/ML for Capital Markets - This brand-new whitepaper (registration required), Embracing AI-Driven Innovation: AWS Generative AI and AI/ML for Capital Markets, explores high-impact use cases, shares architecture patterns, and dives into case studies. Here's the table of contents:

Cross-Account IAM Groups and Roles - This well-architected lab shows you how to use AWS CloudFormation to automatically configure AWS IAM Groups and Roles for cross-account access.

Building LLM-Based Applications with Bedrock - This new article shows you how to Build LLM-Based GenAI Applications With Amazon Bedrock. It covers model selection, use of your own data for customization, importing custom models, customizing LLM responses based on business needs, integration of external data sources and systems via agents, and use of guardrails to build AI in a responsible manner.

Resource Management in Aurora Serverless - This new blog post by my colleague Marc Brooker provides a detailed review of an even more detailed paper. Marc reviews the innovations in memory management, on-host resource management, and cluster resource management which power Aurora Serverless v2:

Cluster-level resource management is where the real cloud magic happens. With a large number of databases under our control, and a large fleet over which to place them, we can place workloads in a way that optimizes performance, cost, and utilization.

Building a Travel Support Agent - My colleague Elizabeth Fuentes Leone wrote a post to show you how to Build a Travel Support Agent with RAG and PostgreSQL, Using IaC. She sums up her architecture as follows:

This architecture eliminates the need for complex conversation management logic, as Bedrock agents handle session tracking, while the Knowledge Base for Amazon Bedrock using Aurora PostgreSQL ensures highly accurate and contextual responses, and Amazon DynamoDB serves a dual purpose: storing both passenger information and support tickets.

3D Printing and Generative AI - Combining two of my favorite topics, my colleague Guillermo Ruiz explains how he can describe what he wants and have an app generate a 3D model that is ready to print.

AWS Quizzes and Doc Links - This cool app uses AI to generate questions, with some manual tweaking to ensure that the answers are correct and that the links take you to to right place (via /r/aws):

Exabyte-Scale Migration - This brand-new post describes Amazon’s Exabyte-Scale Migration from Apache Spark to Ray on Amazon EC2. After a 2020-era proof-of-concept which showed that Ray could compact 12x larger datasets than Apache Spark, while improving cost efficiency by 91% while processing 13x more data per hour, the production-ready system was tested on exabyte-scale datasets. Their testing uncovered some challenges related to the choice of EC2 instance types, with full details in the post.

Data Strategy for Analytics and Generative AI - This new video talks about Building an end to end data strategy for analytics and generative AI:

And that's all for today!