STEM Rover AI Coding Companion

Coding education in middle and high school faces a scaling problem: meaningful learning requires one-on-one guidance, but teachers cannot provide individualized mentoring to every student simultaneously. General-purpose AI tools sound promising but come with many challenges as they readily hand students complete answers rather than teaching them to think through problems, lack awareness of specific hardware and project constraints, and offer no guardrails against content that violates school acceptable use policies.

Deloitte’s Believers Program partnered with the AWS Cloud Innovation Center (CIC) at Cal Poly to build an AI coding tutor powered by Kiro, AWS’s AI-powered development environment. The Believers AI Tutor lives directly inside the student’s programming environment. It provides real-time, conversational guidance as students program physical robot rover kits using Python on Raspberry Pi hardware. The tutor acts as a Socratic guide: when a student asks how to make their rover turn left, it explains GPIO pin control and motor direction, then asks the student to try writing the code themselves rather than handing them the solution.

What makes this platform uniquely suited for education is how teachers govern the AI’s behavior through Kiro steering files — plain-language files that shape the tutor’s responses without requiring any coding or cloud configuration. Teachers can:

  • Define the AI’s role as a tutor that guides rather than gives answers.
  • Enforce code snippet limits and blocks solution extraction
  • Implement the school district’s acceptable use policies
  • Provide the rover’s complete hardware specification so the AI gives technically accurate, device-specific advice.

In this demo, see how students and teachers interact with the Believers AI coding companion.

TV News Archive Segmentation

This AI-powered tool automatically transcribes, segments, and labels television news broadcasts, making large media collections more discoverable and accessible to researchers. Developed by the first student cohort of the Vanderbilt Cloud Innovation Lab for Libraries and Applied Digital Preservation, the solution reduces costs by up to 80 percent compared to manual processes while outperforming manually curated data in accuracy.

The Vanderbilt Television News Archive holds approximately 65,000 hours of content, including 1 million news segments and 500,000 commercial breaks recorded continuously since August 5, 1968. Arranging this collection has traditionally been a labor-intensive manual process. The VCIL-developed tool uses AI to transcribe video broadcasts, break up content into time-stamped segments, and label each segment by type, such as news report, commercial, or teaser.

The open-source solution enables other institutions with extensive media collections to adopt the same approach. Future iterations will expand into automated video clipping, metadata generation, and cloud-based collection management tools for archivists.

AWS services used:

  • Amazon Bedrock
  • Amazon Transcribe
  • Amazon S3
  • AWS Lambda

More information:

Automated Knee Alignment Measurement

This AI-powered tool automatically identifies anatomical landmarks on knee X-rays and calculates the measurements surgeons need before performing knee replacement surgery. Built for the University of Pittsburgh School of Medicine, the solution reduces a 15-minute manual task to seconds while achieving a mean error of less than one degree.

Before knee replacement surgery, surgeons must measure precise angles from long-leg radiographs to guide how they align the prosthetic joint. The tool uses a U-Net convolutional neural network trained on over 300 manually annotated radiographs to detect eight key anatomical landmarks, then automatically calculates the Lateral Distal Femoral Angle (LDFA) and Medial Proximal Tibial Angle (MPTA). Rather than simply returning numbers, the solution overlays predicted landmark positions and measurement lines directly onto the X-ray, giving surgeons a quick visual check before accepting the output.

With more than 700,000 knee replacements performed annually in the United States, the potential time savings are substantial. The same approach could be adapted to other procedures requiring manual measurement from medical imaging.

AWS services used:

  • Amazon S3
  • Amazon SageMaker
  • AWS Amplify
  • API Gateway
  • Lambda

More information:

Survey Analysis Agent

This GenAI-powered conversational interface allows users to query survey data in plain English, transforming how organizations extract insights from fan feedback, customer responses, and qualitative data. Developed with Pitt Athletics, the solution eliminates the delays of traditional survey analytics workflows by letting staff simply ask a question and get an answer.

The solution consolidates structured survey responses, open-ended text, sentiment scores, and timestamps into a unified, searchable dataset. Using retrieval-augmented generation (RAG) and embedding-based semantic search, it generates dynamic summaries, explains sentiment trends in context, and surfaces patterns that static dashboards might miss. Each insight includes citations with original response IDs, giving users full visibility into the evidence behind every answer.

Beyond surveys, the underlying approach has broad applications for customer experience teams, donor feedback programs, campus climate surveys, and clinical feedback systems.

AWS services used:

  • Amazon Bedrock
  • Amazon S3
  • AWS Lambda
  • Amazon API Gateway

More information:

Building Permit Review

This solution is an AI-enabled document-intelligence solution capable of reviewing, extracting, and validating information from complex regulatory and engineering documents.

Building permit applications often require extensive documentation and verification. For example, applicants need to prepare multiple types of complex documents containing diagrams, charts, and text, while reviewers must verify hundreds of checklist items against laws and regulations. This collaboration focused on understanding how AI could streamline the review of pool and spa site plans documents that must conform to engineering, zoning, environmental, and safety standards with the goal of reducing manual review time and improving consistency across submissions.

AWS services used: Amazon Textract, Amazon Bedrock, Amazon Comprehend

More information + open-source code

cartoon family at a household pool with desert scenery

Public Inquiry Chat

This AI-powered chatbot helps the public find accurate answers across an organization’s web properties with fewer clicks and clearer next steps. The POC focuses on delivering sourced responses from USDA-owned content, surfacing citations alongside answers, and capturing feedback to continuously improve coverage and quality over time.

This solutions is a serverless web-content RAG chatbot built on AWS with three main flows: Visitor Chat, Admin Dashboard, and Knowledge Ingestion

AWS services used: Amazon Bedrock Knowledge Bases, AWS Lambda, Amazon API Gateway, Amazon EventBridge, Amazon SES, Cognito

Realistic cartoon of a young very skinny slim Latino man in his early 30s wearing a t-shirt under farmer overalls, sitting at a computer in a cozy kitchen facing the viewer. Very thin arms, no muscles. Tan skin, dark hair. Computer screen faces the viewer showing green farmland. Above his head a thought bubble reads "!!" Warm kitchen lighting. Wide landscape.

Presentation Analyzer

Human coaching does not scale easily. This solution helps address a common communication challenge in higher education and professional development: presenters often receive limited, inconsistent, or overly general feedback. By creating a structured and repeatable presentation practice experience, this solution supports more personalized coaching and better preparation for high-stakes presentations.

AWS services used for this solution: Amazon Bedrock, Amazon Rekognition, Amazon Transcribe, AWS Lambda, Amazon API Gateway, AWS Kinesis Video Streams, Amazon S3, AWS Cloud Development Kit

cartoon woman speaking to people in audience

Disease Concept Model Builder

In qualitative health research, transforming hours of patient and caregiver interviews into structured Disease Concept Models is a labor-intensive process critical for regulatory submissions and clinical outcome assessments. This solution leverages generative AI to automatically extract and classify key observations — symptoms, patient impacts, and caregiver impacts — from transcribed interviews (VTT format) into meaningful subdomains.

The result is a structured, publication-ready Disease Concept Model that captures the lived experience of a condition from both patient and caregiver perspectives, dramatically reducing manual coding time while supporting peer-reviewed research and patient-centered product development.

AWS services used:

  • Amazon Bedrock
  • Amazon S3
  • AWS Lambda
  • Amazon API Gateway

Disease Concept Model Builder

Diverse Learner Support

The K-12 Co-Teacher is an AI-powered assistant that streamlines the management of student accommodations and support plans for educators. By integrating IEPs, 504 plans, and psychological reports with daily lesson planning, the solution reduces administrative burden while ensuring consistent support for students. The system provides real-time accommodation surfacing, class-level and individual student views, and maintains living records of student progress. Through intelligent analysis of lesson content, it automatically flags potential challenges and recommends inclusive strategies aligned with documented supports, making differentiated instruction more manageable for teachers dealing with multiple class sections.

AWS services utilized:

  • Amazon Bedrock (Anthropic Claude Sonnet 3.7)
  • AWS Amplify
  • Amazon Cognito
  • Amazon API Gateway
  • AWS Lambda
  • Amazon DynamoDB
  • Amazon API Gateway WebSocket APIs

This solution transforms classroom support management by reducing teacher workload, improving consistency of accommodations, and enabling more time for direct student engagement.

Empowering Teachers to Serve Diverse Learners with AI

Sizzle Reel

robot on a pop art background