Accelerating AI Application Deployment Using Cloud Native Strategies

Introduction

Kubernetes has become the standard for managing containerized applications, and Oracle Cloud Infrastructure Kubernetes Engine (OKE) is a managed Kubernetes service that delivers outstanding cloud reliability. Now, imagine using OKE with AI to create powerful, scalable, highly available AI applications.

This project deploys an AI pipeline with a multipurpose front end for text generation and summarization. The pipeline integrates with a database to track interactions, enabling fine-tuning and performance monitoring for application optimization. It leverages OCI Generative AI APIs on a Kubernetes cluster.

Demo

Prerequisites and setup

1. Oracle Cloud account—sign-up page
2. Oracle Cloud Infrastructure—documentation
3. OCI Generative AI—documentation
4. OCI Kubernetes Engine—documentation
5. Oracle Autonomous Database—documentation
6. Spring Boot framework—documentation

Getting started

• Detailed steps and sample code on GitHub