Deploy an AI Chatbot on an Ampere A1 Flex Compute Instance Using Minikube

Introduction

This workshop lets users easily deploy and use an open source AI chatbot on an Ampere A1 flexible compute instance, leveraging minikube and Kubernetes for seamless deployment. Operating within Oracle Linux, participants gain hands-on experience deploying on compute shapes without relying on Oracle Cloud Infrastructure (OCI) Kubernetes Engine, enhancing their proficiency in deployment techniques.

Demo

Prerequisites and setup

1. Oracle Cloud account—sign-up page
2. OCI Networking—documentation
3. minikube—documentation
4. Kubernetes—documentation
5. OCI Compute—documentation

Getting started

• Hands-on workshop with step-by-step instructions

Additional resources

• OCI Marketplace image
• Blog: Introducing Meta Llama 3 on OCI Ampere A1: A testament to CPU-Based Model Inference
• Blog: Democratizing Generative AI with CPU-Based Inference