Streaming with Apache Kafka

A fully managed Kafka service that allows you to build real-time, distributed data streaming pipelines so you can collect, process, store, and move millions of events per minute in a cost-efficient manner that’s 100% compatible with open source Apache Kafka.

Empower your data fabric with real-time data integration for AI and analytics.

Join us on Thursday, November 21 for a live webinar and Q&A. Learn how the Oracle GoldenGate platform accelerates data movement and simplifies your connectivity.

To get a preview of the Oracle-managed Kafka solution and explore its features and capabilities before it's released to the public, contact your sales representative.

Learn more about Oracle-managed Kafka solution

Why OCI Streaming with Apache Kafka?

Leverage the high-throughput, low-latency Apache Kafka event streaming platform, fully managed on Oracle Cloud Infrastructure (OCI).

Fully managed

Apache Kafka service

100%

Compatible with Apache Kafka

99.9%

Availability SLA

Cost efficient

Simple and user-friendly pricing with an industry-leading price-performance ratio

Secure

Data encrypted at rest and in transit; integrated with OCI Key Management solution

Open source ecosystem

Out-of-the-box support for all open source tools and connectors built for Apache Kafka

OCI Streaming with Apache Kafka use cases

  • Change data capture (CDC)

    Kafka facilitates CDC by efficiently streaming real-time data changes from databases to downstream systems, enabling immediate processing and integration across applications.

  • Metrics and logs ingestion

    Kafka helps combine logs from different servers within a single feed and transform the data into a standardized format for further analysis by downstream applications.

  • Real-time analytics

    Kafka processes and analyzes continuous streams of data for real-time insights, anomaly detection, and predictive analytics.

  • Web/mobile activity data tracking

    Kafka assists in building a user activity tracking pipeline for real-time processing, monitoring, or loading into data warehousing systems for offline processing and reporting.

How OCI Streaming with Apache Kafka works

Typical use cases for OCI Streaming with Apache Kafka involve processing and analyzing real-time streaming data, such as aggregating and analyzing large volumes of log data from multiple sources to gain immediate insights.

This architecture showcases how data flows from ingestion through OCI Streaming with Apache Kafka to final storage and analytics, enabling seamless, real-time data processing and analysis.


How OCI Streaming with Apache Kafka works diagram, description below

A diagram illustrating a typical data flow using OCI Streaming with Kafka. The diagram consists of three main boxes connected by arrows:

  1. The first box on the left, labeled "Data Ingestion," depicts various data sources that feed into the system: notifications, IoT, and logs.
  2. An arrow labeled "Source Kafka Connector" points from the “Data ingestion” box to the second box, “OCI Streaming with Kafka.”
  3. The second box, "OCI Streaming with Kafka," covers the benefits of the core Kafka service on OCI, which is ideal for processing and analyzing streaming data in real time, e.g., analyzing log data from various sources for immediate insights. With this fully managed service, every aspect of Kafka cluster administration is automated, including high availability, patches, upgrades, backups, scaling, and compliance. It’s 100% compatible with Kafka, so there’s no need to change any application code. The service is also cost-efficient, with pay-as-go, competitive pricing based on compute and storage usage.
  4. An arrow labeled "Sink Kafka Connector" points from the “OCI Streaming with Kafka” box to the third box, “Data storage and analytics.”
  5. The third box, labeled "Data storage and analytics,” depicts how processed data is stored in databases, data lakes, or other storage solutions and analyzed using advanced analytics tools.
  6. This diagram visually depicts the flow of data from ingestion, through Kafka processing, to storage and analytics, highlighting the use of Kafka connectors to manage data movement.

Get started with OCI Streaming with Apache Kafka

Try 20+ Always Free cloud services, with a 30-day trial for even more

Oracle offers a Free Tier with no time limits on more than 20 services such as Autonomous Database, Arm Compute, and Storage, as well as US$300 in free credits to try additional cloud services. Get the details and sign up for your free account today.

  • What’s included with Oracle Cloud Free Tier?

    • 2 Autonomous Databases, 20 GB each
    • AMD and Arm Compute VMs
    • 200 GB total block storage
    • 10 GB object storage
    • 10 TB outbound data transfer per month
    • 10+ more Always Free services
    • US$300 in free credits for 30 days for even more

Contact sales

Interested in learning more about Oracle Cloud Infrastructure? Let one of our experts help.

  • They can answer questions like:

    • What workloads run best on OCI?
    • How do I get the most out of my overall Oracle investments?
    • How does OCI compare to other cloud computing providers?
    • How can OCI support your IaaS and PaaS goals?