Streaming

Oracle Cloud Infrastructure (OCI) Streaming service is a real-time, serverless, event streaming platform for developers and data scientists. Streaming is tightly integrated with OCI, Database, GoldenGate, and Integration Cloud. The service also provides out-of-the-box integrations for hundreds of third-party products across categories such as DevOps, databases, big data, and SaaS applications.

Get to know Streaming (4:48)

Event Streaming

Serverless infrastructure

Elastic and scalable platform

Data engineers can easily set up and operate big data pipelines. Oracle handles all infrastructure and platform management for event streaming, including provisioning, scaling, and security patching.

Deploy streaming apps at scale

With the help of consumer groups, Streaming can provide state management for thousands of consumers. This helps developers easily build applications at scale.

Oracle Cloud Infrastructure integrations

Native integrations with Oracle Cloud Infrastructure services include Object Storage for long-term storage, Monitoring for observability, Resource Manager for deploying at scale, and Tagging for easier cost tracking/account management.

Kafka Connect Harness

The Kafka Connect Harness provides out-of-the-box integrations with hundreds of data sources and sinks, including GoldenGate, Integration Cloud, Database, and compatible third-party offerings.


Security and reliability

Encryption and privacy

For security, the service provides data encryption both in transit and at rest. Streaming is integrated with Identity and Access Management (IAM) for fine-grained access control, as well as Private Endpoints and Vault (KMS) for data privacy.

Fault tolerance and SLAs

The service uses synchronous data replication across geographically distributed Availability Domains for fault tolerance and durability. Streaming is backed by a 99.9% service availability SLA. Oracle will provide credits for any breaches of this SLA.

Consistent performance

Streaming provides tenancy-level data isolation and eliminates “noisy neighbor” performance issues, irrespective of scale and usage.


Industry-leading pricing

Pay-as-you-use

Customers pay only for what they use, making the service attractive for workloads with large spikes in usage.

Simple pricing model

Customers pay only for throughput and storage, with no upfront costs or early termination penalties.

Zero-cost data movement

Unlike other public cloud providers, Oracle does not charge any additional fees for data movement from Streaming to other Oracle Cloud Infrastructure services.


Customer successes for Streaming

Customers use Streaming as a high speed asynchronous message bus to communicate between their microservices. The service’s compatibility with Kafka APIs allows customers to interact with hundreds first- and third-party tools using the Kafka Connect framework.

Streaming use cases

High throughput message bus

Streaming service is ideal for microservices and other applications that require high throughput/low latency data movement and strict ordering guarantees.


View the architecture

Real-time analytics engine

Feed data at scale from websites or mobile apps to a data warehouse, monitoring system, or analytics engine. Real-time actions help ensure that developers can take action before data goes stale.


Streaming service with Serverless Functions and Splunk

Integration with Oracle Database and SaaS applications

Use Streaming to ingest application and infrastructure logs from Oracle SaaS applications, such as E-Business Suite, PeopleSoft, and Change Data Capture (CDC) logs from Oracle Database. Leverage Streaming’s Kafka connectors for Oracle Integration Cloud, then transport them to downstream systems, such as Object Storage, for long-term retention.


Kafka Connect and Autonomous Database

Data-in-motion analytics on streaming data

OCI Streaming is directly integrated with OCI GoldenGate Stream Analytics, OCI GoldenGate, and Oracle GoldenGate for ingesting event-driven, streaming Kafka messages and publishing enriched and transformed messages. OCI GoldenGate Stream Analytics is a complete application that models, processes, analyzes, and acts in real time, flowing from business transactions, loading data warehouses, or data-in-motion. Users easily build no-code data pipelines. Processing discovers outliers and anomalies, applies insight from ML models, and then alerts or automatically takes the next best action.


Learn more about Stream Analytics

March 17, 2020

Back to the Database—Part 1: Preparing to Persist Data from a Stream

Todd Sharp, Developer Evangelist, Oracle

In my last post, I talked about some of the reasons why it makes sense to take advantage of the power of our RDBMS to handle data instead of manually implementing solutions in our application code. In the next few posts, I'm going to start backing up some of that reasoning with some actual examples…

Read the complete post

Related cloud products

Notifications

Publish/subscribe service for reliable message delivery

Connector Hub

Data movement for Oracle Cloud Infrastructure

Functions

Serverless platform driven by events and APIs

Kubernetes Engine

Highly available container orchestration with automatic updates

Get started with Streaming


Try Oracle Cloud Free Tier

Gain free hands-on experience with Streaming service.


FAQ

Frequently asked questions about Streaming service.


Contact us

Find out how Streaming service can help you.