Oracle by Example branding

Getting Started with Oracle Big Data Cloud

section 0Before You Begin

This 10-minute tutorial shows you how to create and use an Oracle Big Data Cloud (BDC) cluster.

Background

Oracle Big Data Cloud combines open source technologies such as Apache Spark and Apache Hadoop to deliver a complete Big Data platform for running and managing Big Data Analytics applications.

Oracle Big Data Cloud leverages Oracle’s Infrastructure Cloud Services to deliver a secure, elastic, integrated platform for all Big Data workloads.

You can create Oracle Big Data Cloud clusters in Oracle Cloud Infrastructure and in Oracle Cloud Infrastructure Classic. The infrastructure a cluster gets created in depends on the region you select when you create the cluster. If you see the Availability Domain and Subnet fields when you select a region for the cluster you're creating, that means the cluster will be created in Oracle Cloud Infrastructure. Otherwise, the cluster is created in Oracle Cloud Infrastructure Classic.

The cluster environment in either type of infrastructure is substantially the same. A few differences exist in the underlying infrastructure components and in the supported capabilities.

What Do You Need?

  • Access to Oracle Big Data Cloud Service

section 1Create an Oracle Big Data Cloud Cluster

Perform the following steps to create a BDC cluster.

  1. Login to your BDC account and navigate to the Instances page.
    bdcsce services page
    Description of the illustration a_01.jpg
  2. Click the Create Instance button.
  3. The Create New Instance page appears. Provide basic service instance information here. Enter the values for the following parameters and then click Next.
    • Instance Name: computecluster1
    • Description: my first compute cluster
    • Notification Email: <your email>
    • Region: No Preference
    bdcsce create service page
    Description of the illustration a_02.jpg
  4. The Instance Details section appears. Provide additional configuration parameters for BDC here.
  5. In the Cluster Configuration sub-section, enter the values for the following parameters.
    • Deployment Profile: Full
    • Number of Nodes: 3
    • Compute Shape: OC2m-2.0 OCPU, 30GB RAM
    • Queue Profile: Preemption On
    • Spark Version: 1.6
    bdcsce create service, cluster configuration subsection
    Description of the illustration a_03.jpg
    Note: Few parameters are auto-filled. Modify as per requirement.
  6. In the Credentials sub-section, enter the values for the following parameters.
    • SSH Public Key: <your ssh public key>
    • Administrative User: bdcsce_admin
    • Password: <password>
    • Confirm Password: <password>
    bdcsce create service, credentials subsection
    Description of the illustration a_04.jpg
    Note: Few parameters are auto-filled. Modify as per requirement.
  7. In the Cloud Storage Credentials sub-section, enter the values for the following parameters.
    • Cloud Storage Container: Path to Cloud Storage Container
    • Username: <username>
    • Password: <password>
    • Create Cloud Storage Container: select if a new cloud storage container is required.
    bdcsce create service, cloud storage credentials subsection
    Description of the illustration a_05.jpg
  8. In the Block Storage Settings sub-section, enter the values for the following parameters.
    • Use High Performance Storage: Select if High Performance Storage is required.
    • Usable HDFS Storage (GB): 50
    • Usable BDFS Cache (GB): 50
    bdcsce create service, block storage settings subsection
    Description of the illustration a_06.jpg
    Note: Few parameters are auto-filled. Modify as per requirement.
  9. In the Associations sub-section, enter the values for the following parameters and click Next.
    • Database Cloud Service: Select if required.
    • MySQL Cloud Service: Select if required.
    • Event Hub Cloud Service: Select if required.
    bdcsce create service, associations subsection
    Description of the illustration a_07.jpg
  10. The Confirmation page appears. Confirm your responses and click Create to create the BDC cluster.
    If you want to edit or update any parameter, click Previous to navigate back to Service Details page.
  11. bdcsce create service, associations subsection
    Description of the illustration a_07.jpg

section 2View Cluster Details

Perform the following steps to view details of BDC clusters.

  1. Navigate to instances page. All the clusters with their details are listed here.
    bdcsce services page
    Description of the illustration b_01.jpg
  2. Click on your cluster name. The Instance Overview page is displayed.
    bdcsce cluster service overview page
    Description of the illustration b_02.jpg
  3. Click Administration on the left to view the administration page.
    bdcsce cluster administration page
    Description of the illustration b_03.jpg

section 3View the Cloud Console

Perform the following steps to view the BDC cluster console.

  1. In the Services page, click the Manage this Servicemanage this service menu icon icon of the cluster and then click Big Data Cloud Console.
    manage this service menu
    Description of the illustration c_01a.jpg
  2. manage this service menu
    Description of the illustration c_01.jpg
  3. A window titled Authentication Required appears. Enter your BDC cluster username and password and click Log In.
    authentication required pop up window
    Description of the illustration c_02.jpg
  4. The Big Data Cloud Console is displayed. Observe the page. You can manage your jobs and notebooks from here.
    Big Data Cluster Console
    Description of the illustration c_03.jpg
    Big Data Cluster Console
    Description of the illustration c_04.jpg

more informationWant to Learn More?