Before You Begin
This 15-minute tutorial shows you how to create an Oracle Big Data Cloud Service instance and then create a Hadoop cluster that uses the computing and storage resources that are allocated to the instance.
Background
Oracle Big Data Cloud Service is a comprehensive service for working with big data in a managed cloud environment. The primary component of the service is the Hadoop cluster, where you can store and analyze massive amounts of structured and unstructured data.
Before you create the cluster, you have to create a service instance. When you create the service instance, Oracle allocates computing and storage resources to you, which you can then use to create the cluster.
An Oracle Big Data Cloud Service cluster must have at least one starter pack of 3 nodes and can have up to 57 additional nodes for a total of 60. The minimum recommended size for a production cluster is 5 nodes. This tutorial describes a scenario with 5 nodes: 1 starter pack and 2 additional permanent Hadoop nodes.
What Do You Need?
- A subscription to Oracle Big Data Cloud Service with enough resources to create a five-node cluster. The nodes must be available and not yet allocated to any instance.
- Administrator credentials for signing in to the service. That information is included in the Welcome email sent to the identity domain administrator when the subscription was purchased.
Create an Instance
- Sign in to Oracle Cloud at https://cloud.oracle.com/ and enter your account credentials.
- On your My Services dashboard, click Create Instance to display the Create Instance dialog box. On the All Services tab, click Create in the BigData section.
The Create New Oracle Big Data Cloud Service Instance wizard is displayed.
- In the Instance Details section, accept the default value for Plan, leave Big Data SQL Nodes blank, and enter the following values in the other fields:
- Name:
bdcsdev-instance
- Starter Pack:
1
- Additional Nodes:
2
- Name:
- In the Administrator Details section, enter values for the administrator's email, user name, and first and last names; and then click Create.
- In the Confirmation dialog box, click Create. The Service Details: Oracle Big Data Cloud Service page is displayed.
- In the Service Instances section of the page, find
bdcsdev-instance
and check its status. When the Status field displays Active, the instance is available and you can create a cluster with the resources of this instance.It can take some time for the process to complete, and you may have to click Refresh to refresh the contents of the page. (You'll also receive an email when it's ready.)
Create a Cluster
- In the Service Instances section of the Service Details: Oracle Big Data Cloud Service page, click the Open Service Console link next to
bdcsdev-instance.
The Services console is displayed with the Services page selected.
-
Click Create Service, and then click Big Data Cloud Service.
The Create Service wizard is displayed. It has three pages: Service, Cluster Details, and Confirmation.
- On the Service page, enter
bdcsdev
for the service name, a notification email address, and a description, and then click Next.The Cluster Details page is displayed:
- In the Service Type Subscription Configuration section of the Cluster Details page, click the Big Data Appliance System drop-down list and select
bdcsdev-instance,
which is the name you gave for the service instance when you created it in Section 1. - In the Node roles section, enter
5
in the Permanent Hadoop Node field. Leave the0
in the Edge Nodes field. - In the Cluster Parameters section, enter or select the following values:
- SSH Public Key: Click Edit. In the SSH Public Key for VIM Access dialog box, add an SSH public key. For example, if you want to create a new SSH public/private key pair, select Create a New Key, and click Enter. Then, in the Download Keys dialog box, click Download to download them to your local computer. After they're downloaded, click Done.
- Cloudera Administrative Password: Enter a password that will be used to sign in to Cloudera Manager and manage the cluster.
- Secure Setup: If it's not already selected, select Enabled to create a secure cluster.
- In the Oracle Storage Cloud Service Configuration section of the Cluster Details page, leave the fields blank and click Next.
- On the Confirmation page, verify that the information is correct and click Create. The Services page in the Services console is displayed.
In the row for the cluster that you're creating, a message displays the status of the process. When that message disappears, you can use the cluster.
View the Details of the Cluster
- On the Services page of the Services console, click the name of the cluster. In this tutorial, the name is "bdcsdev," so click the bdcsdev link.
- On the Service Overview page for the cluster, review the cluster details.
Want to Learn More?
Typical Workflow for Using Oracle Big Data Cloud Service