Infrastructure at your Service

Category Archives: Cloud

Franck Pachot

ATP vs ADW – the Autonomous Database lockdown profiles

By | Cloud, Oracle | No Comments

By Franck Pachot . The Oracle database has always distinguished two types of workloads: transactional (OLTP) and datawarehouse (VLDB, DWH, DSS, BI, analytics). There is the same idea in the managed Oracle Cloud with two autonomous database services. To show how this is old, here is how they were defined in the Oracle7 Tuning Book: The definition has not changed a lot. But the technology behind DSS/DWH has improved. Now, with In-Memory Column Store, Smart…

 
Read More
Franck Pachot
CaptureSUM

Google Cloud Spanner – no decimal numeric data types

By | Cloud, Database Administration & Monitoring | No Comments

By Franck Pachot . Google Cloud Spanner is a distributed relational database focused on scalability without compromising consistency and integrity. It is available only as a managed service in Google Cloud. Basically, the idea is to keep the scalability advantages of NoSQL database (like Bigtable) but adding transactions, relational tables, SQL, structured data,… as in the relational databases we love for decades. The commercial pitch includes all the NoSQL buzzwords, with the addition of the…

 
Read More
Mehdi Bada

Deploy a Cloudera cluster with Terraform and Ansible in Azure – part 3

By | Big Data, Cloud | No Comments

After the deployment step with Terraform and the configuration/installation with Ansible, we will continue the installation of our Cloudera cluster with Cloudera Manager. By following the below steps you will see how to install CDH on our hosts using Cloudera Manager. Connection First, Login to Cloudera manager URL. When you connect to C.M for the first time, you need to accept the Cloudera Terms and Conditions. Then choose your desired edition of Cloudera. For this…

 
Read More
Franck Pachot

ADWC new OCI interface

By | Cloud, Oracle | No Comments

By Franck Pachot . A few things have changed about the Autonomous Data Warehouse Cloud service recently. And I’ve found the communication not so clear, so here is a short post about what I had to do to start the service again. The service has always been on the OCI data centers but was managed with the classic management interface. It has been recently migrated to the new interface: Note that ADWC here is the…

 
Read More
Mehdi Bada

Deploy a Cloudera cluster with Terraform and Ansible in Azure – part 2

By | Big Data, Cloud, Development & Performance | No Comments

In this part of the blog posts series, we will show how ansible helps us to configure our cluster and install all pre-requisite needed for Cloudera Manager. Ansible is one of the most important automation tools currently. Ansible will help us to configure all nodes for a manual installation using Cloudera Manager. Our playbook will contain the following roles: cm_repo: add the same C.M repo into all nodes. os_config: Adjust all OS parameter for installing…

 
Read More
Franck Pachot

ADWC: Creation of Autonomous Data Warehouse Cloud service

By | Cloud, Oracle | 4 Comments

By Franck Pachot . You want to try the Autonomous Data Warehouse Cloud Service? That’s easy. Here is a Step-by-Step. Cloud Credits First, you need Cloud Credits. You may have bought them (any recent negotiation with Oracle Sales, even for on-premises, involves some Cloud Credits). You can have a free trial with 300$ Cloud Credits available for 1 month. To get another month, you need a different e-mail address and different Credit Card number (not…

 
Read More
Mehdi Bada

Deploy a Cloudera cluster with Terraform and Ansible in Azure – part 1

By | Big Data, Cloud | No Comments

Deploying a Cloudera distribution of Hadoop automatically is very interesting in terms of time-saving. Infrastructure as Code tools such as Ansible, Puppet, Chef, Terraform, allow now to provision, manage and deploy configuration for large clusters. In this blog posts series, we will see how to deploy and install a CDH cluster with Terraform and Ansible in the Azure cloud. The first part consists of provisioning the environment with Terraform in Azure. Terraform features an extension…

 
Read More
Franck Pachot

A free persistent Google Cloud service with Oracle XE

By | Cloud, Oracle | 3 Comments

By Franck Pachot . In a previous post I’ve listed several free online services which run an Oracle XE so that you can test your SQL easily. You may want use Oracle XE further, with full access to the database and its host, and still from a web browser. You probably have a Google account. Then you also have a Virtual Machine on the Google Cloud (0.5 vCPU / 1.70 GB RAM boostable to 1…

 
Read More
Mehdi Bada

Managing Oracle Big Data Cloud – CE with REST API

By | Big Data, Cloud, Oracle | 3 Comments

In this blog post, we will see how to manage Oracle Public Cloud Big Data service Compute Edition with REST API. Scheduling the start/stop/restart of a metered PaaS in the Oracle Cloud can be interesting for managing efficiently the consumption of your cloud credits. We should first have a look at the official documentation so as to understand what the API is composed of. https://docs.oracle.com/en/cloud/paas/big-data-compute-cloud/csbdp/QuickStart.html  Use the following URL composition to get access to REST endpoint: https://region-prefix.oraclecloud.com/resource-path According…

 
Read More