Infrastructure at your Service

Category

Cloud

Franck Pachot

AWS Certified Database Specialty (DBS-C01)

By | AWS, Cloud | One Comment

Here is my feedback after preparing and passing the AWS Database Specialty certification. There are tips about the exam but also some thoughts that came to my mind during the preparation when I had to mind-shift from a multi-purpose database system to purpose-built database services. Exam Availability This exam was in beta between last December/January and then was planned for production starting April 6, 2020. I initially planned to take the exam this first day…

Read More
Daniel Westermann

Rapid PostgreSQL cloning using AWS EBS snapshots

By | AWS, Cloud, Database Administration & Monitoring | No Comments

When you go for AWS EC2 instances to host your PostgreSQL deployments and you want to rapidly clone PostgreSQL instances for development or testing purposes you can make use of AWS EBS snapshots. In this post we’ll look at how you can quickly spin up EC2 instances that use these snapshots as a base for new PostgreSQL clusters. Although we’ll be using the AWS console to show how this can be done you should use…

Read More
Daniel Westermann

Using AWS Storage Gateway as a backup target for PostgreSQL

By | Cloud, Database Administration & Monitoring | No Comments

In the last post we had a quick look at AWS Kinesis data streams and how you can push data to AWS S3 using AWS Firehose. Another great AWS service is AWS Storage Gateway and in this post we’ll use that to push our PostgreSQL backups to AWS. The primary usage of AWS Storage Gateway is to extend you local storage to AWS so that you do not have to extend your local storage on…

Read More
Franck Pachot

Oracle disables your multitenant option when you run on EC2

By | Cloud, Oracle | 6 Comments

I have installed Oracle 19.6 on an EC2 for our Multitenant Workshop training. And of course, during the workshop we create a lot of PDBs. If you don’t have paid for the Enterprise Edition plus the Multitenant Option you can create at most 3 pluggable database. But with this option you can create up to 252 pluggable databases. Does it worth the price, which according to the public price list is USD 47,500 + 17,500…

Read More
Daniel Westermann

Sending PostgreSQL data to AWS S3 by using AWS Kinesis data streams

By | Cloud, Database Administration & Monitoring | 2 Comments

Before we really start with this post: This is just an experiment and you should not implement it like this in real life. The goal of this post is just to show what is possible and I am not saying that you should do it (the way it is implemented here will be catastrophic for your database performance and it is not really secure). As I am currently exploring a lot of AWS services I…

Read More
Christophe Cosme

AWS Automation – Stop a RDS instance

By | Cloud, Database Administration & Monitoring, Database management | No Comments

Introduction I created a RDS SQL Server instance on AWS. I use it for test purpose and to minimize the costs I needed to ensure that my instance is stopped automatically at the end of the working day and also because on RDS instances are automatically activated when its schedule maintenance is triggered. In this article I will share the solution I implemented to achieve my goal. I assume you have already created a RDS…

Read More
Franck Pachot

DynamoDB: adding a Local covering index to reduce the cost

By | AWS, Cloud, Database Administration & Monitoring | No Comments

By Franck Pachot . This is a continuation on the previous post on DynamoDB: adding a Global Covering Index to reduce the cost. I have a DynamoDB partitioned on “MyKeyPart”,”MyKeySort” and I have many queries that retrieve a small “MyIndo001” attribute. And less frequent ones needing the large “MyData001” attribute. I have created a Global Secondary Index (GSI) that covers the same key and this small attribute. Now, because the index is prefixed by the…

Read More
Franck Pachot

DynamoDB: adding a Global covering index to reduce the cost

By | AWS, Cloud, Database Administration & Monitoring | No Comments

By Franck Pachot . People often think of indexes as a way to optimize row filtering (“get item” faster and cheaper). But indexes are also about columns (“attribute projection”) like some kind of vertical partitioning. In relational (“SQL”) databases we often add more columns to the indexed key. This is called “covering” or “including” indexes, to avoid reading the whole row. The same is true in NoSQL. I’ll show in this post how, even when…

Read More
Nathan Courtine

Restore S3 Object with AWSPOWERSHELL

By | Cloud | No Comments

AWS S3 offers different Storage Classes, allowing to optimize cost among others. For instance, some classes are used for archiving purposes: S3 Glacier and S3 Glacier Deep Archive. It means the storage cost is the lowest you can obtain, but your data is not available immediately and the access cost is increased. In the case of S3 archive classes, retrieving the data is not cost-effective because this is clearly not what it is aimed for….

Read More
Franck Pachot

Oracle 20c SQL Macros: a scalar example to join agility and performance

By | Cloud, DevOps, Oracle | 2 Comments

By Franck Pachot . Let’s say you have a PEOPLE table with FIRST_NAME and LAST_NAME and you want, in many places of your application, to display the full name. Usually my name will be displayed as ‘Franck Pachot’ and I can simply add a virtual column to my table, or view, as: initcap(FIRST_NAME)||’ ‘||initcap(LAST_NAME). Those are simple SQL functions. No need for procedural code there, right? But, one day, the business will come with new…

Read More