Infrastructure at your Service

Category

AWS

Daniel Westermann

Getting started with Citus – Setting up a four node cluster

By | AWS, Database Administration & Monitoring | No Comments

One issue with traditional database systems like PostgreSQL is, that you cannot easily scale vertically. Of course you could add read replicas and offload read operations, but that either requires changes in the application, or putting something in front that understands the PostgreSQL dialect and automatically routes writes to the primary and spreads reads across one or more replicas (e.g. pgpool-II). But even if you have something in place, you need to deal with replications…

Read More
Daniel Westermann

Building a PostgreSQL EC2 AMI for testing the latest commits

By | AWS, Database Administration & Monitoring | No Comments

Testing the latest features or bug fixes in PostgreSQL can easily be done by pulling the latest commits from the git repository and compile PostgreSQL from source code. I am doing that frequently on my local sandbox VM but this becomes limited when I need more CPUs or more memory. This is where the public cloud really shines, as you can easily deploy new VMs, do your tests and get rid of it afterwards with…

Read More
Franck Pachot

DynamoDB / Aurora: sparse and partial indexes

By | AWS, Cloud | No Comments

By Franck Pachot . In a previous post I tried to build a glossary about Amazon DynamoDB terms that look like relational database terms, but with a different technical meaning. Here is more about it. If you work with AWS Databases and frequently switch between DynamoDB and Aurora, or other RDS databases, you may be confused by the same terms used for different meanings. An index is a redundant structure that is maintained by the…

Read More
Franck Pachot

A VPC is a private cloud in a public cloud

By | AWS | No Comments

By Franck Pachot . If you are surprised that the first thing you do in a Public Cloud is creating a Virtual Private Cloud, this post is for you. This is a beginner level post. And if you are at that level, interested by what is the Cloud and what is AWS, I recommend our free AWS Discovery Days – I give it next week in French: https://www.dbi-services.com/fr/trainings/aws-discovery-days/ Today, with the “digitalization” trend, people are…

Read More
Daniel Westermann

Deploying a Kubernetes cluster on EC2 with Rancher

By | AWS, Cloud, DevOps, Docker, Kubernetes | No Comments

Once Rancher is up and running, it makes the deployment and management of Kubernetes clusters quite easy. In this post we’ll deploy a brand new cluster on top of EC2. If you want to have a simple and quick Rancher playground you can follow this post, which will give you a Rancher setup on SLES 15. If you want to have a more production like Rancher setup, you can follow these posts: Rancher, up and…

Read More
Franck Pachot

AWS: PostgreSQL on Graviton2 with newer GCC

By | AWS, Postgres | 3 Comments

By Franck Pachot . In the previous post I have run PostgreSQL on AWS m6gd.2xlarge (ARM Graviton2 processor). I didn’t precise the compilation option and this post will give more details following this feedback: @FranckPachot thanks for sharing the results. Our own testing showed similar perf when using the default gcc7. However, with newer compiler and use of LSE, the graviton2 would provide higher performance : https://t.co/x9OgFqiPPy — NB (@N_B__N_B) March 9, 2021 First, the…

Read More
Daniel Westermann

Rancher, up and running, on EC2 – 2 – Three nodes

By | AWS, Database Administration & Monitoring, Docker, Kubernetes | No Comments

In the last post we’ve brought up a RKE Kubernetes cluster on a single node. While that is cool for demonstration purposes or testing, this is nothing for a real life setup. Running the control pane, the etcd nodes and the worker nodes all on one node, is nothing you want to do usually, as you can not guarantee fault tolerance with such a setup. To make the RKE cluster highly available we’ll be adding…

Read More
Franck Pachot

AWS: PostgreSQL on Graviton2

By | AWS, Postgres | No Comments

By Franck Pachot . On the AWS free tier, you can run a t2.micro instance for 750 hours per month during the first 12 month after sign-up date. And currently, until June 2021, you can also run a T4g.micro. But be careful, when the free trial ends, or if your usage exceeds the free trial restrictions, you’ll pay the standard pay-as-you-go rates. This is a good occasion to test the Graviton2 ARM processors, and you…

Read More
Daniel Westermann

Rancher, up and running, on EC2 – 1 – One node

By | AWS, DevOps, Kubernetes | No Comments

If you want to play with Rancher you have several options, as outlined in the documentation. There are quick starts for the major public cloud providers (using Terraform), you can install it on a Linux host by using the Rancher container or you can do it on your own. We’ll be doing it step by step, as I believe that gives most information on how things actually work. We’ll start with one node and then…

Read More