Infrastructure at your Service

Category

AWS

Daniel Westermann

8000 PostgreSQL clusters on one host?

By | AWS, Database Administration & Monitoring | No Comments

Coming back to the last post: 8000 databases in one PostgreSQL cluster?. As we’ve seen this is doable but comes with a lot of pain points. Another solution for this kind of requirement would be to host 8000 PostgreSQL clusters on one host. Again, I am not saying this is something you should do, and again, this is not how it finally will be implemented. This is more about if you can do it, and…

Read More
Joël Cattin

AWS EC2 instance deployment with Terraform

By | AWS, Cloud | No Comments

When it comes to quickly provision a server in the Cloud, using an Infrastructure as Code (IaC) tool is a solution to consider. There are many IaC products available and among them, Terraform seems to be the most popular. The following is a non-exhaustive list of Terraform advantages : – Terraform can deploy infrastructure to multiple cloud service providers simultaneously – With Terraform, you can easily preview and validate infrastructure changes before they are applied…

Read More
Franck Pachot

DynamoDB Scan: the most efficient operation 😉

By | AWS, NoSQL | No Comments

By Franck Pachot . The title is provocative on purpose because you can read in many places that you should avoid scans, and that Scan operations are less efficient than other operations in DynamoDB. I think that there is a risk, reading those message without understanding what is behind, that people will actually avoid Scans and replace them by something that is even worse. If you want to compare the efficiency of an operation, you…

Read More
Franck Pachot

Amazon Aurora: calling a lambda from a trigger

By | AWS, Cloud | No Comments

By Franck Pachot . You may want your RDS database to interact with other AWS services. For example, send a notification on a business or administration situation, with a “push” method rather than a “pull” one from a Cloud watch alert. You may even design this call to be triggered on database changes. And Amazon Aurora provides this possibility by running a lambda from the database through calling mysql.lambda_async() from a MySQL trigger. This is…

Read More
Franck Pachot

Aurora Serverless v2 (preview) – CPU

By | AWS | No Comments

By Franck Pachot . This follows my previous post https://blog.dbi-services.com/aurora-serverless-v2-ram/ ‎which you should read before this one. I was looking at the auto-scaling of RAM and it is now time to look at the CPU Utilization. I have created an Aurora Serverless v2 database (please don’t forget it is the beta preview) with auto-scaling from 4 ACU to 32 ACU. I was looking at a table scan to show how the buffer pool is dynamically…

Read More
Franck Pachot

Aurora Serverless v2 (preview) – RAM

By | AWS | No Comments

By Franck Pachot . What is Aurora Serverless? That’s the RDS Aurora name for auto-scaling: instead of provisioning an instance size (from the burstable db.t3.small with 2 vCPU and 2GB RAM to db.r5.16xlarge with 64 vCPU and 512 GB RAM) you define a range in term of ACU /Aurora Capacity Unit). ACU is about CPU + RAM. This blog post will focus on RAM. Aurora Serverless v1 In Serverless v1 the ACU goes from 1…

Read More
Franck Pachot

Database announcements at re:Invent 2020

By | AWS | No Comments

By Franck Pachot . This year is not very nice for conferences as everything is virtual and we miss the most important: meeting and sharing with people. But the AWS re:Invent is actually a great experience. As an AWS Data Heros, I received an Oculus Quest 2 to teleport to the virtual Neon City where we can meet and have fun in Virtual Reality (but incredibly real-life chatting): A little bit of what @AWSreInvent looks…

Read More
Franck Pachot

DynamoDB Scan (and why 128.5 RCU?)

By | AWS | No Comments

By Franck Pachot . In the previous post I described the PartiSQL SELECT for DynamoDB and mentioned that a SELECT without a WHERE clause on the partition key may result in a Scan, but the result is automatically paginated. This pagination, and the cost of a Scan, is something that may not be very clear from the documentation and I’ll show it here on the regular DynamoDB API. By not very clear, I think this…

Read More
Franck Pachot

Cross-cloud PMM: which TCP ports to open

By | AWS, Database Administration & Monitoring | No Comments

By Franck Pachot . I recently installed Percona Monitoring & Management on AWS (free tier) and here is how to monitor an instance on another cloud (OCI), in order to show which TCP port must be opened. PMM server I installed PMM from the AWS Marketplace, following those instructions: https://www.percona.com/doc/percona-monitoring-and-management/deploy/server/ami.html. I’ll not reproduce the instructions, just some screenshots I took during the install: I have opened the HTTPS port in order to access the console,…

Read More
Franck Pachot

DynamoDB PartiQL – part II: SELECT

By | AWS | No Comments

By Franck Pachot . In the previous post I insertd a few rows in a Demo table using the SQL-like new API on DynamoDB. I checked my items with a SELECT but was limited in the ORDER BY clause. Here is the most important to understand: there are no additional data processing engine here. PartiQL (pronounce it like ‘particle’ and it helps to avoid any kind of dyslexia) parses a statement with INSERT/UPDATE/DELETE/SELECT and calls…

Read More