Infrastructure at your Service

All Posts By

Cloud Team

Cloud Team

Cloud CLI

By | Cloud | No Comments

By Franck Pachot . Here is how to quickly install the CLI (Command Line Interface) for the following public clouds: Amazon, Google, Microsoft and Oracle. On Linux, I’m using wget but you can use curl. I’ll install all cloud command line interfaces into a $HOME/cloud directory and add an alias into $HOME/.bashrc if not already existing Amazon – AWS AWS – install ( mkdir -p ~/cloud/aws-cli ; cd /var/tmp && wget -qc https://awscli.amazonaws.com/awscli-exe-linux-x86_64.zip && unzip…

Read More
Cloud Team

DynamoDB / Aurora: sparse and partial indexes

By | AWS, Cloud | No Comments

By Franck Pachot . In a previous post I tried to build a glossary about Amazon DynamoDB terms that look like relational database terms, but with a different technical meaning. Here is more about it. If you work with AWS Databases and frequently switch between DynamoDB and Aurora, or other RDS databases, you may be confused by the same terms used for different meanings. An index is a redundant structure that is maintained by the…

Read More
Cloud Team

A VPC is a private cloud in a public cloud

By | AWS | No Comments

By Franck Pachot . If you are surprised that the first thing you do in a Public Cloud is creating a Virtual Private Cloud, this post is for you. This is a beginner level post. And if you are at that level, interested by what is the Cloud and what is AWS, I recommend our free AWS Discovery Days – I give it next week in French: https://www.dbi-services.com/fr/trainings/aws-discovery-days/ Today, with the “digitalization” trend, people are…

Read More
Cloud Team

Google Spanner – SQL compatibility

By | Cloud | No Comments

By Franck Pachot . I have posted, a long time ago, about Google Spanner (inserting data and no decimal numeric data types) but many things have changed in this area. There is now a NUMERIC data type and many things have improved in this distributed SQL database, improving a bit the SQL compatibility. gcloud I can use the Cloud Shell, which is very easy – one click fron the console – but here I’m showing…

Read More
Cloud Team

Amazon Aurora: calling a lambda from a trigger

By | AWS, Cloud | No Comments

By Franck Pachot . You may want your RDS database to interact with other AWS services. For example, send a notification on a business or administration situation, with a “push” method rather than a “pull” one from a Cloud watch alert. You may even design this call to be triggered on database changes. And Amazon Aurora provides this possibility by running a lambda from the database through calling mysql.lambda_async() from a MySQL trigger. This is…

Read More
Cloud Team

Aurora Serverless v2 (preview) – CPU

By | AWS | No Comments

By Franck Pachot . This follows my previous post https://blog.dbi-services.com/aurora-serverless-v2-ram/ ‎which you should read before this one. I was looking at the auto-scaling of RAM and it is now time to look at the CPU Utilization. I have created an Aurora Serverless v2 database (please don’t forget it is the beta preview) with auto-scaling from 4 ACU to 32 ACU. I was looking at a table scan to show how the buffer pool is dynamically…

Read More
Cloud Team

Aurora Serverless v2 (preview) – RAM

By | AWS | No Comments

By Franck Pachot . What is Aurora Serverless? That’s the RDS Aurora name for auto-scaling: instead of provisioning an instance size (from the burstable db.t3.small with 2 vCPU and 2GB RAM to db.r5.16xlarge with 64 vCPU and 512 GB RAM) you define a range in term of ACU /Aurora Capacity Unit). ACU is about CPU + RAM. This blog post will focus on RAM. Aurora Serverless v1 In Serverless v1 the ACU goes from 1…

Read More
Cloud Team

Database announcements at re:Invent 2020

By | AWS | No Comments

By Franck Pachot . This year is not very nice for conferences as everything is virtual and we miss the most important: meeting and sharing with people. But the AWS re:Invent is actually a great experience. As an AWS Data Heros, I received an Oculus Quest 2 to teleport to the virtual Neon City where we can meet and have fun in Virtual Reality (but incredibly real-life chatting): A little bit of what @AWSreInvent looks…

Read More
Cloud Team

DynamoDB Scan (and why 128.5 RCU?)

By | AWS | No Comments

By Franck Pachot . In the previous post I described the PartiSQL SELECT for DynamoDB and mentioned that a SELECT without a WHERE clause on the partition key may result in a Scan, but the result is automatically paginated. This pagination, and the cost of a Scan, is something that may not be very clear from the documentation and I’ll show it here on the regular DynamoDB API. By not very clear, I think this…

Read More
Cloud Team

Cross-cloud PMM: which TCP ports to open

By | AWS, Database Administration & Monitoring | No Comments

By Franck Pachot . I recently installed Percona Monitoring & Management on AWS (free tier) and here is how to monitor an instance on another cloud (OCI), in order to show which TCP port must be opened. PMM server I installed PMM from the AWS Marketplace, following those instructions: https://www.percona.com/doc/percona-monitoring-and-management/deploy/server/ami.html. I’ll not reproduce the instructions, just some screenshots I took during the install: I have opened the HTTPS port in order to access the console,…

Read More