Infrastructure at your Service

Category

AWS

Franck Pachot

DynamoDB PartiQL – part II: SELECT

By | AWS | No Comments

By Franck Pachot . In the previous post I insertd a few rows in a Demo table using the SQL-like new API on DynamoDB. I checked my items with a SELECT but was limited in the ORDER BY clause. Here is the most important to understand: there are no additional data processing engine here. PartiQL (pronounce it like ‘particle’ and it helps to avoid any kind of dyslexia) parses a statement with INSERT/UPDATE/DELETE/SELECT and calls…

Read More
Franck Pachot

DynamoDB PartiQL – part I: INSERT

By | AWS | No Comments

By Franck Pachot . This sounds paradoxical to execute SQL statements on a NoSQL database, but we have now a new API to interact with DynamoDB, which looks like SQL. AWS data services is a collection of purpose-built database services that have their own API. The relational databases in RDS all share a similar API thanks to the SQL standard. However, for non-relational databases, there is no standard: each NoSQL databases, even if they have…

Read More
Franck Pachot

AWS burstable EC2 and CloudWatch metrics

By | AWS | No Comments

By Franck Pachot . Your application workload is usually not constant and maybe not predictable. If you undersize the capacity, you will save money but in case of peak of activity you will have severe performance issues. Thus, you need to size the capacity for peak workloads: you pay for idle CPU when out of those peaks. This is one major reason for virtualization and cloud: elasticity. Because the hardware is shared by multiple applications,…

Read More
Franck Pachot

AWS DynamoDB -> S3 -> OCI Autonomous Database

By | AWS, Cloud, Oracle | No Comments

By Franck Pachot . I contribute to multiple technologies communities. I’m an Oracle ACE Director for many years, and I also became an AWS Data Hero recently 🎉. I got asked if there’s no conflict with that, as Amazon and Oracle are two competitors. Actually, there’s no conflict at all. Those advocacy programs are not about sales, but technology. Many database developers and administrators have to interact with more than one cloud provider, and those…

Read More
Daniel Westermann

Loading data from S3 to AWS RDS for PostgreSQL

By | AWS, Database Administration & Monitoring | No Comments

AWS RDS for PostgreSQL comes with an extension that allows you to fetch data from AWS S3 and to write back data to AWS S3. The use case for this is obvious: Either you use other AWS services that write data to S3 and you want to further process that data in PostgreSQL, or you want other AWS services to consume data from PostgreSQL by providing that data in S3. Let’s have a look at…

Read More
Franck Pachot

PostgreSQL in AWS: clearing the doubts

By | AWS, Postgres | No Comments

By Franck Pachot . I’ve heard and read people saying that the PostgreSQL managed service is not the true open-source PostgreSQL from the community. This is wrong and I’m writing this post to clarify it. PostgreSQL on EC2 Obviously, you can install PostgreSQL on an EC2 instance, as a database running on IaaS (Infrastructure as a Service). You have the full choice of version, you can even compile it from sources, and add whatever extensions…

Read More
Franck Pachot

NoSQL and SQL: key-value access always scale

By | AWS, Cloud, NoSQL, Oracle | 4 Comments

By Franck Pachot . I have written about some NoSQL myths in previous posts (<a href="https://blog.dbi-services.com/rdbms-scales-the-algorithm/" rel="noopener noreferrer" target="_blank"4here and here) and I got some feedback from people mentioning that the test case was on relatively small data. This is true. In order to understand how it works, we need to explain and trace the execution, and that is easier on a small test case. Once the algorithm is understood it is easy to infer…

Read More
Daniel Westermann

Getting started with Exasol – Distribution keys

By | AWS, Database Administration & Monitoring, Database management | No Comments

After the previous posts about Exasol, which have been more around installation, administration, backup & restore, loading data and general notes around transactions and sessions we’ll now go into more details how Exasol manages data. Here is the list of the previous posts: Getting started with Exasol – Setting up an environment Getting started with Exasol – Loading data from PostgreSQL Getting started with Exasol – Some words about indexes and transactions Getting started with…

Read More
Daniel Westermann

Getting started with Exasol – A multi node cluster in AWS

By | AWS, Database Administration & Monitoring | No Comments

As of now, all the previous posts worked with the Community Edition of Exasol. While that is great for getting started quickly (the Community Edition comes with all the features, except multi node support and a limit of 200GB of data) there are some limitations: Can you not really test how data is distributed across cluster nodes because there is only one. You do not have a real access to the operating system as the…

Read More
Franck Pachot

Amazon Aurora Serverless (PostgreSQL compatibility)

By | AWS, Cloud | No Comments

By Franck Pachot . I’ve written a blog post about serverless databases and here is an example of Amazon RDS Aurora PostgreSQL in serverless mode: When I’ve created the instance (15:55 – CloudWatch is GMT+2 but event log is UTC), it started with 0 capacity unit (18:03), which means that it was paused (you pay for storage only). Then I connected and the instance was resumed (18:19) to its maximum capacity unit (4 here). And…

Read More