Infrastructure at your Service

Category Archives: Development & Performance

David Barbarin

Variations on 1M insert (2): write commit

By | Development & Performance | No Comments

In this blog post, I will try to do the same than my colleagues about Oracle and for PostgreSQL. As a reminder, we’ve seen in my previous blog post that SQL Server is designed to commit transactions implicitly by default and inserting 1M rows in this case may have a huge impact on the transaction log throughput. Each transaction is synchronously committed to the transaction log. In this blog post, we’ll see a variation of…

 
Read More
David Barbarin

Variations on 1M rows insert (1): bulk insert

By | Development & Performance | No Comments

I think you already have read the interesting series of blog posts of my colleagues Franck and Daniel about inserting on 1 million rows for Oracle and PostGreSQL. So it’s time to write the first of the same series concerning SQL Server. First of all, just to clarify, the idea is not to make a direct comparison between Oracle, PostGreSQL and SQL Server but just to see variations that exist for each of them to insert…

 
Read More
Daniel Westermann

the fastest way to load 1m rows in postgresql

By | Development & Performance | 3 Comments

There have been several posts on how to load 1m rows into a database in the last days: Variations on 1M rows insert (1): bulk insert Variations on 1M rows insert(2): commit write Variations on 1M rows insert (1): bulk insert – PostgreSQL Variations on 1M rows insert(2): commit write – PostgreSQL Variations on 1M rows insert (3): TimesTen In this post I’ll focus on how to prepare a PostgreSQL database for bulk loading in…

 
Read More
Daniel Westermann

bulk loading semi structured data in postgresql

By | Development & Performance | 3 Comments

The last post took a look at how to efficiently load 1m rows into a table in PostgreSQL. In this post I’ll take a look on how to do the same with semi structured data. Again it is the same system as in the last post using the same PostgreSQL parameters. Using the hstore datatype For storing key/value pairs there is the hstore extension in PostgreSQL. Using the same sample data as in the last…

 
Read More
Daniel Westermann

Variations on 1M rows insert(2): commit write – PostgreSQL

By | Development & Performance | No Comments

Franck was quite fast with his second post Variations on 1M rows insert(2): commit write. Lets see what we can do on the PostgreSQL side. I’ll take the same test table as Franck again: create table DEMO (“id” number , “text” varchar2(15), “number” number) ; The pgplsql block which corresponds to Frank’s plsql block looks like this: \timing on truncate table DEMO; DO $$DECLARE l_people_array varchar(15)[12] := ‘{“Marc”, “Bill”, “George”, “Eliot”, “Matt”, “Trey”, “Tracy”,”Greg”, “Steve”,…

 
Read More
Daniel Westermann

Variations on 1M rows insert (1): bulk insert – PostgreSQL

By | Development & Performance | No Comments

When I read Franck’s post about Variations on 1M rows insert (1): bulk insert I thought doing quite the same in PostgreSQL might be interesting. Lets start by using the same test tables, one using a primary key and the other one without a primary key:create table DEMO (“id” int , “text” varchar(15), “number” int); create table DEMO_PK (“id” int , “text” varchar(15), “number” int, constraint demo_pk_pk primary key (id) ) ; postgres=# \d demo*…

 
Read More
Stéphane Haby

SQL Server 2012: new perfmon counters

By | Development & Performance | One Comment

I have read some blog postings concerning the new perfmon counters, but I have not seen really extensive overviews yet. In this post, I would like to present not only what is new, but also what has changed (or not) and how to find it. The first step is to select all objects in SQL2008R2 and SQL2012 from the view sys.dm_os_performance_counters. Remarks: All object or counter definitions from this post come from msdn. Objects comparison The…

 
Read More