I have a post on NoSQL but as Azure moves on it’s looking a little long in the tooth so I thought it was time for an update..
I am a big fan of Darwin because he was able to question his own beliefs and perceptions by taking a hard look at the evidence around him, and if his survival of the fittest is to be believed then the relational database will be replaced by something better. Mass extinctions generally occur when the environment changes and in the IT landscape the biggest change is the cloud and I can see that this alters the way we interact with data in online transactions. So if we set aside the pros and cons of a traditional relational database for this work,what is there to replace it, that makes it more evolved and better?
The recent arguments I have seen seem to advocate column based databases which are superb for querying but less efficient than row based solutions for oltp. This isn’t really new, I was using Sybase IQ back in 2004 and it really made Business Object fly so I can understand why SAP have acquired Sybase given they now own Business Objects. So was it ahead of its time and will it now flourish as the cloud takes off. Possibly possibly not and I don’t really care because SQL Server is evolving itself to adapt to the demands of the cloud and to handle the many kinds of data we need to keep track of:
I can’t speculate how much of this ends up in future iterations of SQL Azure, but here’s a couple of things to bear in mind:
So my assertion is that databases like SQL Server have continually adapted and survived over the last 35 years and will probably continue for the foreseeable future,.
Happy as ever to debate this online or over coffee
It may be prudent, when talking about sharding in SQL Azure, to point to Lev Novik's presentation at PDC this year (player.microsoftpdc.com/.../591d586f-3732-4bff-8ee2-857f27d74df4) which shows that built-in sharding support is coming to SQL Azure. I'm really excited about this and I'm surprised it hasn't captured more headlines.
Hopefully see you tomorrow at the Open Day
Jamie thanks for this and the link, I will do a separate post for another day
Personally, I'm in favour of Bruce Lipton's view of evolution which he calls Spontaneous Evolution.
In Spontaneous Evolution, the transition of organisms from what they were to what they will be is not based on randomness or survival of the fittest but instead his research has proved in cellular biology that evolution happens in response to the perception of the environment in consistent and replicable ways.
So in synopsis what we have now is in response to what fits best in to the environment that's been and whenever the system comes out of balance i.e. the environment can no longer support whatever is going on there's a sudden spurt of evolution to bring the system as a whole back into balance.