It was in early 2000 if memory serves that I first used OLAP Services in SQL Server 7 and Cognos Novaview 1.0 and ten years later I wondered, as you do at this time of the year, what has changed and what will the future bring? and specifically is there a future for the BI professional with the dawn of BI in the cloud?
What did/do people like me actually do?
Even without mentioning the cloud these task have changed over the last ten years I have worked in BI:
SQL Server 2008 R2 arrived last year and attempted to address the need for the business user (or information worker in Microsoft speak) to design their own analytics. This new tool PowerPivot introduced a new column based in memory analytical engine (vertipak), which is simple and fast at the expense of the power of traditional analysis services in such areas as fine grain security control and the development of really complex business logic. This will be up-scaled in SQL Server vNext (aka Denali), but will exist in parallel with analysis services.
Assume for the moment all of this and more will be available at some point in SQL Azure/Office 365 or something like it – where Microsoft BI is offered as a platform as a service (Note: This is pure conjecture on my part) what will change for the BI Professional?
I don’t see any of the fundamental tasks changing, all of the promise of the cloud is good as I never had to worry about setting up infrastructure on most of my projects, indeed often I was never allowed near it and had to put in change requests to get accounts setup and access to data . And that’s a good point where is the data in this new world? If the data is on premise it will have to be moved to the cloud, presumably using some sort of cloud based integration services and we could be talking about a lot of data.
A lot of of the presentation layer is already built on web services so moving that to the cloud will make little or no difference to those, for example SharePoint is in Office 365 although PowerPivot isn’t there yet that can’t be too difficult.
That leaves the design tool which are typically rich clients, like BI Dev Studio and Excel , and these will have to stay on our desktops, it will just be a question of having the right credentials to deploy to the cloud , for example PowerPivot can already load data from SQL Azure and BI Dev studio will allow you to design reports for SQL Azure shortly.
The point about all of this is that the role won’t change that much even if all of the services are available through SQL Azure + Office 365, data will have to be cleansed, and transformed, and users will need support and guidance on how to turn their data into meaningful insights. This means working with the clients and understanding their culture and this in turn means work where they are. This can mean expensive travel and working away form home, but if it can be done anywhere then anyone can do it remotely, which is one reason why off-shoring has only had a limited impact on the BI services industry in the UK.
The appetite for BI in a tough economy shows no sign of declining with the exception of the public sector, and even here some large programs may well have been scrapped but administrators at all levels looking for savings will still need BI to assess the impact of any cuts and to prioritise them.
So I am pretty sure that the next 10 years will be interesting and possibly disruptive but at the end of the next decade people will still need reports and analytics and so they’ll still be a role for us.
For all the promise of the cloud all it really does is take away some infrastructure headaches, and since when has BI had anything to do with infrastructure? The cloud knows nothing about data structures, these have to be analysed and designed by experts.
Reminds me of every demo I've ever seen for BI, all based on CRM systems, which are almost mind numbingly simple compared to most of the work required of me from day to day.