The Inmates Taking over the Asylum? Traditional Data Management Meets Web 2.0

What does the way the public internet is evolving tell us about how Enterprise Data Management might change?

After having presented on these questions recently at DAMA Europe, I've been contacted several times about running an independent follow-up workshop in the London area in the early part of 2007 to work through some of these issues. Anyone who'd be interested in such a workshop, please drop me a line through a comment, link or the email address on my profile page.

Enterprise IT has always looked to improve efficiency through industrialisation and automation. This has often meant standardisation, centralisation, and consolidation were/are used as methods of enabling this. Enterprise Data Management has been no different and has generally followed this path. Whether you're thinking about (1) relational databases and data modelling, whether you're thinking about (2) data warehouses, the CIF and business intelligence, or whether you're thinking about (3) metadata management, business activity monitoring and corporate performance management ... all generations have held standardisation, centralisation and consolidation either at their core, or at least relied on it to a significant degree.

But outside of the enterprise, the internet of enthusiasts and consumers has had rather different dynamics. Rather than automation and industrialisation, its key objectives have tended to be more like access and collaboration. This difference has enabled interesting emergent innovations in the internet that enterprise IT has been able to absorb back into its own practices.

This applied to the original world-wide web and the eCommerce wave where the mass access to information at almost zero cost enabled new channels. New channels for organisations to interact with their customers and suppliers, new ways for systems to interact with their users, and new ways for employees to find and get at information hidden in their organisations' islands of information.

It's interesting to think about what the current wave of evolution in the internet (generally referred to as Web 2.0) might mean. One of the characteristics about what is known as Web 2.0 is that rather than the web primarily acting as a new channel providing greater access and cheaper communication, the emphasis is on the web being the platform itself, providing a basis for new levels of collaboration and cheaper participation.

For the Enterprise Data Management world there is an additional focus in this. As with the original web generation, although the channels available and information access grew, the data was generally still 'owned' in the same place it always had been. However now, the Web 2.0 evangelists and analysts talk about the user controlling their own data - which should grab the attention of all professionals involved in enterprise data, as it's a big mindset change from where things have been in the enterprise.

There are many interesting patterns in Web 2.0 that warrant analysis for clues as to how enterprise data may evolve. The Long Tail for example is very relevant, as enterprise data's current techniques and approaches are generally very expensive in terms of labour, time, and politics and so can only be applied economically (if at all) to the most common pieces of shared data, and not the huge amount of other data. The dynamic bottom-up network effects and the emergence that follows fosters behaviours and insight not normally available with the top-down governance and compliance methods of traditional enterprise data. And the user-provided tagging is very different to the rigid and controlled hierarchical taxonomies, structures and syntax that typically have been the basis of enterprise data approaches. And so on ... (I'll follow up on some of these separately).

So Web 2.0 will undoubtedly introduce new technologies like RSS, Wikis, REST, Blogs, AJAX etc into enterprise usage. But perhaps more interesting than the new technologies is the potential influences it will have on Enterprise Systems design and the way Enterprise Data Management will adapt.

For example:-

Web 2.0 EDM Influence	Challenged EDM Characteristic
Intellectual Commons	Not just Elite Experts
Emergence	Not just Upfront Grand Design
Dynamic Metadata	As well as Fixed Syntax
Tagging & Semantics	Instead of Just Hierarchies
Resources	Beyond Just Data
Links	As well as Replication
Others’ Resources as Your Platform	As well as Your Own

Many will recognise that there has been quite a lot of discussion about what Web 2.0 will mean to Enterprise IT generally (Andrew McAfee's Enterprise 2.0 threads are a fine example) but I havn't yet come across discussion on what it specifically may mean to Enterprise Data, which would seem to be one of the prime areas affected.

Technorati Tags: Enterprise IT Web 2.0 Web_2.0 web-20 Data Management Data Architecture Information Architecture Information Management