by Julie Hunt

It’s always great to get a briefing from a very knowledgeable and flexible founder of a young company: tapping into original vision that has been tempered by the experience of customer implementations can be a rich experience. Recently the MDM Think Tank chatted with Martin Turvey, CEO of Loqate, about location intelligence and data quality. Loqate may be a young company, but in many ways, it is not a “start-up” due to the extensive expertise of founders Turvey and Paul Flew, in the areas of address quality practices and location intelligence — and the technologies that support them. Flew’s strong NLP (natural language processing) background is also an important asset for Loqate.

For most businesses, accurate address data is essential; poor address quality costs companies tons of money and lost customers. Not only is missing address information a problem, but inconsistent address data across repositories impedes data synchronization and calls into question the accuracy of all of the data. Turvey provided an interesting point: over 80% of data has a location element (source: PBBI). This means that verifying and cleansing address data, and then adding geocoding, can greatly enhance the usability of this data.

Use cases for location intelligence include: fraud detection, insurance risk assessments, improving mailing and shipping operations, real time mapping of web content and news feeds. Loqate maintains a repository of reference data comprised of address, geocodes, languages and other data covering 242 countries and territories.

Loqate is one of the few independent software vendors for address quality / location intelligence services, since most of the other vendors have been acquired by the usual suspects. Traditional data management stacks from the large infrastructure vendors are not an option for many companies, especially in emerging markets and the larger international arenas for address quality needs.

So Loqate is positioning its independence as a competitive differentiator that allows it to target solution niches not usually covered by the big infrastructure vendors.  This positioning is strengthened by Loqate solution innovation and future direction, including an upcoming Cloud / SaaS offering. Turvey commented that most MDM solutions fail at what Loqate does well for address quality and location intelligence. As to sales model, the Loqate solution is only available through Loqate partner companies that OEM or sub-license the technology.

The components of Loqate are broken down into:  Verify, Geocode, Register, and Identify. Additional technology includes the Geo-Data Quality Engine and the Global Knowledge Repository.

In Verify, where validation and clean up are performed, powerful differentiation exists in the parsing methodology. Based on lexicon and context, parsing algorithms understand what the data should be, based on context parameters. Loqate parsing capabilities analyze and remediate data in situ, and do the hard work on single strings without breaking the string into components first. In fact, the string’s structural context provides cues for Loqate’s parsing / validation. Most other data quality tools require users to do quite a bit of hands-on mapping and other tedious work as preparation for remediation. This isn’t the case for Loqate Verify. Parsing is also trans-global for processing records and strings with mixed international character and language sets. Data can also be transliterated from one character set to another character set (e.g. Roman to Katakana in Japan)

Turvey cited a use case for Fraud Detection: cheats will use fake addresses made up of components that are valid on an individual basis (real street address, real city), but in combination the components do not add up to a valid address. Most other address quality and data quality solutions will vet the individual components but not the composite, which means they may validate a fraudulent address.

Loqate provides real value by trapping errors at data entry time when remediation is at the cheapest point. It’s also essential to trap inconsistencies at data entry to prevent fraud and block bad data from infecting processes such as shipping that can greatly impact costs.

Geocoding is available for every address data element “out of the box”. The geocode assignment results from high granularity generation of a latitude-longitude coordinate for any address worldwide. From the geocode a map visualization can be created, accurate to delivery point / rooftop levels.

Register provides smart data entry to reduce errors and speed up operational processes. This is particularly useful when working with customers, whether it’s a call center employee talking to a customer or a self-service interface for eCommerce.

Identify:  The Loqate Entity Extraction module enables location, additional geographic and contact information to be identEified and extracted from web content and other unstructured information sources. LocationV extractions enable content to be localized, driving location-based services and geographically targeted advertising.

Loqate has included the ability to quantify address data quality through its Accuracy Code analysis. A verification accuracy match score portrays the similarity between input data and the closest reference data match as a percentage between 0 and 100, with 100 as best match, as well as detailing what changes have been made to each key component during processing and determining validity of those components.

Right now, user tweaking is limited and is mainly accomplished through processing rules. There is no means as yet to tweak algorithms. Loqate is taking a slow approach here, being careful not to lead users astray, since algorithm changes can end in unexpected and harmful consequences.

Next up for Loqate is an impending Cloud / SaaS offering that should be available Spring 2012. Loqate is touting their Cloud services as “developer source for anything location”. It is also a great opportunity for further innovation since the Cloud can take software vendors in some very interesting directions.

About the author: Julie Hunt is a software industry strategist and analyst, providing market and competitive insights. Her 25+ years as a software professional range from the very technical side to customer-centric work in solutions consulting, sales and marketing.  Julie shares her takes on the software industry via her blog Highly Competitive and on Twitter at @juliebhunt   For more information, please visit Julie Hunt Consulting – Strategic Product & Market Intelligence Services. 

Liaison provides a cloud-based platform, which is a horizontally marketed solution with a strong focus on Life Sciences. The solution emphasizes a Data Integration component, which handles the movement, transformation and delivery of data. There’s a Data Management component, which handles data quality improvement through semantic data and metadata management, as well as data modeling, data cleansing and  enrichment. Finally, there’s a Data Security component, which protects data at rest and in motion, and provides compliance with  mandates.

Liaison defines MDM as “an ongoing process of continuous data improvement to better meet the needs of the business”, and approaches MDM via a “software as a service” (SaaS) approach through a lifecycle of:

• Data Integration
• Data Consolidation
• Data Management
• Data Automation

Liaison approaches MDM from a history in the product domain, but at this point, many of its customers are mastering product data and business-to-business customer data as well.

The main product component of the Liaison Technologies solution is Enterprise Content Director, which I found a little confusing, since it brought to mind a content management system (CMS). But from the discussion with Jonathan Razza, it was apparent that Liaison was doing the classic MDM functions, such as:

• Extracting data from source systems
• Audit and cleansing
• Matching and merging (survivorship)
• Conversion and loading data
• Maintaining a master repository
• Synchronizing additions and updates to the master data back to the source systems

Additionally, Liaison can do data enrichment in the cloud, focused on the customer domain. Using web services, Liaison’s product can invoke any web service to validate or enrich customer data.

Since Liaison’s product is delivered via the cloud, it makes it easier for Liaison to offer outsourced data stewardship, using an onshore model. This has become a differentiator for Liaison, as it offers managed services (in blocks of hours) to assist clients who may find it difficult to get access to their own internal IT resources when they need something done quickly.

Liaison Technologies brought its customer, xpedx, to tell us about their experiences in an end user case study. xpedx is a $7 billion North American paper, graphic supplies and equipment distributor that has tapped into Liaison’s Cloud MDM solution. xpedx was a finalist in the 2011 Gartner MDM Excellence Awards.

Scott Dickerson, who is the National E-Business Manager for Data Quality and Catalog Services at xpedx, talked to us about their experience with Liaison Technologies. xpedx had over a dozen ERP systems at one point, and over 700,000 – 800,000 SKUs (products).

xpedx uses Liaison to manage 600 product attributes, as well as to integrate data coming from its 13,000+ suppliers. Liaison built a custom web-based “front end” to their cloud offering for xpedx, and uses about 65 ontologies to classify and categorize its products.

Datapoint, the name for the custom web portal created jointly by xpedx and Liaison, turns “dumb applications” into applications capable of producing “smart data” – where the data is in a “ready to go” format for consumption within xpedx.

Liaison has about 9,000 customers across all their services and solutions and almost 40 cloud MDM clients, and like the rest of the MDM industry, is experiencing rapid growth in the interest in and demand for its product. One thing that was interesting about this briefing was that Liaison was the first MDM vendor to bring a customer voice into the conversation at the briefing, and I thought it added a lot of credibility to their message.

The event is sponsored by Trillium Software. Here are the invitation details:

Is your data governance program delivering?

Having a center of excellence to govern and manage your corporate data is no easy task. Yet, a solid data governance program is critical to making your data work for your organization.

In Part 4 of our Data Governance Series: Impact You Can See, you have the chance to hear from a panel of experts who explain how to make your data governance efforts help you achieve your organizations goals by aligning data to your business.

Have a question for our experts? We’d like to hear from you. Submit your question when you register and get the chance to have one of our experts answer it!

The featured speakers are:

• Dan Power, President, Hub Solution Designs
• Jon Asprey, VP of Strategic Consulting , Trillium Software
• Lovan Chetty, Senior Manager (Product Management), Kalido
• Patrick Beatty, Director of Information Management, PwC

Please click here to register.  It should be a very interesting session!

Not because we need to jump on the social networking bandwagon to keep MDM interesting and relevant. But because companies like Google (with Google+) and data.com (formerly Jigsaw and now SalesForce.com) have already cemented the relationship between the two.

The evolving conversation regarding MDM and social networking has two perspectives. One angle considers how to use members of a social network in the management of master data. The other addresses how to use MDM for managing data about members of a social network.

The first context for discussing MDM and social networking has been a subject of interest for some time. Crowd-sourcing is the basic social networking mechanism used to accomplish this goal. The “crowd” can be a well-defined group of employees or a coalition of like-minded members of an online service.

The second recently came to the forefront when Google chairman Eric Schmidt proclaimed that the company will only accept “real names” in Google+. According to GigaOM, Schmidt admitted in an interview “Google is taking a hard line on the real-name issue because it sees Google+ as an ‘identity service’.”

That sounds a lot like an MDM policy in the making.

Marrying MDM and Social Networking

The idea of bringing social networking and MDM together has its roots in “community data stewarding,” which some in the MDM space started touting a few years back. The idea is to leverage the collective efforts of individuals within an organization to help manage master data. More recently the notion of community data stewarding expanded to include using “the masses” for MDM.

Online data services like data.com, which is the reincarnation of Jigsaw after it was acquired by SalesForce.com in 2010, is a good example of mass data stewardship.  Jigsaw is probably the first real adaptation of social networking, specifically crowdsourcing, to managing data about people and organizations.

Even though the stated intent of Jigsaw was to share contact names, I can easily argue that Jigsaw is a social MDM application. By tapping the universe of salespeople for information about people and organizations, Jigsaw, now data.com is, in effect, the first commercially successful crowdsourced Master Data as a Service (DaaS).

Master DaaS is different than MDM SaaS, which is the delivery of MDM software capabilities in the cloud. Personally, I believe all the action is (or will be) at the intersection of Master DaaS and MDM SaaS, which is where data.com is likely heading. But that’s a conversation for another time.

One can also show that even LinkedIn is readily re-purposed as a Master DaaS, where individuals manage their own identity. Consider offerings such as “LinkedIn for Salesforce.com.” It’s not much of a leap to see how contact names in SalesForce.com are indirectly managed by the contacts themselves through their LinkedIn profiles.

While understanding how to adapt crowdsourcing dynamics to data stewardship is worthy of further consideration, this article focuses on the second context: how to use MDM to manage data about members of the crowd, i.e. a social network. This is where the conversation gets contentious, as Schmidt unwittingly demonstrates.

At first blush, all the fuss about banning pseudonyms on Google+ seemingly has nothing to do with MDM. But it does. Very much so.

Master Identity Keeper

According to GigaOM, during an interview with Andy Carven, National Public Radio’s digital editor, Google’s Schmidt stated:

“G+ was build (sic) primarily as an identity service, so fundamentally, it depends on people using their real names if they’re going to build future products that leverage that information. If you think about it, the Internet would be better if we had an accurate notion that you were a real person as opposed to a dog, or a fake person, or a spammer or what have you… So if we knew that it was a real person, then we could sort of hold them accountable, we could check them, we could give them things, we could you know bill them, you know we could have credit cards and so forth.”

Fred Wilson at Union Square Ventures further notes, Google “wants to be an identity gatekeeper,” where individual crowd members basically manage their own identities.

Schmidt and Wilson suggest what sounds like the ultimate Master DaaS for person-type parties. But it raises some interesting questions. Does a business need to definitively know the individuals that they interact and transact business with? While this may seem absurd to even ask, apparently we are at that crossroad. And from the dialogue it seems not everyone agrees on the answer.

Is MDM Evil?

To date, a business naturally assumes that a customer cooperates by exposing their identity. After all, how else can you conduct business?

That said, there are many instances of businesses that don’t know the identity of their customer. P&G, for example, cannot readily identify the consumers who purchase, say, Tide®. The “customer” represented in P&G’s business systems are retailers and wholesalers and some of their employees, but not likely the person pouring Tide® into their washing machines.

On the other hand, take a retailer like Target. Recently, they had some challenges with handling online purchases as described in this story on CNN.

“…shoppers who bought the Missoni Target line are posting on social media websites Facebook and Twitter that they won’t shop at Target again because their online orders are being delayed — or worse, canceled — by the retailer.”

Before the internet, Target did not likely know the identity of many “shoppers,” i.e. customers who made their purchases at a store, unless they had a Target credit card or exposed their identities at the cash register. And even if they did have shoppers’ identities, they would not likely have the capability to resolve the relationships among them, which is a major goal for social media sites.

In the past Target’s customers for MDM purposes were suppliers and wholesalers and not “shoppers.” Just like P&G. With online purchases, however, this is no longer the case.

Of course, Target needs to know the identity of the suppliers and wholesalers and those related contact names. The question is this. Will they ever know the identity of the supplier or wholesaler contact, who, when behaving also as a shopper, is bad mouthing Target on some social media site under a pseudonym…or is part of some anti-Target group? Meanwhile, a Target representative may just have had a seemingly pleasant lunch with the person. They’re being blindsided.

Now consider this. The blog GIZMODO states “Google’s horrible new policy on using real names in Google+ effectively means that the service is now a danger to real people.” (As opposed to fake people?) And “…the policy is evil.”

GIZMODO adds:

“You can’t use initials (even if that’s what you go by). You can’t use a pseudonym (even if that’s what you go by). And you can’t use numbers or symbols (even if they are part of your name).

Æ, e.e. cummings, Malcolm X, and T.S. Eliot would all be in violation of Google’s policy. So, too (by my reading) would be Mark Twain, George Eliot and doubly so, R.U. Sirius. I’m pretty sure nobody whose name you actually know in the band U2 can use Google+ or, by extension, Gmail.”

Play Nice

Apparently Google seeks birth certificate-quality names. Is this the same strength of policy making that MDM needs to succeed?

Traditionally, the answer is not necessarily, because any decent MDM technology will have the ability to relate multiple aliases to a person party. But as MDM moves to manage master data about your customers who are also members of business and social networks, not all aliases are willingly shared.

Everyone knows Mark Twain and Samuel Clements is the same person. And even if we did not, someone besides Twain himself would ultimately have to know his real identity. Otherwise how would he collect his royalties?

And here is the blind spot for MDM moving into the social realm. A 360-degree view will be without those structured or unstructured data relationships of a party that may only be revealed under a fantasy name…and not disclosed to you or anyone else.

Selling and marketing may get a whole lot harder as individuals increasingly armor themselves with pseudonyms and fantasy names (or personas). In response, we see the rise of strict policies enforcing identification…or don’t play on my social media site.

Unfortunately, that’s a double edged-sword, and the physics of it all has yet to get worked out. On the one hand, Facebook and Google have a threshold mass where people have to play by the rules or get booted. On the other hand, the resistive power of the masses can influence those policies. Just ask Netflix.

When a Customer Identity Is the Product

Consider Don Norman’s observation about Google+. Normanis the author of The Design of Everyday Things. He says, “Real names, they (Google) say, turn out to be the names on your driver’s license and your passport and your credit cards so that they can track you.”

He goes on to say Google’s “goal is to gather all the knowledge in the world in one place, but really their goal is to gather all of the people in the world and sell them.”

This appears very much like a goal of MDM: to gather all of the people in your business circle in one place so you can ultimately track them. All, of course, with the intent to manage a relationship with them…um sell them something.

I unequivocally say, yes, this is a goal of MDM. But there is a slight twist to the Google+ story.

Norman also submits that “Most people would say (of Google) ‘we’re the users, and the product is advertising. But in fact, the advertisers are the users and you (we) are the product.”

Typically, MDM assumes we are talking about the identities of persons and organizations like customers, suppliers, employees, partners and the like. Norman fundamentally asks, when a person’s identity is a product, do we have a right to enforce them to share that identity as a condition of use…I mean, participation in a service?

Frankly, I am not quite sure what the big deal is. Credit bureaus, like Experian and other companies like Acxiom, have sold our identities as a product for years.

Data Is Not An Asset. A Person’s Identity and Relationships Are.

According to GIZMODO, “Forget social networking, the big goldmine of the future is online identity verification.” Bingo, that’s Master DaaS.

Two questions related to MDM are at play here. (Since we are solely discussing individuals and groups of individuals …and for simplicity, I exclude master data on other entities such as products.)

1. How do you have transactions and interactions and perform analytics without, well, master data? After all, a party’s name is master data. In other words, how do you create an order or an account without header information about the party?

2. Is there an obligation for people who do business with you to correctly identify themselves? I am not sure how else business can occur. Even setting up a Swiss bank account requires identifying the account holder. Although, I cannot say for certain. I’ve never had enough money to hide from anyone!

Speaking of bank accounts, Dave Winer thinks Google “wants to effectively become a bank.” According to Weiner, knowing the relationships among persons is where the value of sites like Facebook and Google+ is. Knowing and managing the relationships among persons happens to be an important function of MDM too. We can think, then, of a MDM hub as a sort of bank of person and organization identities and the relationships among them.

If nothing else, one thing has been settled. Data is not an asset. The true identity…and corresponding relationships of a party are. It’s an asset to a person. It’s an asset to a business. Even if we mean “asset” rhetorically.

In my opinion, Google+ and other social media sites purporting to be identity services should offer an incentive like Jigsaw does. You gain points by sharing the identities of people you know. If anything, Jigsaw is the evil one. It’s a platform for everyone to “rat out” everyone else they know by disclosing their name, employer, work address, phone number and email address.

Identity and Relationship Resolution and Keeping

The concern voiced by Google resonates in MDM because a single representation of customer information and a “single version of truth” are frequently stated desired outcomes. Given the largest percentage of MDM initiatives involves resolving and managing identities and relationships, we need to reconsider what and who is a party to a transaction and interaction.

For starters, we need to rethink the notion of “customer.” It’s becoming an increasingly marginalized, if not obsolete and irrelevant concept. “Customer” seems inadequate for collectively describing the myriad roles played by all the participants in business transactions and interactions.

If abandoning “customer” altogether is too radical, we should limit it to a very narrow meaning. Take a health insurance company for example. They narrowly define a customer as the employer sponsoring a health plan. That’s it.

An employer a.k.a customer is only one of many participants in their business transactions and interactions. Other participants include subscribers, providers, members, administrators and brokers. They collectively refer to these participants as constituents, and any participant may play more than one role. A provider, for example, can also be a subscriber or member, or if the provider is an organization, such as a hospital, the provider is also an employer that sponsors a health plan for its own employees.

Additionally, we need to recognize that the collection of participants forming a crowd, group, organization, circle or whatever we call it is also an entity. Crowds, circles and groups are similar to organizations, except they usually don’t have a legal standing and tend to be virtual. Nevertheless, they are living, breathing entities that matter and require identity and relationship resolution. This is particularly the case if they are participants or potential participants in a transaction, interaction or analysis.

We can no longer easily segregate the persons and organizations we engage in a transaction or interaction into separate entities like customer, supplier, employee, partner, user, shopper, guest, donor or whatnot. It’s time to recognize these concepts and terms for what they are: role designations, not discrete entities.

The entity is the person or group. That’s why some organizations now collectively recognize all of them as a single entity and dub it a “party” or “constituent” or the like. Where the entity can behave in one or more roles as a customer, supplier, employee, partner, shopper or whatever.

Personally, I prefer “participant” to describe the individuals in a group. “Member” or “party” is probably easier on the brain, but “participant” is an action word, even if it doesn’t nicely roll off the tongue. “Constituent” works too, but sounds a little formal.

I also prefer Google+’s “Circles” to simply “group” or to, say, Facebook’s “Smart Lists” when depicting a crowd. After all, people travel in circles, not on lists! A “list” is too linear, even hierarchical sounding. “Circle” is a clean break from the chronic misrepresentation of all relationships as hierarchical. Plus, we can be participants in multiple related or unrelated circles.

“Smart group” might work too, where smart means identifiable. Then, of course, there is always “network.” A network is neither linear nor hierarchical but it’s too clinical sounding. We can always just say persons and organizations. But that’s unimaginative.

Instead of categorizing persons and organizations by their role in transactions and interactions, just designate them as participants in a circle. Some seek to distinguish social networking and business networking, but in the end, we can’t always distinguish interactions as social or business.

The following table depicts the evolving conceptual models for representing participants and circles in a system. While the goal is to move toward a Stage VI model, most organizations will have systems representing participants and circles in transactions and interactions at different stages.

Where Do We Go From Here

Deriving a panoramic view of fragmented customer data for transaction processing, business interactions and analytics involves multiple parties arranged in complex network configurations. But not all these parties traditionally and simply behave as a “customer.”

Business applications must rapidly evolve to a Stage VI model that can support different sets of relationships among persons, organizations and groups and different sets of data relationships for them. A blind spot may still exist where the identity of participants in a combined social and business circle are irreconcilable.

Until business applications can support a Stage VI model, MDM will have an interim function as keeper of participant and circle identities and relationships. However, even with MDM, separate data relationships based on participant role may not be fully supportable until business systems themselves can support complex network configurations.

Once business applications can support a Stage VI model, they still may not be suitable for managing all participant relationships for two reasons. One, if enterprise applications are not optimized for a large, complex arrangement of participant and data relationships, performance could be a significant roadblock. And two, a production transaction system may not be optimal for dedicated data stewards and curators to maintain participant identities and relationships.

For these reasons, the importance of MDM will increase as it becomes the main mechanism for managing current and historical participant and circle identities and relationships with pointers to corresponding data relationships. As cloud computing penetrates enterprises, resolving and keeping participant identities and relationships will increasingly occur as a combination of MDM SaaS and Master DaaS.

The Master Data Management Track of this conference will be the best we’ve ever had.  There’s been a separate MDM track for five years, since I joined the Education Committee of the Oracle Applications Users Group in 2006.

This year’s COLLABORATE conference will be held in Las Vegas, Nevada at the Mandalay Bay Convention Center on April 22-26, 2012.

We’re looking for papers from new people and returning speakers, on topics like Customer MDM and Product MDM, as well as other domains of MDM. Multidomain MDM – the ability to manage many different domains of data within one MDM hub – would be a great topic.  Data governance is another hot topic that people definitely want to hear about.  Here are the sub-categories that you can use within the MDM Track:

• Best Practices
• Data Quality
• Data Governance
• External Content
• MDM Hubs
• Organizational Change

We’d like a good mix of presentations from end users and consultants. This year, we want more case studies, more real world presentations, and more examples from different industries.

To respond to the MDM Track Call for Papers before the October 17th final deadline, just click here.

VERY IMPORTANT: be sure to indicate the “Master Data Management (MDM)” track (and only that track) in your entry so it doesn’t get lost in the shuffle. When we “build the room”, it’s hard to find your submission if it’s got 4 other tracks added on to it. So just stick with the MDM track, please.

If your paper is selected, you’ll get a free conference registration.

Don’t forget – click here to submit your paper before the October 17th final deadline! 

If it were so, I could redefine an entire industry with this article. The gray area between DG and MDM is real and (artificially) exists due to a lack of definition, maturity, or understanding within an organization. Considering that methodologies for MDM and DG have many variances, it would be a challenge to hit on every possible permutation of DG and MDM to define the dividing lines. Doing so would make for a long and painful read and probably be published under a self-help genre for curing insomnia. Instead, let’s generalize on the goals of each and try to find that utopian business model where there is complete harmony.

To do so, I have broken the discussion into three topics: DG, MDM, and that gray matter in between.

Governance

Data Governance organizations are business entities that define and manage the most vital corporate asset, business information. Governance organizations may vary in participation and influence, but they share common goals of corporate data policy definition, policy enforcement, and communication. DG initiatives arise from self-awareness amongst the business leadership that they create and own information and that IT serves as its librarian. Throughout the business are pockets of information, some self-contained within a single business process and some shared across many.

The self-contained “departmental” information can be manipulated, manufactured, and retired with little concern over consequences to external business processes and are of lesser concern to Governance organizations. But when information created by one business process is integral to other business processes, it becomes apparent that a lack of control introduces organizational risk. DG strives to define the structure within the organization to manage the complete information lifecycle of information deemed to be of business importance in order to mitigate risk.

The “best” or “most effective” methods to accomplish successful Data Governance can be the subject of numerous heated debates. I submit that such debates detract from the true mission of identifying what information is important, how to manage it, how to communicate about it, and most importantly, how to measure the effectiveness of your Governance efforts. If the business already realizes a need for Governance, half the effort is done. As long as there is a desire to institute and improve a process, most any dialog is a step in the right direction.

One aspect of Governance that is rarely in dispute is the identification of data owners and data stewards. Data Owners are responsible for the accuracy and completeness of the information and Data Stewards are entrusted to maintain this accuracy.  Also common is the Governance Council which defines the standards and processes to be followed by the Owners, Stewards, and Librarians. These standards and processes are company assets that become the ‘rules of law’ for all things data.  Like rules that govern acceptable behavior in our society, these rules are in place for the good of the business.

MDM

MDM is an information-centric business process to consolidate and manage specific enterprise data that just happens to use technology to assemble, merge, and distribute the data in question.  MDM arose from a need to ensure consistency of strategic shared information to improve data quality, accessibility, and security.

MDM is unique in that it is limited to specific shared information that is not transactional in nature such as: common reference codes, persons, products, or locations.  Value realized from an MDM solution occurs when information is made consistent across the organization, duplicate records are identified and resolved, and the quality of the information is markedly improved.

Achieving data consistency and quality generally requires a thorough understanding of the information at hand, how and where it is created or modified, and what roles and rules are needed to manage its data life cycle.

Methods for MDM, like DG, vary by business and business need.  Long before any MDM solution can be implemented, extensive process and information re-engineering must be planned for. Organizations that do not integrate information across departments effectively have a much harder time getting consensus during this planning process.  Despite the MDM data subject, methods, or tools used, a common practice of the planning process is to identify those responsible for the data in question and those responsible for its daily management (similar to the data owners and stewards above). For the select information within its domain, MDM should consider management from data inception through retirement and all uses between.  Roles of an MDM project include Business Analysts, Data Architects, Data Owners, Data Stewards, data providers, and data consumers.

Gray Matter

Unless my hints were not blunt enough or I’ve put you to sleep already, it should be apparent that there is significant overlap in the purpose, roles, and assets between Governance and MDM. Both processes define data elements and rules around their creation, management, and retirement.  They also both identify owners and stewards of information and place a structure around the process for ensuring data quality, security, and interaction.  So it seems simple that these overlapping roles would be one and the same, right?  Right?

In a utopian business world, the DG organization would be in place before an MDM initiative begins.  Such a DG organization would be structured with the foresight to handle an MDM initiative. In fact, in Utopia, the DG organization would be the driving force for identifying the business need and performing the cost-benefit analysis to justify such an MDM project.

Without tight coupling between MDM and DG, each initiative will see voids in their processes and fill them in order to be successful in their own right.  If DG has not instituted data standards prior to the MDM envisioning stage (or they are not followed), MDM may limit itself to what is needed to satisfy the current phase or one system. For example, “MDM in a vacuum” may have no reason to validate the business definition, domain, or business name of an attribute or list of values does not conflict with an already-established business data element.  A source system may use NULLs to indicate yes or no conditions or have other non-documented defaults that flow into the Best Version of Truth.

Without a global view of how Yes/No indicators should be handled, an MDM project could proliferate ambiguous data to all its consumers.

Another area of consideration is the logging and reporting of data errors and exceptions. In Utopia, I’m told, it is a law that each data element is assigned a data owner, a data steward, a domain of allowed values, restrictions, and a distinct definition. When data is introduced that break these laws, the violation is recorded and the owner or stewards are notified to rectify the situation. A clearly defined policy to automatically identify and report such violations along with a policy to address these issues in a timely manner ideally springs from a strong DG presence rather than an MDM afterthought.

It is expected that DG will evolve to handle new technologies regardless of whether the technology is new to the organization.  In the case of MDM, a DG organization needs to be able to address MDM concepts like trust and survivorship as well as create and expand policies around data dictionaries and canonical modeling. With tight coupling, an MDM project will look heavily to a DG organization for guidance and resources, and MDM will become another data standardization model to demonstrate the value of DG.

Summary

MDM should be considered an extension of DG.  Without proper controls and standardization of data, the worst case for an MDM project is that is becomes a waste of budget. The best case under the same lack of vision is that the project becomes a waste of potential.  Strong DG methods are undeniably needed when defining and standardizing information within an MDM solution. Without an Enterprise-wide focus on DG, an MDM solution will eventually arrive at a solution that meets the myopic needs of its immediate source/target systems, but little else. When an MDM expansion opportunity arises, the original lack of global vision will result in either a re-evaluation of the entire MDM solution or a limiting of the new audience to the initial design goals.

When considering a new or expanded MDM initiative, the first step should focus on your DG program. DG Stewards and Sponsors are the driving force for MDM justification and definition and are the true customer for MDM. Defined global controls should be finalized and introduced early into the process. Only then will you be considered a citizen of Information Utopia.

Rob DuMoulin is an information architect with more than 26 years of IT experience, specializing in master data management, database administration and design, and business intelligence.

“MDM should be a business driven program” is the mantra we hear time and time again. And while that is the right prevailing wisdom, doesn’t it seem that there is far more articulation about the technical elements of MDM than about the business elements?

So often I have seen MDM publications and presentations start with the “should be business driven” perspective but then quickly shift to covering the technical elements of MDM, topics related to architecture, data models, data integration, metadata management, match logic, consolidation, synchronization, application services, and so on.

Yes, those all are important elements in the MDM equation, but this over-abundance of technical insight can be frustrating for those seeking practical knowledge and guidance for the business planning of an MDM program. After all, without a strong business presence, MDM can’t develop into a core competency throughout the company. So why, in comparison, is so little insight provided about the business side of the equation?

Actually, it’s easy to understand this situation. The plethora of technical insight is a byproduct of the influence that IT and vendors have on the MDM market. And that’s not suggesting that business organizations don’t care to promote their MDM practices, it’s just that there is much more uniqueness and latency involved with getting these business components established, and these dynamics are harder to articulate.

Let’s take a closer look at these influences and dynamics.

The call for MDM

The initial need and sponsorship for an MDM initiative often emerges from the IT and/or analytical groups in a company. These groups usually exist separately or on the periphery of the business. The IT and analytical areas responsible for activities such as system integration, data migration, information management, data warehousing, business intelligence and reporting will typically be the first to expose where poor data quality and lack of data governance is creating project delivery delays, data management problems, integration issues, distrust of the data, and reporting problems.

Therefore, it’s understandable that these groups become initial proponents of MDM solutions. And while the root cause for many of these data problems lies in front-end business practices and data entry points, the IT and analytical groups are most directly impacted and naturally tend to implement their own back-end corrective actions.

At some point these ongoing problems and workarounds become a tangled mess, and that situation becomes a catalyst for seeking an MDM solution. Current state issues, improvement opportunities, and cost/benefit projections cited in MDM proposals are usually centered on correcting these legacy issues, improving data governance and information management practices, and eliminating the workaround overhead. In other cases, MDM programs often emerge when legacy applications are being replaced with more integrated platforms such as business application suites, data hubs, and enterprise warehouses where IT planning and activity is already underway.

Product vendor and consulting influence

Because of the large market opportunity and competition among MDM product vendors and consulting firms, it is expected that they will have a significant influence on the MDM information being presented. Technology and consulting help should always be factored into an MDM assessment and implementation plan. Although the overall impact and practical use of both can often be overstated, good technology and consulting help applied in the right places can definitely advance MDM capability and reach.

But many other aspects of implementing MDM involve new and unique business practices, business context, and process management where technology and consulting help will only have limited application, if any.

MDM is as much about people and process as it is about technology, which is why product vendors are increasingly looking at improving their business consulting practices or consulting partnerships as a competitive advantage. Over time this trend should help bring a better balance of information and practical insight for the planning and implementation of MDM.

Discovery and Analysis

At the onset of an MDM initiative, a “Discovery and Analysis” phase is conducted to fully detail the issues, root causes, business and system impacts, and opportunities for improvement. This discovery and analytical phase is often led by IT or an analytical team, if not a consulting group. Business leads should be actively involved in this phase, but specifically how and where business groups will be needed to drive and support MDM plans will largely depend on what priorities and direction come out of this discovery and analysis work. And where the business engagement needs are identified, the business groups will often need time to plan, budget, and prepare for these activities.

Implementing process improvements and driving data governance activity can be new or disruptive territory for business organizations. Many MDM programs do not have sufficient budgets to cover these business area needs, therefore the implementation of these business elements can take some time.

MDM job roles

IT groups already have most of the necessary job roles and skill sets needed (e.g. analysts, architects, project managers, programmers, data miners, database administrators) to initiate and support the technical aspects of MDM. The business roles needed within a MDM program (e.g. data governance leads, data stewards, process analysts, quality managers, data access gatekeepers) often do not already exist as formal job roles. Consequently these roles either have to be assigned to existing resources that have other job responsibilities and/or created through new hires, job transfers, or contracted positions which can require budget allocation and also take time to fulfill. Therefore it’s common to see IT and analytical related activity initiated early on while the business roles and needs are being addressed.

Maturity models

In MDM and data governance maturity models, we typically see the advanced levels of maturity defined using terms such as Managed, Optimized, Proactive, Advanced, or Transformational. But in many of these models, those levels are characterized by more system and analytical orientated achievements, related to systems integration, establishing a system of record, business process automation, using SOA/SaaS, quality monitoring, delivering trusted analytics and KPIs, and so on.

The business area maturity needs and milestones — associated with data governance, data life cycle management, and quality control — are much less apparent in these maturity models.

Granted, much of the program development and maturity on the business side of a MDM program is going to be tied to unique business practices that are harder to generalize in a high-level maturity model. Therefore it often takes some digging in MDM and data governance forums or finding business case studies to gain good insight on how and where the business events and the maturity of business practices have occurred in a MDM implementation.

A developing dynamic

So even though it is critical for business to be involved and provide leadership in an MDM program, defining, articulating, and achieving that is likely to be a developing dynamic that spawns from IT and analytical underpinnings where product vendors and consulting firms are also well entrenched. As more companies launch MDM initiatives and develop their MDM core competencies across their business model, we can expect to see increasing amounts of business insight and best practice information made available that will express how and where business roles and business practices evolved in MDM programs. I look forward to that.

Mark Allen is co-author of the book “Master Data Management in Practice: Achieving True Customer MDM”. Mark has over 20 years of data management and project management experience including extensive planning and deployment experience with customer master initiatives, data governance programs, and with leading data quality management practices. Mark is a senior consultant and enterprise data governance lead at WellPoint, Inc. Prior to WellPoint, Mark was a senior program manager in customer operations groups at both Sun Microsystems and Oracle Corporation. At Sun Microsystems, Mark served as the lead data steward for the customer data domain throughout the planning and implementation of Sun’s enterprise customer data hub.

Process-centric initiatives are often optimal approaches for the things that companies want to accomplish. Business processes make it possible to directly connect work to business outcomes that lend themselves to various metrics that provide clarity for business performance. On the other hand, data and data-oriented solutions, by themselves, don’t usually map directly to business outcomes, and as such, usually can’t be measured by value contributed to desired outcomes and achievement of key corporate goals.

But — business processes and data are inextricably bound together. Processes create, modify and consume data – one might even say processes live and breathe data. It is through business processes that data can be mapped to business value.

Companies generally have not taken a holistic view of business information, technologies to improve it, or its impacts across end-to-end processes or businesses, instead treating data as information islands within specific system silos.

Kalido, The State of Data Governance Maturity 2011

Notions like “Big Data” and “Information as an Asset” have stimulated thinking in many enterprises about extracting more value from the data already in enterprise repositories to benefit the business and its goals. But to extract that value, it’s not about the data nor is it about data governance. The key focus should be the business processes that impact revenue, business agility, competitiveness, and overall positive performance. However, both reliable data and effective data governance are key enablers of gaining value from business processes.

Data governance is an important strategy both to maintain data in its most usable condition and to ensure consistency in how processes work effectively across the enterprise, by sustaining the quality, accessibility and relevance of data used by processes. Instead of many siloed processes working on siloed data, data governance contributes greatly to connecting essential pieces to synchronize significant business processes to the bigger enterprise strategic picture.

Here is Martin Atherton on data governance as an enabler of business value:

For many companies, it is common to focus on the minimum standards required to achieve compliance, instead of seeking to incrementally expand the effort and reap the benefits of being compliant more broadly across the business. In a previous research note, we used the phrase ‘value driven compliance’ to highlight the difference between approaching regulatory compliance as a chore versus seeing it as a business enabler.

Some of the difficulty of transitioning how enterprises derive value from business processes (and the data running through them) is the fact that most data-related initiatives have been driven by IT instead of by more business-oriented roles.

To enable better business outcomes, data governance needs to bring business roles and IT teams together, as well as incorporating the support of various levels of management and strategic decision-makers. Too many times, data governance has not been implemented strategically. Instead it has been marooned by ad hoc decisions and “policies” tied more to daily operational situations. Without involving data governance in key corporate strategies, enterprises are not in good position to handle internal data issues, let alone address the ever-growing proliferation of data from many new sources inside and outside the enterprise.

Ross Dawson expands on the notion of “governance as an enabler”:

Governance should focus as much on enabling innovation and taking useful risks as about managing and mitigating risk… What needs to happen is that governance, risk, and compliance become part of the process of creating business value… More generally, I think it is important to note that IT governance and corporate governance have long been treated as separate. As I pointed out in my keynote this morning, technology – including in data management – is increasingly central to corporate strategy.

With good commitment from management, business units and IT teams alike, data governance initiatives are a very good way to manage data more effectively for greatly improved use in business processes. Data governance should provide the means to coordinate efficient and non-redundant business processes, along with the necessary data assets, across the enterprise, between lines of business.

From data governance coordination, standards for reliable data and optimized business processes can be implemented, maintained and changed as needed. Data governance is also an enabler of acquiring important insights into both data and business processes.

In my interactions with Forrester clients, I get the sense that data governance is receiving the most senior-management-level attention today than I’ve seen throughout my 18+ year data management career.

Rob Karel, Forrester

Tangible Value

Data alone carries little value. Unusable and poorly managed data carries no value. Real cost savings obviously result when data sources are streamlined and cleaned up, when processes are more responsive to business needs.

Great value can result when business intelligence and other processes are based on the right data that can be trusted to lead to decisions that are more accurate and timely. The tangible benefits and value of data governance and data are further revealed through their connections to business processes and the desired outcomes from those processes that connect to corporate strategies and goals.

About the author: Julie Hunt is a software industry strategist and analyst, providing market and competitive insights. Her 25+ years as a software professional range from the very technical side to customer-centric work in solutions consulting, sales and marketing. Julie shares her take on the software industry via her blog Highly Competitive and on Twitter: @juliebhunt. For more information: Julie Hunt Consulting – Strategic Product & Market Intelligence Services.

The Master Data Management Track of this conference will be the best we’ve ever had.  There’s been a separate MDM track for five years, since I joined the Education Committee of the Oracle Applications Users Group in 2006.

This year’s COLLABORATE conference will be held in Las Vegas, Nevada at the Mandalay Bay Convention Center on April 22-26, 2012.

We’re looking for papers from new people and returning speakers, on topics like Customer MDM and Product MDM, as well as other domains of MDM. Multidomain MDM – the ability to manage many different domains of data within one MDM hub – would be a great topic.  Data governance is another hot topic that people definitely want to hear about.  Here are the sub-categories that you can use within the MDM Track:

• Best Practices
• Data Quality
• Data Governance
• External Content
• MDM Hubs
• Organizational Change

We’d like a good mix of presentations from end users and consultants. This year, we want more case studies, more real world presentations, and more examples from different industries.

To respond to the MDM Track Call for Papers before the October 14th deadline, just click here.

VERY IMPORTANT: be sure to indicate the “Master Data Management (MDM)” track (and only that track) in your entry so it doesn’t get lost in the shuffle. When we “build the room”, it’s hard to find your submission if it’s got 4 other tracks added on to it. So just stick with the MDM track, please.

If your paper is selected, you’ll get a free conference registration.

Don’t forget – click here to submit your paper before the October 14th deadline! 

Recapping our series so far:

• Why Govern Master Data?
• Getting Started with Data Governance, Part 1
• Getting Started with Data Governance, Part 2
• Organizing Data Governance for Success

We’ve served almost 30 clients on three continents (North America, Europe and Africa), in industries such as financial services, insurance, telecommunications, software, high tech, information services, payroll, life sciences, health insurance, and medical devices.

Although we’ve had our ups and downs, we’ve managed to grow even during the toughest economic times of the past eighty years. Over the last four quarters, revenue has grown an average of 100% per quarter. It hasn’t hurt that the master data management (MDM) space has been doing well even in the teeth of the turbulent economy.

We currently have two distinct practices:

Our Consulting & Systems Integration practice focuses on developing and delivering high value MDM and data governance strategies. We focus on:

• Education
• Readiness Assessment
• Strategic Roadmap Development
• Preliminary Software Selection
• Business Case Creation
• Data Governance Formation

Our unique approach allows clients to develop their MDM strategy and create their data governance organization in parallel.

Our Thought Leadership practice develops high quality content to help MDM software vendors reach their target audiences:

• Objective, well researched white papers
• Thought provoking, high attendance webinars
• Guest articles on other organizations’ blogs
• Keynotes at conferences and dinners
• Engagement through social media
• Distributing content through our specialized network

I’m still a volunteer on the Education Committee of the Oracle Application Users Group, which is a robust users group that is completely independent of Oracle Corporation. I’ve been involved in the group as a whole for over 15 years now, and have been on the Education Committee for more than five years.

The Call for Papers for the 2012 COLLABORATE conference is open, and I am starting to plan the MDM track of the conference.

We are going to make this conference – to be held in Las Vegas, Nevada, USA at the Mandalay Bay Convention Center on April 22-26, 2012 – our best ever. We are looking for papers on Customer Master Data Management (MDM) and Product MDM, as well as other domains of MDM as well. Multidomain MDM – the ability to manage several different domains of data within one MDM hub – is a popular topic, as is anything to do with data governance.

We’re looking for real world success stories, with presentations from end users at deploying companies as well as from consultants who have been part of MDM and data governance projects.

Last year, we had 32 different MDM track presentations, with titles such as:

• Managing Global Customer Data Using Oracle Data Quality Management and Party Merge – One Year Later, by Mike Foxcroft and Nick Soh
• MDM Case Study: Making Information Management the Foundation of the Future, by William McKnight
• The Strategic Nature of MDM, by David Butler of Oracle
• MDM Best Practices and Implementation Approaches, by Mani Kumar Manda
• Oracle MDM Strategy and Roadmap, by Manoj Tahiliani of Oracle

But this year, we want to go above and beyond last year. We want bigger and better case studies, more real world / end user presentations, different examples from different industries. Share what you’ve learned with your fellow practitioners in the MDM Community.

To respond to the MDM Track Call for Papers before the October 14th deadline, just click here. Be sure to indicate the MDM Track in your entry so it doesn’t get lost in the shuffle. If your paper is selected, you’ll get a free conference registration.

Don’t forget – click here to submit your paper before the October 14th deadline! 

In recent months, the “gamification” of business applications has become a hot topic. Gamification seeks to incorporate game mechanics into software applications for, say, CRM and ERP. The goal is not to literally make MDM a game but to instead apply game mechanics to MDM and data quality.

Gamifying MDM fosters participation in managing data quality in business applications. People love playing computer games. Few would say the same about entering data or taking care of data quality in CRM and ERP systems.

Online discussions, blogs, webinars, conferences and articles regularly discuss how to get people excited about data quality. Gamfication may be just the cure for curating data on customers, products and parts, suppliers and employees.

Gamification is all about software and data adoption. Naturally, if we are using enterprise software, we’re using the data. If we’re using data, it must reflect reality and so offer value. People like to use applications with high quality data. Someone said “Data quality is about data use. If data is not used, it won’t be any good.” If so, then gamification of MDM is a no-brainer.

Three ways to gamify MDM are

1. embed gamified MDM gadgets in software
2. gamify software functions
3. gamify MDM software itself

With the recent movement towards making applications “MDM-aware,” gamification may be a good way to embed MDM functionality into other enterprise applications.

Here’s how Software Advice envisions an embedded MDM-type dashboard in an SFA application:

An MDM dashboard in a CRM application can show the number of duplicates and data completeness by user and even award points based on quality levels. Applying game mechanics can provide real-time data quality levels, show data quality progress and even make managing data more fun.

Directly gamifying business and MDM application functionality are two other ways to accomplish key MDM objectives. A variety of game mechanics are applicable to MDM and data quality.

Achievement levels, points and leaderboards are types of gamification mechanics that can help drive data quality in software. Points can be awarded to users of applications where they can view their rankings and data quality achievement level.

While MDM dashboards employ some game dynamics, operational components of MDM software can also benefit from them.

Multiple-player game dynamics can be used to collaborate on data quality and foster a culture of community data stewardship.

Some are questioning the hullabaloo over gamifying enterprise applications. After all, computer games have been around for a while. Any pinball wizard from the 1970’s can testify that “incentivizing” is not particularly new and innovative. But the application of gamification goals, specifically to engage users of business applications in data quality, is new and promising.

Fear that gamifying software will create a distraction is unwarranted if the game mechanics are well-designed. The goal of MDM gamifcation is to ease, not hinder, participation in attending to data quality.

Gamifying MDM involves understanding what motivates software and data users and mapping those motivations to the game mechanic. MDM gamification can engage software users in initial data capture and ongoing data enrichment, data monitoring and data management.

Peter Perera is the Founder of The Perera Group, a CRM and MDM consulting firm working with organizations to increase customer data usability and value and to profitably boost revenue generating performance.

I’ve been asked this question many times: why is implementing an MDM solution so difficult? The short answer is MDM includes technical and business challenges, and encompasses a set of disciplines that are pervasive to the organization. But in this article, I’d like to focus on one particular aspect: establishing a system of record (SOR).

Let’s first take a look at a typical IT infrastructure in a large organization. Figure 1 depicts a simplified scenario.

Figure 1 – Typical IT infrastructure in a large organization

The main points I’d like to make here are:

• Each line of business (LOB) has its own data source, which includes transactional and non-transactional (i.e. master data) information.
• The separate data systems typically lead to disparate and fragmented information.
• The need for data sharing soon arises, and organizations start to integrate information either directly (database links, direct data access, and so on) or via an Enterprise Service Bus (ESB) and underlying Service Oriented Architecture (SOA).

I’m sure you noticed my diagram is really simplified. As you probably have experienced in your organization, this becomes a big mess as companies grow and data systems increase in size and complexity.

Also, SOA services typically grow slowly and unevenly. At some point, either IT and/or business realizes the underlying architecture is unsustainable, and decides to implement an MDM hub to avoid data disparity, duplication and fragmentation and improve data quality, data integration, and data distribution.

Figure 2 depicts one of the many ways data can be integrated into an MDM hub. I won’t get into the merits of which use case of MDM is being implemented, such as Analytical, Operational or Enterprise. As I said previously, I want to stay focused on one particular aspect, the System of Record.

Figure 2 – Data migration into a Master Data hub

Now that master data is in a single place, the many application systems in each LOB can be leveraged to use the hub as the “single source of truth,” as depicted in Figure 3. Needless to say, this is one of many possible configurations.

Figure 3 – A possible MDM hub configuration

Unsurprisingly, the above looks simpler than it really is. Let’s talk about some of the challenges.

The data migration effort offers plenty of technical challenges. A data migration project is typically done in phases. Not all systems are migrated at once, and sometimes, even a single system is not migrated entirely in a single phase. Your data hub becomes another data source, and worse, must be kept in sync with the sources still in operation.

But in addition to all technical challenges, we have the business challenge. What data source is the System of Record (SOR)? During the migration itself, that question is important, because if you have disparate information across the many sources being migrated, which one trumps the others?

Each LOB will say their data is better, and will want their information to prevail. That’s when a data governance office is important, and will help solve the many conflicts that are bound to happen.

And a single source is not necessarily the SOR for all data being converted, which increases the challenge.

Even if a SOR is clearly established during data migration, timing may be an issue as well. At some point, you obviously want to make the MDM hub the System of Record. But how do you manage the intermediate phases? An intermediate state may include many sources still operational, and in need of a live interface to maintain data consistency.

Remember, not everything is migrated at once. That’s clearly a challenge that can get quite complex, especially if the interface is bi-directional.

Once migration is completed, rewriting all your existing systems to use the hub can be expensive and unfeasible, especially if you use COTS products. Custom interfaces are sometimes unavoidable.

Here are some tips to remember:

• Start a data governance program early. You don’t need an MDM initiative to have a data governance body. The earlier you start the cooperation between the many LOB’s, the easier it will be to integrate their data later, and establish which system is the SOR at any given moment.
• The above is also true for data quality. Data quality is just one of many MDM disciplines, but can and should exist even if you’re not doing a full MDM yet. The cleaner your existing data sources are, the easier it will be to integrate them later into a single hub. Plus, data with higher quality facilitates the determination of which source is more appropriate to be the SOR.
• Once integration starts, clearly establish which system is the SOR for a given entity and/or set of information. This definition is critical to avoid confusion and facilitate entity resolution. As data is migrated, clearly define when the SOR transition will occur.
• Data maintenance should be done on the SOR only. Avoid bi-directional interfaces. Synchronizing information that is modified in multiple places is a nightmare, and should be eliminated if possible.
• IT and business must work closely together. Establishing a SOR is a combination of technical feasibility along with properly supporting all business processes. Rarely will one side be able to define the SOR without consulting the other side.

An MDM program requires a lot of planning and coordination, and it is not a single project. It is an ongoing program that needs constant collaboration between the many LOBs and IT. Having a clearly established SOR for every single attribute, at all times, will certainly minimize issues.

Dalton Cervo is a Senior Solutions Consultant at DataFlux, helping organizations in the areas of data quality, data integration, and MDM. Prior to DataFlux, Dalton served as the Data Quality Lead for the customer data domain throughout the planning and implementation of Sun Microsystem’s enterprise customer data hub. 

Combining Forces to Better Answer Business Needs

Data governance can be seen as formalized policies, practices and processes set up to manage voluminous data assets across enterprises. Data governance also sits on an important growing convergence that encompasses multiple, and frequently separate, disciplines: data quality, data integration, master data management (MDM), business process management (BPM), business intelligence (BI) and analytics.

The solutions surrounding the management of information, data and intelligence are emerging from artificial silos to acknowledge the greater overlap and interrelationships of these technologies and practices. Deliberate initiatives to tighten up the convergence of these solutions will not only improve the better overall functioning of all of these solutions, but they’ll help both IT and business users see how it all works together.

A greatly beneficial result should be the elimination of duplicate demands on business users and IT for implementing and managing these systems.

Forrester’s Rob Karel had this to say on aligning Business Process and Data Governance initiatives:

Data governance is not – and should never have been – about the data.

High-quality and trustworthy data sitting in some repository somewhere does not in fact increase revenue, reduce risk, improve operational efficiencies, or strategically differentiate any organization from its competitors. It’s only when this trusted data can be delivered and consumed within the most critical business processes and decisions that run your business that these business outcomes can become reality.

So what is data governance all about? It’s all about business process, of course.

Let’s add this note to Karel’s assessment: business process is about optimizing the Business.

The current state of the increasing relationships between Data Governance, MDM, BPM, BI / Analytics (as well as DQ and DI) is also the story of the teaming up of business users and IT as collaborative partners in doing the work that help businesses meet strategic goals, bring value to customers, and add to competitiveness.

Both sides of the story must start with the business problems and the jobs to be done, plus the desired outcomes and benefits. Then decisions must be made regarding the role to be played by the software solutions to be implemented. Starting with the business also encourages the exploration and creation of the specific business cases that reflect needs and requirements. With those business cases defined, monitoring outcomes of data governance, BPM, BI, etc., should have a clear basis.

While business processes are a major focus for strategies around data governance, BI and BPM, data still retains a significant role as a strategic asset that enterprises can use to differentiate themselves. These two entities (process and data) must be accorded respect when developing interrelated approaches that incorporate all of these solutions. Just as these solutions are best when in synch with one another, so must the enterprise itself work with these solutions across departments and diverse teams. For business and intelligence processes to yield useful, timely and accurate results, the underlying data must be trustworthy.

Knocking down the Silos

Data, information and content saturate most enterprises, so business users must become much more directly involved in creating and managing the overall solution for handling these vital resources. Business people usually hold the key to the context for data and processes, as well as future ways of using the data.

The integrated components of MDM / data governance, BI / analytics, and BPM need to deliver real results to business users but are also highly dependent on the participation of business users to incorporate reality and provide on-target solutions.

True collaboration between business and IT teams starts with requirements, results, procedures, and then leads to collaborative work on joint projects. Such collaboration fosters reuse, reduces duplication of effort and processes, and builds a network of trust between business and IT staff that is aligned with how systems really need to support key business objectives, initiatives and future strategic direction.

Commonality also crosses the business drivers for data governance, MDM, BI, and BPM where key benefit areas consist of growing revenue, cost efficiency, different levels of agility, and compliance. Efforts should provide improvements for:

• Faster, more accurate decision-making, including real-time intelligence
• Identifying and engendering new markets, new products, new customers
• Enhancing and supporting customer relationships and customer service
• Operational procedures
• Customer cross-selling / up-selling
• Ease of compliance, audits, and risk management

Rajan Chandras said in Data Gaps Plague Process Initiatives:

The genesis of these types of initiatives is often very different. BPM is undertaken when organizations find themselves beset with process shortcomings, and with the primary purpose of better understanding, improving and integrating business processes. Data governance initiatives, on the other hand, are usually justified by shortcomings in data quality, consistency and integrity.

Then, data governance is often closely intertwined with master data management, and thus organized alongside important “master” business data entities — customer, product, organization and such.

That said, Rob Karel, Forrester analyst and lead author of the report, suggests that IT must learn how to better educate and evangelize data issues in a language and a context that matters to the business — a responsibility that Karel puts squarely on IT, “because IT often has a more cross-enterprise view than siloed business units and functions.”

For data governance and process governance efforts to be successful, they both (business and IT) must frame their priorities and business value in the context of which business processes they are aiming to improve, transform and optimize, says Karel.

From Forrester study, September 2010

Source:http://alteryx.com/How-Alteryx-Performs/Pages/White-Papers/Forrester-Report-on-BI-Platform-Requirements.aspx

Intelligence, People and Process

Master data management (MDM) is a good reflection of how an enterprise uses data, information – and content – for business purposes. The creation and management of master data touches more than the information itself. By creating data repositories and processes that reflect business functions, an enterprise should develop access to the information that is so crucial to effectively and efficiently achieving its business goals. It’s extremely important to analyze, manage and provide access to all forms of information – structured and semi-structured data, as well as “unstructured” content.

For BI and analytics solutions to provide real intelligence, they must be based on accurate and timely data. BI outputs are based on data aggregations, until recently, from structured data in data warehouses, with delivery in the form of reports or dashboards to enterprise users. Analytics add the dimension of mathematics and formulas, with variants addressing forecasting and prediction.

Neil Raden responds to the ebizQ question: How does master data management change BI?:

…to describe how organizations collect data as part of a process, but manage to make it infinitely more valuable by using it for other purposes.

What does this have to do with BI and MDM? In our research, we have found that most knowledge workers shun BI for two reasons (not performance or ease-of-use): relevance and understanding. MDM adds nothing to address these concerns because its representational framework, a relational schema, is inadequate. It’s a representation of a model. An ontology is a model. Until MDM rejects the relational model as its underlying schema, it will be unable to add the rich meaning, relationships and even reasoning that an ontology can do.

So, the point is, if you’re going to go to the massive effort and expense of an MDM solution, take some advice from 21 years ago… Make the data useful for people, not just governors and black belts.

One newer area of interest for BI and analytic solutions is the inclusion of collaborative activities to add contextual and qualitative layers to the output of BI processes. To achieve authentic intelligence, contextual / qualitative layers can provide a strong basis to test, fine tune and filter the artifacts of analytics.

Analytics can benefit greatly from human filters that bring experience, knowledge and creative thinking. Context has a big role here: context for sources, context for outcomes, context for usage with other data points, to achieve the optimal intelligence for “making better business decisions”.

The possibilities for new applications of analytics increase with collaboration. Inviting in many-to-many interactions also opens up processes to new ideas from participants. Gartner found that social venues and collaboration help to track and capture outcomes of the decisions made based on BI / analytics:

Gartner’s user surveys show that improved decision making is the key driver of BI purchases. However, most BI deployments emphasize information delivery and analysis to support fact-based decision making, but fail to link BI content with the decision itself, the decision outcome, or with the related collaboration and other decision inputs. This makes it impossible to capture decision-making best practices. Solutions are emerging that tie BI with social software and collaborative tools for higher-quality, more transparent decisions that will increase the value derived from BI applications.

With convergence, employees in the enterprise should operate more effectively, where improved data governance/MDM lead to better BI, where collaborative processes also enhance and validate BI, where a collaboration setting for BPM works to deliver more of the information that the enterprise needs.

A possible approach to marrying collaboration, data and intelligence to business processes, and, more importantly, to the way people work, can be seen in Tibco’s re-working of tibbr. Dennis Howlett provides this description of tibbr:

It intelligently marries people, process and context, delivering information the way people want to consume

Tibco connects tibbr to business processes and event-triggering that are then exposed in tibbr for taking action. While tibbr is built more for real-time information streams than archives of content and information, tibbr and Tibco have created a platform with a lot of potential for improving overall information findability that adheres to context and worker roles.

It connects to process, people/workers, collaboration venues, data and information streams, centralizing all event streams into one dashboard. Information can be organized by subject or topic, rather than by people. tibbr enables users to create, contribute to, and subscribe to the real-time event streams that matter most to them.

Convergence Clarifies Benefits and Value

In a recent Gartner report covering predictions for data integration and MDM:

Through 2015, 66% of organizations that initiate an MDM program will struggle to demonstrate the business value of it.

It’s probably not a stretch to extend this “struggle for value” to BPM and BI / analytics. But through the convergence of MDM with BI / analytics and BPM, an analyst like Sandy Kemsley sees increased business value, in this Loraine Lawson interview:

Lawson: It’s become more important with MDM to identify pain points and a real business case. Yet MDM is still pretty IT-centered. Does connecting it to business process management (BPM) allow it to be more business-focused as a project?

Kemsley: Absolutely – connecting it to BPM, and also connecting it to business intelligence and analytics, because that’s one of the things that many business users are interacting directly with (analytics), whether it’s just simple reporting or dashboards or a more complex drill-down. You can get better analytics if you have consistent data models and those consistent data models are going to be helped by MDM, that’s one of the key business benefits. When you want to have a report that gathers data from a number of different systems, it’s not going to be some huge, big, long project because somebody has to figure out what data maps onto what other data. It’s going to be a much more straightforward thing because while the data may not all be in one place, at least it will be in a consistent format so that you can easily bring it together.

Individually these solutions can achieve some value and success for an enterprise, but at the cost of much duplicated effort and resources.

In convergence, with initiatives for business improvement and better decision-making, an integration of BI/analytics, BPM, data governance and MDM has definite synergistic outcomes that can greatly increase business value and reduce wasted effort.

Integrating business insights into process execution will significantly improve the quality of decisions and lead to continuous process optimization. And process events kicking off BI and analytics for real-time decision-making increases beneficial outcomes.

All of these solutions should be about solving frequently complex business problems and supporting the work to be done in the enterprise. Each solution brings a significant piece of the “big picture”: better decisions for the business with reliable data feeding both intelligence and process. Ultimately the biggest payoff is how this convergence feeds directly into business agility and continuous change to constantly fine tune sustainable competitiveness.

About the author: Julie Hunt is an accomplished software industry analyst, providing strategic market and competitive insights. Her 20+ years as a software professional range from the technical side to customer-centric work in solutions consulting, sales and marketing. Julie shares her take on the software industry via her blog Highly Competitive and on Twitter: @juliebhunt. For more information: Julie Hunt Consulting – Strategic Product & Market Intelligence Services.

The golden records in the hub are formed from the master data records typically describing the customers, suppliers, products and locations in the transactions made in the enterprise application stack. In the master data hub, we emphasize consolidating, and eventually also splitting, the master data (to be) from different contexts into golden records being as close to the real world as needed in the enterprise as a whole.

As in common database theory, we also need relations between the golden records and we may, staying in the metallic tune, call them golden relations.

Golden Relations in the Party Domain

In understanding our customers, suppliers and other party roles, we build hierarchies of the golden records in the golden copy. Typical hierarchies include:

• Consumers belonging to a household
• Company family trees, often derived from external reference data
• Contacts within the companies which are our customers and suppliers

My guess is that we’ll start seeing more advanced relationship tracking in this domain in the near future. An example would be social network-based tracking of contacts changing jobs between parties who are our customers, prospects and suppliers.

Golden Relations in the Product Domain

Hierarchy building in the product domain is much more diverse between industries and in a single organization than hierarchy building is in the party domain.

Therefore, flexible structures are needed within a golden copy or master data hub used for Product Information Management (PIM).

Our ability to handle more products in our databases and the trend towards globalization making more products available will only increase the demand for handling the golden relations between the golden product master records.

Golden Relations in the Place Domain

I like to name the domain of locations as the “place” domain, because then we have a “P” trinity of Parties, Products and Places.

Hierarchies come naturally with places, as they form a geographical hierarchy of the type we like to use, typically being country, state, postal code / city, street name / block, building number and unit depending on where on the earth our place is situated.

The trend of governments around the world making public sector data more open helps a lot in getting the structures of the place master data aligned with the real world.

Golden Relations in Multi-Domain MDM

A multidomain master data hub embracing the “P” trinity of parties, products and places will have some important golden relations between the golden records within each domain like:

• The exact place where a unique party such as a consumer lives. This also helps with forming the right households.
• The exact place of a certain part of a product, being a locality for example in hospitality and travel – and the exact places of the nearby attractions.
• The sales figure in a defined period for products belonging to a given category sold to parties being companies in a given line-of-business.

Most interesting business problems require more than one domain of data for their solution.

Platinum Relations

Master data may be born in the hub or may be born outside the hub and then transformed into the hub, thus becoming the golden copy.

Transforming already existing records representing parties in the prospect and customer role into the hub is still the most common direction today. Therefore that discipline is still often called Customer Data Integration (CDI).

In this process, it is highly recommended not to purge the records and relations that already exist when we merge data into golden records. You should keep the incoming records with a platinum relation to the new golden record as it sometimes happens that you have to rollback.

Mass import and transformation of data also happens in the product domain, for example at retailers. Also here it’s recommended to keep the original data and make platinum relations.

In some places, I’ve come across a case of “keeping up appearances”, called vanity addressing. Here your customer insists on using a somewhat incorrect address that “sounds better”, such as “Beverly Hills” instead of “Los Angeles”. For that reason too, it’s recommended to keep the vanity address and a platinum relation to the real world place.

This article was written by Henrik Liliendahl Sørensen, a well known blogger whom we hope will be a frequent guest author here. You can find his blog, “Liliendahl on Data Quality” at http://liliendahl.wordpress.com.

Why is this stuff so hard?

Companies aren’t used to governing data across the entire enterprise. It goes against their well honed instincts, to break things up into smaller units or silos to make them more manageable. Where they do have data governance in place, it’s usually done at an application or business unit level.

And it can be tough to show ROI for data governance.

But companies with effective governance processes in place generate up to 40% higher ROI on their IT investments than their competitors, according to Peter Weill and Jeanne Ross in “IT Governance: How Top Performers Manage IT Decision Rights for Superior Results” (Boston: Harvard Business School Press, 2004).

The bottom line is that managing things, when you have control over them yourself, is hard enough. Governing them, when you have to consult with others, gradually win them over, and lobby for things that matter deeply to you, is hard work!

How to get started

First, it’s important to avoid “analysis paralysis”. Since many organizations don’t know where to start, they do nothing at all.

Analyzing your current state and desired future state, using a maturity model as we discussed in the previous article, provides a framework for planning your activities and managing your expectations, enabling you to proceed.

Start by defining with some degree of precision (1) where the company is now, (2) where the company wants to be, and (3) over what period of time.

Then look at the critical elements such as MDM, data integration, data quality, data enrichment, data governance, business process management, BI, enterprise content management, and information lifecycle management over time. This should lead to a realistic plan and design. For more information on how to create a strategic roadmap, see James Parnitzke’s article on that topic.

Click to enlarge

Spend time on the design before launching

Don’t let yourself be rushed into getting organized too soon. Setting up a Data Governance Council too early is a classic failure mechanism!

Spend time on things like developing the data governance program’s overall vision and strategy, and its value statement – its reason for existing. Your stakeholders will want to know the answers to some basic questions like “where will the program live, and how will it be funded?”

Once you have the basics outlined, you can move on to the more detailed elements of the design. Who will be involved? How will the program be organized? Will it be centralized or de-centralized? Why are we doing this? What will the DG program do for the enterprise?

Before you launch a formal governance council, you need to have positioned the initiative to a key executive sponsor. Without them, the council will be just another meeting. Another point to keep in mind is that a global council can work cooperatively with local groups. Some companies think the global group is going to wind up being too big because it has to centrally govern all aspects of Customer, for example, instead of defining the 10 critical attributes across business processes and simply starting there.

Whatever you decide on these questions, working from a solid design is a lot easier than making it up as you go along.

When to start establishing Data Governance

Ideally, you would start about six months before starting any MDM initiative, so that your new DG group would have a chance to form itself, and then help drive the MDM initiative.

But don’t start before you’ve got your executive sponsorship and funding lined up. You’ll just end up with a failed data governance effort to explain away later. It’s better to wait until everything is lined up than start before you’re ready.

Then get ready for the ride of your life – corporate politics, new technology, organizational change, marketing communications, project management, you name it!

Using a Data Governance Maturity Model

Something that Hub Designs recommends early in a new Data Governance program is using a Data Governance Maturity Model to realistically assess how you currently govern data at the enterprise-wide level. This is helpful so that you’ll know where you’re starting from where the four dimensions of People, Process, Technology and Information are concerned, before embarking on your initiative.

Most Data Governance Maturity Models are based on the Software Engineering Institute’s Capability Maturity Model (CMM) for software development.

A Data Governance Maturity Model states what should occur at each level, not how to accomplish the activities. There are many different DG maturity models, but they share some common characteristics: they usually have 5 levels, and they’re just a tool to assess where you’re starting from, not something to get hung up on or on which to spend a lot of time.

The National Association of State CIOs (NASCIO) did a great study of the different Data Governance Maturity Models available from organizations such as IBM Data Governance Council, DataFlux, EWSolutions, Gartner, Knowledge Logistics, the MDM Institute, and Oracle Corporation, concluding that “data governance maturity models can be used as references in communication, awareness building, and the marketing of data governance”.

Where are most organizations today?

The important thing is to be realistic about where you’re starting from – most companies are starting at 0 or 1.

A lot of companies are doing governance, just not formally. People are managing data, they just need to figure out who’s doing it, and what and how they’re doing. Then group them and provide some central guidance to get them started.

Here are three things to think about:

• A recent survey of over 100 organizations found that only 10% have been able to move their DG programs beyond the lowest two levels of maturity. IT is still accountable for the data in 63% of organizations. Only 27% have established a data governance council with business representation and formal data stewardship. And 57% of organizations do not measure the performance of data management activities at all.
• Most companies with which Hub Designs has worked have not been successful making the types of organizational, cultural, process and technological changes necessary solely with internal resources.
• Most of the companies with which we’ve worked have a “research & analysis” period of up to two years under their belts before they start making serious progress on their MDM and governance programs.

The reality is that with cross-functional, multi-year programs such as MDM and data governance which involve multiple organizational, process, technology and information disciplines, it’s better to proceed deliberately and have a series of incremental “wins” that show business value, rather than go for a rapid implementation or a “big bang” approach.

Progress in this area is not linear – you make investments, you build competency, you do the hard work (and sometimes even get frustrated), and then by doing a relatively small amount of remaining work, you start to achieve your goals.

Like a baby learning to talk, or an adult learning a foreign language, there’s a steep learning curve that flattens out rapidly at the top. Companies will seem not to make progress for a long time (while they’re making the investment in growing their data governance capability), and then their abilities will come together rapidly, as people get a chance to put their new skills to work in a new Data Governance Organization.

The most important thing about data governance is to “start from where you are”. Most companies are just getting started on their data governance journey. It can be hard to admit that your company is at data governance maturity level 0 or 1. But the most critical step is the first one – getting started.

We live in interesting times. Poor information security practices led to the release of a huge number of secret diplomatic cables to WikiLeaks. The Federal Aviation Administration admitted that registration information for as many as one-third of all private aircraft is out-of-date and inaccurate, forcing the FAA to cancel and re-register all civil aircraft.

And the private sector isn’t immune. TUI Travel, Europe’s largest tour operator, accepted the resignation of its CFO after restating its 2009 results to the tune of $191.8 million, blaming problems in integrating computer systems following a 2007 merger.

Sound familiar? Hopefully, your company doesn’t have any data governance “skeletons in the closet” like these. But if you hunt around a bit, you’ll undoubtedly find people in your business who’ll tell you about:

• decisions that were made based on reports with wrong or missing information,
• the real costs of duplicate data in your customer master database,
• cash flow being impacted because invoices were being sent to the wrong addresses,
• supplier master issues causing millions in avoidable costs in lost volume discounts
• the penalties for not complying with industry and government regulations on customer data and privacy,
• failure to comply with tax laws because of inaccurate billing information,
• information-heavy projects that run over time, or require length rework after go-live,
• decommissioning systems is nearly impossible because clear retention and destruction policies have not been defined,
• manual correction and alignment of content and documents takes time away from resources because these items aren’t singularly governed,
• IT staff spending a lot of time re-integrating data and dealing with data fire-drills because data service level agreements and fit-for-use levels have not been established and tracked.

If you talk to business owners across functional areas like R&D, Marketing & Sales, Finance, Operations, Human Resources, and Customer Service, you’ll fill up a small notebook with the stories about what not having a data governance organization in place is costing your company.

What exactly is “master data”?

Good question. Master data is the lifeblood of your company. It’s information that’s critical to the enterprise, including entities such as customers, products, employees, suppliers, and locations. It’s shared (or it should be) across applications, systems and databases, and across multiple business processes, functional areas, organizations, geographies and channels. It’s generally not anything that happens at a particular time, but instead a person, place or thing that changes slowly over time. Master data is not transactional, but it’s used by and linked to transactions.

And what is “data governance”?

Master data needs to be governed as you would any other critical asset in the enterprise – with diligence, formal processes and metrics. I’ve often said that if companies treated their cash and their inventory the way they treat their customer and product data, a lot of people in corporate America would be going to jail.

Jill Dyché, in Ten Mistakes to Avoid when Launching Your Data Governance Program, defined data governance as “the decision rights and policymaking for corporate data”.

Whenever you see the word “decision rights” and “policymaking” next to the words “corporate data”, you know that you’re dealing with an area that is more political than technological. But technology can be an enabler.

One of my favorite quotes is by Dean Kamen, the inventor and entrepreneur:

The technology is the easy part. Understanding what drives people – individuals, societies, what makes cultures clash – all of those questions are way, way harder to answer than how to solve any particular technical problem.

Simplifying today’s enterprise architectures

Today, most companies larger than $500 million – $1 billion in revenue:

• have grown through merger & acquisition activity,
• have a mixture of front office and back office suites and “best of breed” applications
• have some acquisitions and applications that are integrated and some that aren’t
• have created shadow IT organizations in individual Lines of Business in an effort to speed up results
• have created more complex processes for dealing with data issues, causing individual groups to creatively work around the processes
• have more diverse groups of workers with diverse experience (and preferences) for enabling software tools, like Excel

As a result, most companies suffer from significant data silos and data fragmentation – what I call the “Islands of Data” problem.

These data silos increase costs, hurt business and IT agility, and result in bad decisions being made throughout the enterprise (because of low quality, inaccurate, inconsistent data).

Master Data Management can solve the “Islands of Data” problem

Master Data Management (MDM) technology brings master data together in an MDM hub. In addition to the MDM hub itself, you’ll usually need:

• Data Integration (usually using Service-Oriented Architecture)
• Data Profiling and Data Quality
• Business Process and Business Rules Management
• Third Party Data Enrichment
• Technology to facilitate Data Governance

The MDM Hub centralizes master data, providing the much desired “Single Source of Truth”, streamlining business processes (which reduces costs and increases productivity and agility), and increasing revenue (through ability to support more targeted marketing and cross sell / up sell initiatives) and improving compliance.

But committing to MDM technology isn’t enough, unfortunately. Nor is it the first thing you need to figure out. In order to make the entire exercise work, we also need data governance.

So Why Do It? Why Govern Master Data?

The alternative – not governing it – is information chaos and anarchy. “A disaster of biblical proportions. Human sacrifice, dogs and cats living together… mass hysteria!” (from one of my favorite movies, Ghostbusters).

Seriously, why would we bring together master data from all over the enterprise, cleanse it, build golden records of customers, products, suppliers, etc. and not govern the decision-making process, result, and resulting analytics? That would be a value destruction exercise worthy of the Guinness Book of World Records.

Data governance is a critical success factor for master data management. MDM isn’t a “lights out operation”. Don’t try to do master data management without a data governance organization in place or under construction. You’ll wind up looking like this guy!

IT teams are already carrying heavy workloads with ever-shrinking staffing levels, and frequently don’t have the resources to immediately respond to time-sensitive LOB needs. However without IT involvement, these LOB groups do not usually have the expertise to understand the implications of creating data in the cloud and its relationship not only to data in other Software-as-a-Service (SaaS) / cloud offerings, but to on-premises systems as well. These business users need a partnership with IT to ensure that comprehensive data management processes are put into practice.

It’s clear that enterprises will continue to increase usage of cloud and SaaS offerings to find new ways to operate more competitively and efficiently. Unfortunately the rapid creation and adoption of cloud and SaaS services have led to increased data silos in the cloud. The same challenges that enterprises face for on-premises data management obviously apply to data repositories in the cloud: data quality and reliability, integration, governance, security and compliance, master data management (MDM), as well as improved data accessibility. There is now a even bigger picture for data management, where all of these domains need to be governed as an interoperating whole.

If enterprises fail to address a rigorous data management strategy for cloud computing initiatives, deterioration in data quality and reliability of cloud data are likely to kick in quickly. Data that cannot be trusted nor aligned with enterprise datasets will destroy the value and cost savings that enterprises want from cloud services. One of the most important requirements of business data generated through cloud services is security for that data. Not all data created in the cloud requires security, but most of it does. Comprehensive data management policies are needed in the cloud as well as for on-premises data repositories to ensure secure data processes.

The concerns of both business users and IT regarding data in the cloud have been articulated in many surveys including one recently completed by IDC where issues that relate directly to data governance and MDM initiatives covered security, data integration, operational costs and compliance – all pretty much to be expected when considering management strategies for cloud data. The IDC study goes on to discuss an important point that again requires IT and LOB groups working together: Business Relevance.

The next two challenges – the perceived difficulty of cloud services integration, and the limited ability to customize – are both related to the important issue of business relevance.  While customers certainly enjoy the economic and operational benefits of the off-the-shelf, standardized nature of many cloud services, this survey shows they nonetheless want greater ability to “fit” cloud services more tightly into the context of their specific business.

MDM and data governance provide clear value when they reflect the actual activities and processes of the enterprise. This approach also makes it easier for corporate decision-makers to understand the role MDM and data governance play to support strategic goals and even how they might map (at the high level) to key business processes. Malcolm Chisholm and Fabio Corzo flesh out these ideas in The True Role of MDM:

The importance of master data is not just data values or quality, but the real-life concepts they represent…

We are looking for fundamental business transformation that will take the business into new ways of perceiving, understanding and developing customers, employees, suppliers, assets and securities. We are looking for business transformation that moves in line with the business goals. And though executives understand that data is at the heart of proper and well-executed business transformation, experience tells us that more often than not, the business transformation is limited to improved data quality side effects that fail to realize the true value of an MDM program.

The above concepts become even more imperative when establishing management of data-driven business processes between the cloud and on-premises systems. There will need to be an evolution of data management and governance approaches to deal with new challenges that come from data in the cloud and from an integrated approach to managing data across disparate data domains, many of which are not owned by the enterprise.

Cloud services have been very effective in converting (or commoditizing) IT practices through well-formed repeatable processes. To accommodate proper data management for cloud and on-premises solutions, IT and business users will need to work together to build out data management solutions through practices and technologies that support the creation, use and storage of data “anywhere anytime”. Both IT and Business are important to setting the right strategies, including the crafting of a data management architecture that will kick in before an enterprise’s cloud data becomes too distributed for thorough governance. While more and more data will be owned by non-enterprise entities in the cloud, the ownership of comprehensive data management processes and practices continues to fall squarely on the enterprise through business users and IT working to ensure reliable data availability.

About the author: Julie Hunt is an accomplished software industry analyst, providing strategic market and competitive insights. Her 20+ years as a software professional range from the very technical side to customer-centric work in solutions consulting, sales and marketing.  Julie shares her takes on the software industry via her blog Highly Competitive and on Twitter: @juliebhunt. For more information: Julie Hunt Consulting – Strategic Product & Market Intelligence Services.

The topic will be how to “Drive Customer Loyalty with Effective Master Data Management”.

It costs a lot less money to hold onto existing customers than to attract new ones.  But now that your customers have more choices than ever before, you need to give them compelling reasons to stay. Unfortunately, for many organizations, poor data quality leads to an inaccurate view of the customer – decreasing service levels and damaging customer loyalty.

Oracle Master Data Management consolidates, maintains, governs and distributes complete, accurate master data across all enterprise systems. And Oracle’s Siebel Loyalty Management provides the customer insight to help you design loyalty campaigns that maximize the value of all your customer relationships. Seamlessly integrated, Oracle’s solutions offer a powerful combination of high data quality and effective loyalty management.

Register to join the live Webcast on Wednesday, August 17 at 11:00 am Pacific (2:00 pm Eastern) to hear myself (Dan Power from Hub Designs) and David Butler (Senior Director, MDM Marketing at Oracle) discuss how the combination of Oracle MDM and Siebel Loyalty Management can help you:

• Gain an accurate view of every customer with high-quality data and advanced analytics
• Improve service levels with a single, unified view of the customer across every channel
• Boost revenue by maximizing the return from upsell and cross-sell opportunities
• Reduce service costs with increased call center efficiency and productivity
• Accelerate the return on loyalty campaigns with dramatically improved targeting

Oracle has some exciting things to say about Enterprise Data Quality and Master Data Management, and I’m pleased to be doing this webinar (and the Product MDM Webinar on August 11th) with them. Register now!

The topic will be how to “Ensure World Class Data For World Class Supply Chain Management”.

When you don’t have world class data, your company suffers from inefficient processes, misjudged decisions, compromised compliance, excessive spend, and supplier exceptions. But if you have a robust Product Data Quality and MDM strategy and deliver it well, your product information rapidly becomes one of your organization’s greatest assets.

Oracle’s Product Information Management solutions offer the most comprehensive and powerful suite of applications and tools for managing product data at every stage of the extended supply chain. By eliminating common data management problems, Oracle’s market-leading solutions allow you to improve efficiency, enhance data quality, make better informed decisions and manage a world class supply chain.

Register to join the live Webcast on Thursday, August 11 at 9:30 am Pacific (12:30 pm Eastern) to hear myself (Dan Power from Hub Designs) and David Butler (Senior Director, MDM Marketing at Oracle) discuss how Oracle’s Product Information Management solutions can help you:

• Consolidate all product information with Oracle Product Hub
• Improve data accuracy, accessibility and security with Oracle Enterprise Product Data Quality
• Drive efficiency across the supply chain with world-class Product Information Management

Don’t miss this chance to learn how you could transform supply chain data quality with Oracle Product Master Data Management. Register now!

IBM sells Identity Insight to a lot of financial services and insurance customers, who use it to disrupt fraud rings and money laundering schemes, and for employee vetting purposes. IBM also has a lot of global reference customers in the public sector, including law enforcement, intelligence, and social service.

Identity Insight is well suited to finding hidden identities and relationships across large datasets, especially when combined with what IBM calls Complex Event Processing for pattern analysis.

In the Finance and Insurance market, Identity Insight is used to:

• Uncover fraud rings across multiple channels (through social network analysis)
• Prevent fraud from insider and external threats
• Improve regulatory compliance for finding and reporting suspicious activity
• Initial credentialing, continuous vetting and insider threat detection

In the Intelligence and Law Enforcement market, Identity Insight is used to:

• Match identities and relationships of persons of interest across hundreds of data sources and billions of records
• Build a global master name index
• Explore a suspect’s relationships across myriad data silos
• Recognize and respond to potential insider and collusion threats before damage occurs

In the Government Services market, Identity Insight is used to:

• Verify citizen identity for more accurate determination of eligibility for social programs
• Reduce improper payments where citizens are applying for mutually exclusive benefits
• Background check of program applicants against watch lists and other data
• Uncover relationships between citizens and other benefit recipients that would reduce benefits

Identity Insight approaches things a little differently. Other technologies approach data like it’s dirty, it’s unorganized, it’s not too smart, etc. But IBM approaches it like it’s sneaky, it’s hiding something, it’s not what it says it is. That’s a very different mindset, born of the product’s heritage in the casino and intelligence industries.

There are three distinct capabilities in the Identity Insight portfolio now: Identity Insight itself, which is the underlying analytical engine that establishes the unique identities, discovers the obvious and non-obvious relationships, and provides the real-time awareness for fraud and threat detection.

Global Name Recognition delivers the culturally-driven name analysis for individuals and businesses, so a person can be recognized regardless of which permutation of their name is presented.

And Anonymous Resolution allows for inter-agency sharing of information without compromising privacy, by anonymizing all personally identifiable information.

IBM shared some great case studies with us. A good one in the financial services industry is MoneyGram International, which to date has stopped more than $37.7 million in fraud, increased their ability to interrupt fraud by 40%, and realized 72% reduction in consumer fraud complaints in a single year.

I enjoyed this briefing very much, and was blown away by the things this IBM product can do.

And I found myself at the end of the briefing wondering if the future for MDM is to have enhanced identity resolution and analytics built into the master data management hubs of tomorrow, because even though IBM doesn’t sell them together very often today, the data stewards at most major corporations could definitely use this type of identity intelligence being built into the next generation customer MDM hubs.

In recent months, the “gamification” of business applications has become a hot topic. Gamification seeks to incorporate game mechanics into software applications for, say, CRM and ERP. The goal is not to literally make MDM a game but to instead apply game mechanics to MDM and data quality.

Gamifying MDM fosters participation in managing data quality in business applications. People love playing computer games. Few would say the same about entering data or taking care of data quality in CRM and ERP systems.

Online discussions, blogs, webinars, conferences and articles regularly discuss how to get people excited about data quality. Gamfication may be just the cure for curating data on customers, products and parts, suppliers and employees.

Gamification is all about software and data adoption. Naturally, if we are using enterprise software, we’re using the data. If we’re using data, it must reflect reality and so offer value. People like to use applications with high quality data. Someone said “Data quality is about data use. If data is not used, it won’t be any good.” If so, then gamification of MDM is a no-brainer.

Three ways to gamify MDM are

1. embed gamified MDM gadgets in software
2. gamify software functions
3. gamify MDM software itself

With the recent movement towards making applications “MDM-aware,” gamification may be a good way to embed MDM functionality into other enterprise applications.

Here’s how Software Advice envisions an embedded MDM-type dashboard in an SFA application:

An MDM dashboard in a CRM application can show the number of duplicates and data completeness by user and even award points based on quality levels. Applying game mechanics can provide real-time data quality levels, show data quality progress and even make managing data more fun.

Directly gamifying business and MDM application functionality are two other ways to accomplish key MDM objectives. A variety of game mechanics are applicable to MDM and data quality.

Achievement levels, points and leaderboards are types of gamification mechanics that can help drive data quality in software. Points can be awarded to users of applications where they can view their rankings and data quality achievement level.

While MDM dashboards employ some game dynamics, operational components of MDM software can also benefit from them.

Multiple-player game dynamics can be used to collaborate on data quality and foster a culture of community data stewardship.

Some are questioning the hullabaloo over gamifying enterprise applications. After all, computer games have been around for a while. Any pinball wizard from the 1970’s can testify that “incentivizing” is not particularly new and innovative. But the application of gamification goals, specifically to engage users of business applications in data quality, is new and promising.

Fear that gamifying software will create a distraction is unwarranted if the game mechanics are well-designed. The goal of MDM gamifcation is to ease, not hinder, participation in attending to data quality.

Gamifying MDM involves understanding what motivates software and data users and mapping those motivations to the game mechanic. MDM gamification can engage software users in initial data capture and ongoing data enrichment, data monitoring and data management.

Peter Perera is the Founder of The Perera Group, a CRM and MDM consulting firm working with organizations to increase customer data usability and value and to profitably boost revenue generating performance.

I’ve been asked this question many times: why is implementing an MDM solution so difficult? The short answer is MDM includes technical and business challenges, and encompasses a set of disciplines that are pervasive to the organization. But in this article, I’d like to focus on one particular aspect: establishing a system of record (SOR).

Let’s first take a look at a typical IT infrastructure in a large organization. Figure 1 depicts a simplified scenario.

Figure 1 – Typical IT infrastructure in a large organization

The main points I’d like to make here are:

• Each line of business (LOB) has its own data source, which includes transactional and non-transactional (i.e. master data) information.
• The separate data systems typically lead to disparate and fragmented information.
• The need for data sharing soon arises, and organizations start to integrate information either directly (database links, direct data access, and so on) or via an Enterprise Service Bus (ESB) and underlying Service Oriented Architecture (SOA).

I’m sure you noticed my diagram is really simplified. As you probably have experienced in your organization, this becomes a big mess as companies grow and data systems increase in size and complexity.

Also, SOA services typically grow slowly and unevenly. At some point, either IT and/or business realizes the underlying architecture is unsustainable, and decides to implement an MDM hub to avoid data disparity, duplication and fragmentation and improve data quality, data integration, and data distribution.

Figure 2 depicts one of the many ways data can be integrated into an MDM hub. I won’t get into the merits of which use case of MDM is being implemented, such as Analytical, Operational or Enterprise. As I said previously, I want to stay focused on one particular aspect, the System of Record.

Figure 2 – Data migration into a Master Data hub

Now that master data is in a single place, the many application systems in each LOB can be leveraged to use the hub as the “single source of truth,” as depicted in Figure 3. Needless to say, this is one of many possible configurations.

Figure 3 – A possible MDM hub configuration

Unsurprisingly, the above looks simpler than it really is. Let’s talk about some of the challenges.

The data migration effort offers plenty of technical challenges. A data migration project is typically done in phases. Not all systems are migrated at once, and sometimes, even a single system is not migrated entirely in a single phase. Your data hub becomes another data source, and worse, must be kept in sync with the sources still in operation.

But in addition to all technical challenges, we have the business challenge. What data source is the System of Record (SOR)? During the migration itself, that question is important, because if you have disparate information across the many sources being migrated, which one trumps the others?

Each LOB will say their data is better, and will want their information to prevail. That’s when a data governance office is important, and will help solve the many conflicts that are bound to happen.

And a single source is not necessarily the SOR for all data being converted, which increases the challenge.

Even if a SOR is clearly established during data migration, timing may be an issue as well. At some point, you obviously want to make the MDM hub the System of Record. But how do you manage the intermediate phases? An intermediate state may include many sources still operational, and in need of a live interface to maintain data consistency.

Remember, not everything is migrated at once. That’s clearly a challenge that can get quite complex, especially if the interface is bi-directional.

Once migration is completed, rewriting all your existing systems to use the hub can be expensive and unfeasible, especially if you use COTS products. Custom interfaces are sometimes unavoidable.

Here are some tips to remember:

• Start a data governance program early. You don’t need an MDM initiative to have a data governance body. The earlier you start the cooperation between the many LOB’s, the easier it will be to integrate their data later, and establish which system is the SOR at any given moment.
• The above is also true for data quality. Data quality is just one of many MDM disciplines, but can and should exist even if you’re not doing a full MDM yet. The cleaner your existing data sources are, the easier it will be to integrate them later into a single hub. Plus, data with higher quality facilitates the determination of which source is more appropriate to be the SOR.
• Once integration starts, clearly establish which system is the SOR for a given entity and/or set of information. This definition is critical to avoid confusion and facilitate entity resolution. As data is migrated, clearly define when the SOR transition will occur.
• Data maintenance should be done on the SOR only. Avoid bi-directional interfaces. Synchronizing information that is modified in multiple places is a nightmare, and should be eliminated if possible.
• IT and business must work closely together. Establishing a SOR is a combination of technical feasibility along with properly supporting all business processes. Rarely will one side be able to define the SOR without consulting the other side.

An MDM program requires a lot of planning and coordination, and it is not a single project. It is an ongoing program that needs constant collaboration between the many LOBs and IT. Having a clearly established SOR for every single attribute, at all times, will certainly minimize issues.

Dalton Cervo is a Senior Solutions Consultant at DataFlux, helping organizations in the areas of data quality, data integration, and MDM. Prior to DataFlux, Dalton served as the Data Quality Lead for the customer data domain throughout the planning and implementation of Sun Microsystem’s enterprise customer data hub. 

This large telecom company is getting ready to do an enterprise transformation program called PROTEA, which stands for Process Redesign, Organizational Transformation and Enterprise Architecture.

They recognized early on that master data management would be a critical part of their new enterprise architecture, so they reached out to Hub Designs last fall, when they were starting to put together their new program. We worked closely with them to help craft an engagement that would focus on developing a Strategic Roadmap and Business Case, and after being home from the Gartner MDM Summit for three days, we headed to South Africa to kick off that engagement.

Our main contact, Maurice, met us in the lobby and quickly ushered us through getting security badges and a quick tour of the facilities. Our first scheduled meeting was with Paul, the MDM program’s business sponsor, who would be an important ally. The meeting went very well, and we promised to work on some introductory slides he could use at the kickoff meeting coming up that Monday.

An hour later, we met the entire PROTEA team, including Maurice’s boss, Clark, plus the organizational change management team, led by Carol, the enterprise architect, Brian, a business analyst named Lisa, and project managers Joseph and Stephan. We were struck by the warm, welcoming feeling we got from the team, and the efficient way everyone got down to business, getting ready for the upcoming week’s workshops on MDM, data governance and the “As Is” and “To Be” states that we would be having with the business and IT community.

The next day, we spent time finalizing the presentations for those workshops, and meeting with the business sponsor again. We also started having some one-on-one meetings with people from the business, and we met with the project manager and talked about how we saw future phases of the program shaping up.

Friday was hectic, as we were putting the finishing touches on the presentations for the upcoming workshops. We would be presenting to and meeting with almost 50 people from across business and IT, and doing an “Intro. to MDM” session on Monday, for 3 hours in the morning, and then 3 hours in the afternoon. On Tuesday, we would do two 2 hour “As Is” workshop, and then on Thursday, two workshops on the desired “To Be” state. All told, we did more than 14 hours of workshops in three days.

Friday evening, the team was very gracious in inviting the Hub Designs folks out, along with the rest of the PROTEA team and a few international visitors, plus everyone’s families, to an authentic South African “brai, which involved a lot of great conversation, adult beverages and huge quantities of barbecued meats. It was a great time, and a very good way to get to know everyone on the team in a short time.

During the week, we also had some one-on-one meetings with a few key IT people who were critical to win over to the MDM initiative. They were skeptical at first, in some cases, but it seemed the meetings went well, and we reached a meeting of the minds that the PROTEA initiative, and the MDM component of it, was something they recognized the need for, and that MDM was something that “made sense” to them. So, a few more potential allies in the enterprise were identified.

The Monday “Intro. to MDM” workshops went very well. Lots of good discussion and questions, very interactive, engaged attendees from both business and IT, good evaluation forms, a big relief at the end of the day that it went so well.

Tuesday’s “As Is” sessions went well too, although it was a little harder because of the mixed audience of business and IT people. At one point, we were discussing some technical questions for a few minutes, and of the business chimed in and said that if we didn’t change the subject back to a more business-oriented track, she was going to leave. We immediately saw that she was right; we were losing the audience. So we apologized, explained that we would change back to a more business-oriented theme, and we’d take technical discussions “offline” if they came up in the future.

Wednesday was a national holiday so that South Africans could vote, but Tim Smith and myself came into the office and worked anyway, getting ready for the Thursday session and preparing for a Friday meeting with Africom’s CIO that had just been set up.

Thursday’s “To Be” sessions were very productive, leading to lots of back and forth discussions with the business users and the IT people about what the destination point for PROTEA should look like.

We used the Gartner Seven Building Blocks of MDM: A Framework for Success as a guide, with some additional Hub Designs frameworks added in as well. Basically, we focused on aligning the MDM vision with Africom’s overall business strategy, then developing an MDM strategy that supported that MDM vision, and creating some metrics (while working towards an MDM business case) that the MDM initiative can impact in a positive way.

Finally, we recognized that without a strong emphasis on governance, MDM is just “throwing technology at a problem” and is unlikely to be successful, so we planned for creating a data governance organization and corresponding processes. Only then did we envision the technology and future architecture that will facilitate the organizational transformation, process redesign and enterprise architecture that PROTEA requires.

Realizing that there are significant gaps between the “As Is” state and the “To Be” state, we dug in and spent a long working session on Friday listing those gaps. On Monday, we’ll prioritize the gaps and identify the gap closure strategies needed to remedy or close all of the gaps we identified.

We also had a great meeting with Africom’s CIO on Friday, who was very receptive and impressed me with his grasp of the implications of a business-led data governance organization on the relationship between business and IT at Africom. We spent 30 minutes talking with him and it was one of the best business conversations I’ve ever had with a C-level IT person.

Over the weekend, Tim Smith and I took a break and drove to the Pilanesberg National Park, a game reserve in the North West Province of South Africa. What a beautiful place! We saw zebra, gazelles, giraffes, Cape buffalo, hyenas, impala. Saturday night, we stayed in Sun City, which was an awesome resort about 15 minutes from the game reserve. Sunday morning, we went back and had the most amazing experience. Five or six elephants walked right in front of our car, including one giant one who stopped directly in front of us, eyeballed us for about 5 minutes, sniffing the hood of the car, even touching it with his trunk, trying to decide whether to charge us or not. Eventually though, he decided we were no threat and he wandered off to join the rest of his family.

We’ve got two more days of meetings, as we discuss the importance of data governance with Clark’s boss, meet with another critical senior IT person, have our gap closure strategies working session, and have a debriefing session at the end of the engagement on what we’ve accomplished, and what are the next steps.

We’ll be coming back in July for another two weeks to finalize the Strategic Roadmap and Business Case, and to spend some time socializing them with the business community and IT leadership that we’ve met on this trip. We’ve really enjoyed the first two weeks of this engagement and are looking forward to the next part in July.

Africom has a lot of work ahead of it as it brings PROTEA from the early stages to the execution stage. We’re looking forward to being one of their MDM and data governance partners, as they take on this massive program.

We look at it as an effort comparable to trying to lift a pyramid – you need someone at each corner and many people in between. “Many hands make light work.”

In partnership with the Africom business and IT staff, the SI firm they’ll engage to assist with PROTEA, and a local consulting firm that also specializes in data management and information quality, we think Hub Designs can continue to make a big impact on the MDM and data governance component of the PROTEA initiative.

In 2010, one of the 25 people recognized was a Hub Designs client, Dorcy Lannigan, program manager, business excellence at Ceridian.

Hub Designs developed our Equifax Integration for Oracle, which integrates Equifax Commercial Information Solutions data into the Oracle E-Business Suite and Oracle Customer Data Hub platforms, and Ceridian was our first client for this solution. This product smoothly integrates Equifax data into Release 12 of Oracle’s enterprise resource planning (ERP) and master data management (MDM) suites.

Dorcy Lannigan

We really enjoyed working with Dorcy and the entire Ceridian team, so it was great to see Information Management recognize him as one of the Top 25 Information Managers for 2010.

In 2011, Information Management recognized another Hub Designs client, Chuck Backus, who is the VP of Enterprise Data at LexisNexis.

Hub Designs partnered with another consulting firm, eVerge Group, to do a Product master data management strategy engagement for LexisNexis. We were also involved in the data governance formation effort there, which is where we came to know Chuck. It’s been a little more than a year since the end of that engagement, but the work Chuck and his team is doing is going full steam ahead.

Chuck Backus

I caught up with a LexisNexis MDM team member at the Gartner MDM Summit, and they are up to some great stuff there, as they implement a Product Hub, spread governance throughout the organization, and develop flexible services that can be invoked from anywhere within the enterprise.

Congratulations to Dorcy Lannigan from Ceridian and Chuck Backus from LexisNexis. We look forward to highlighting the latest Hub Designs client like this here soon!

Convergence Clarifies Benefits and Value

In a recent Gartner report covering predictions for data integration and MDM:

Through 2015, 66% of organizations that initiate an MDM program will struggle to demonstrate the business value of it.

It’s probably not a stretch to extend this “struggle for value” to BPM and BI / analytics. But through the convergence of MDM with BI / analytics and BPM, an analyst like Sandy Kemsley sees increased business value, in this Loraine Lawson interview:

Lawson: It’s become more important with MDM to identify pain points and a real business case. Yet MDM is still pretty IT-centered. Does connecting it to business process management (BPM) allow it to be more business-focused as a project?

Kemsley: Absolutely – connecting it to BPM, and also connecting it to business intelligence and analytics, because that’s one of the things that many business users are interacting directly with (analytics), whether it’s just simple reporting or dashboards or a more complex drill-down. You can get better analytics if you have consistent data models and those consistent data models are going to be helped by MDM, that’s one of the key business benefits. When you want to have a report that gathers data from a number of different systems, it’s not going to be some huge, big, long project because somebody has to figure out what data maps onto what other data. It’s going to be a much more straightforward thing because while the data may not all be in one place, at least it will be in a consistent format so that you can easily bring it together.

Individually these solutions can achieve some value and success for an enterprise, but at the cost of much duplicated effort and resources.

In convergence, with initiatives for business improvement and better decision-making, an integration of BI/analytics, BPM, data governance and MDM has definite synergistic outcomes that can greatly increase business value and reduce wasted effort.

Integrating business insights into process execution will significantly improve the quality of decisions and lead to continuous process optimization. And process events kicking off BI and analytics for real-time decision-making increases beneficial outcomes.

All of these solutions should be about solving frequently complex business problems and supporting the work to be done in the enterprise. Each solution brings a significant piece of the “big picture”: better decisions for the business with reliable data feeding both intelligence and process. Ultimately the biggest payoff is how this convergence feeds directly into business agility and continuous change to constantly fine tune sustainable competitiveness.

About the author: Julie Hunt is an accomplished software industry analyst, providing strategic market and competitive insights. Her 20+ years as a software professional range from the technical side to customer-centric work in solutions consulting, sales and marketing. Julie shares her take on the software industry via her blog Highly Competitive and on Twitter: @juliebhunt. For more information: Julie Hunt Consulting – Strategic Product & Market Intelligence Services.

Master data management (MDM) is a good reflection of how an enterprise uses data, information – and content – for business purposes. The creation and management of master data touches more than the information itself. By creating data repositories and processes that reflect business functions, an enterprise should develop access to the information that is so crucial to effectively and efficiently achieving its business goals. It’s extremely important to analyze, manage and provide access to all forms of information – structured and semi-structured data, as well as “unstructured” content.

For BI and analytics solutions to provide real intelligence, they must be based on accurate and timely data. BI outputs are based on data aggregations, until recently, from structured data in data warehouses, with delivery in the form of reports or dashboards to enterprise users. Analytics add the dimension of mathematics and formulas, with variants addressing forecasting and prediction.

Neil Raden responds to the ebizQ question: How does master data management change BI?:

…to describe how organizations collect data as part of a process, but manage to make it infinitely more valuable by using it for other purposes.

What does this have to do with BI and MDM? In our research, we have found that most knowledge workers shun BI for two reasons (not performance or ease-of-use): relevance and understanding. MDM adds nothing to address these concerns because its representational framework, a relational schema, is inadequate. It’s a representation of a model. An ontology is a model. Until MDM rejects the relational model as its underlying schema, it will be unable to add the rich meaning, relationships and even reasoning that an ontology can do.

So, the point is, if you’re going to go to the massive effort and expense of an MDM solution, take some advice from 21 years ago… Make the data useful for people, not just governors and black belts.

One newer area of interest for BI and analytic solutions is the inclusion of collaborative activities to add contextual and qualitative layers to the output of BI processes. To achieve authentic intelligence, contextual / qualitative layers can provide a strong basis to test, fine tune and filter the artifacts of analytics.

Analytics can benefit greatly from human filters that bring experience, knowledge and creative thinking. Context has a big role here: context for sources, context for outcomes, context for usage with other data points, to achieve the optimal intelligence for “making better business decisions”.

The possibilities for new applications of analytics increase with collaboration. Inviting in many-to-many interactions also opens up processes to new ideas from participants. Gartner found that social venues and collaboration help to track and capture outcomes of the decisions made based on BI / analytics:

Gartner’s user surveys show that improved decision making is the key driver of BI purchases. However, most BI deployments emphasize information delivery and analysis to support fact-based decision making, but fail to link BI content with the decision itself, the decision outcome, or with the related collaboration and other decision inputs. This makes it impossible to capture decision-making best practices. Solutions are emerging that tie BI with social software and collaborative tools for higher-quality, more transparent decisions that will increase the value derived from BI applications.

With convergence, employees in the enterprise should operate more effectively, where improved data governance/MDM lead to better BI, where collaborative processes also enhance and validate BI, where a collaboration setting for BPM works to deliver more of the information that the enterprise needs.

A possible approach to marrying collaboration, data and intelligence to business processes, and, more importantly, to the way people work, can be seen in Tibco’s re-working of tibbr. Dennis Howlett provides this description of tibbr:

It intelligently marries people, process and context, delivering information the way people want to consume

Tibco connects tibbr to business processes and event-triggering that are then exposed in tibbr for taking action. While tibbr is built more for real-time information streams than archives of content and information, tibbr and Tibco have created a platform with a lot of potential for improving overall information findability that adheres to context and worker roles.

It connects to process, people/workers, collaboration venues, data and information streams, centralizing all event streams into one dashboard. Information can be organized by subject or topic, rather than by people. tibbr enables users to create, contribute to, and subscribe to the real-time event streams that matter most to them.

About the author: Julie Hunt is an accomplished software industry analyst, providing strategic market and competitive insights. Her 20+ years as a software professional range from the technical side to customer-centric work in solutions consulting, sales and marketing. Julie shares her take on the software industry via her blog Highly Competitive and on Twitter: @juliebhunt. For more information: Julie Hunt Consulting – Strategic Product & Market Intelligence Services.

Data, information and content saturate most enterprises, so business users must become much more directly involved in creating and managing the overall solution for handling these vital resources. Business people usually hold the key to the context for data and processes, as well as future ways of using the data.

The integrated components of MDM / data governance, BI / analytics, and BPM need to deliver real results to business users but are also highly dependent on the participation of business users to incorporate reality and provide on-target solutions.

True collaboration between business and IT teams starts with requirements, results, procedures, and then leads to collaborative work on joint projects. Such collaboration fosters reuse, reduces duplication of effort and processes, and builds a network of trust between business and IT staff that is aligned with how systems really need to support key business objectives, initiatives and future strategic direction.

Commonality also crosses the business drivers for data governance, MDM, BI, and BPM where key benefit areas consist of growing revenue, cost efficiency, different levels of agility, and compliance. Efforts should provide improvements for:

• Faster, more accurate decision-making, including real-time intelligence
• Identifying and engendering new markets, new products, new customers
• Enhancing and supporting customer relationships and customer service
• Operational procedures
• Customer cross-selling / up-selling
• Ease of compliance, audits, and risk management

Rajan Chandras said in Data Gaps Plague Process Initiatives:

The genesis of these types of initiatives is often very different. BPM is undertaken when organizations find themselves beset with process shortcomings, and with the primary purpose of better understanding, improving and integrating business processes. Data governance initiatives, on the other hand, are usually justified by shortcomings in data quality, consistency and integrity.

Then, data governance is often closely intertwined with master data management, and thus organized alongside important “master” business data entities — customer, product, organization and such.

That said, Rob Karel, Forrester analyst and lead author of the report, suggests that IT must learn how to better educate and evangelize data issues in a language and a context that matters to the business — a responsibility that Karel puts squarely on IT, “because IT often has a more cross-enterprise view than siloed business units and functions.”

For data governance and process governance efforts to be successful, they both (business and IT) must frame their priorities and business value in the context of which business processes they are aiming to improve, transform and optimize, says Karel.

From Forrester study, September 2010

Source:http://alteryx.com/How-Alteryx-Performs/Pages/White-Papers/Forrester-Report-on-BI-Platform-Requirements.aspx

About the author: Julie Hunt is an accomplished software industry analyst, providing strategic market and competitive insights. Her 20+ years as a software professional range from the technical side to customer-centric work in solutions consulting, sales and marketing. Julie shares her take on the software industry via her blog Highly Competitive and on Twitter: @juliebhunt. For more information: Julie Hunt Consulting – Strategic Product & Market Intelligence Services.

Combining Forces to Better Answer Business Needs

Data governance can be seen as formalized policies, practices and processes set up to manage voluminous data assets across enterprises. Data governance also sits on an important growing convergence that encompasses multiple, and frequently separate, disciplines: data quality, data integration, master data management (MDM), business process management (BPM), business intelligence (BI) and analytics.

The solutions surrounding the management of information, data and intelligence are emerging from artificial silos to acknowledge the greater overlap and interrelationships of these technologies and practices. Deliberate initiatives to tighten up the convergence of these solutions will not only improve the better overall functioning of all of these solutions, but they’ll help both IT and business users see how it all works together.

A greatly beneficial result should be the elimination of duplicate demands on business users and IT for implementing and managing these systems.

Forrester’s Rob Karel had this to say on aligning Business Process and Data Governance initiatives:

Data governance is not – and should never have been – about the data.

High-quality and trustworthy data sitting in some repository somewhere does not in fact increase revenue, reduce risk, improve operational efficiencies, or strategically differentiate any organization from its competitors. It’s only when this trusted data can be delivered and consumed within the most critical business processes and decisions that run your business that these business outcomes can become reality.

So what is data governance all about? It’s all about business process, of course.

Let’s add this note to Karel’s assessment: business process is about optimizing the Business.

The current state of the increasing relationships between Data Governance, MDM, BPM, BI / Analytics (as well as DQ and DI) is also the story of the teaming up of business users and IT as collaborative partners in doing the work that help businesses meet strategic goals, bring value to customers, and add to competitiveness.

Both sides of the story must start with the business problems and the jobs to be done, plus the desired outcomes and benefits. Then decisions must be made regarding the role to be played by the software solutions to be implemented. Starting with the business also encourages the exploration and creation of the specific business cases that reflect needs and requirements. With those business cases defined, monitoring outcomes of data governance, BPM, BI, etc., should have a clear basis.

While business processes are a major focus for strategies around data governance, BI and BPM, data still retains a significant role as a strategic asset that enterprises can use to differentiate themselves. These two entities (process and data) must be accorded respect when developing interrelated approaches that incorporate all of these solutions. Just as these solutions are best when in synch with one another, so must the enterprise itself work with these solutions across departments and diverse teams. For business and intelligence processes to yield useful, timely and accurate results, the underlying data must be trustworthy.

About the author: Julie Hunt is an accomplished software industry analyst, providing strategic market and competitive insights. Her 20+ years as a software professional range from the technical side to customer-centric work in solutions consulting, sales and marketing. Julie shares her take on the software industry via her blog Highly Competitive and on Twitter: @juliebhunt. For more information: Julie Hunt Consulting – Strategic Product & Market Intelligence Services.

The new address, HubDesignsMagazine.com, is up and running, and the old address, http://blog.hubdesigns.com, will continue to work as well.

The Hub Designs Blog started in July 2007 as a way to chronicle the development of the consulting firm Hub Solution Designs, and as a way to capture my thoughts on the master data management and data governance industry as it evolved.

Forty-six months and more than 290 articles later, we’ve outgrown the blog format, so it’s time for some changes – we’re going from being a blog to being an online magazine.

New look and feel

We recently changed the “look and feel” here; we’re going for a cleaner, more visually elegant look, with more of a “magazine” style. The previous look had become a little cluttered and busy over the past year or so.

Our recent “spring cleaning” included our corporate web site, the Hub Designs Newsletter, and the MDM Community, the online community of practitioners (which will be welcoming its 500^th member within the next few days).

New authors

In the past, we’ve had guest authors occasionally, but we’ve recently added several new columnists to our regulars. We’re really excited about them all because of their excellent writing and their breadth of perspective:

• James Parnitzke: Jim is a well known MDM and enterprise architecture thought leader.  He’s been writing for us since March 2009, had a very popular series called Modeling the MDM Blueprint and recently wrote a great article on How to Build a Strategic Roadmap.

• Rob DuMoulin: A consultant with expertise in MDM, data governance, business intelligence, and enterprise data architecture, Rob’s been writing for us since November 2009. He also had a popular series, Data Profiling For All The Right Reasons, and recently wrote the Varonis Analyst Briefing.

• Julie Hunt: a software industry analyst, business technology strategist and consultant from Austin, TX. Julie blogs at http://jhcblog.juliehuntconsulting.com. Her first article will be published as a short series in early May.

• Henrik Liliendahl Sørensen: a data quality and master data professional from the Copenhagen area in Denmark. Henrik has his own blog on data quality at http://liliendahl.wordpress.com. His first article was Golden Relations and Platinum Relations.

• Kimmo Kontra and Pertti Karhu: co-founders of a Finnish data management consulting company, Datpro. Kimmo writes at http://datalifeuniverse.blogspot.com. Their first article was MDM Is Not Only About Aligning “Business” and “IT”.

We’ve already started running some of their pieces over the past month. By the way, some of these folks write for other journals or have their own blogs, so please let them know how much you appreciate seeing their writing here by commenting on their articles when they do appear.

Also, if you’re interested in writing for the Hub Designs Magazine, we’d love to hear from you, just contact us via the Hub Designs web site.  You can also read the Author Guidelines.

Advertisers wanted

The other change is that we will soon start accepting advertising from the MDM and data governance vendors we cover. If you’re interested in advertising, please contact us via the Hub Designs web site.

Hub Solution Designs, the consulting firm, has been vendor agnostic from its beginnings, with partnerships in place with all major MDM providers, including Oracle, IBM / Initiate, SAP, Orchestra Networks, Talend, Kalido, and Stibo Systems. By partnering with all but not formally aligning with any, we’ve remained objective.

We will follow a similar policy here at Hub Designs Magazine. We’ll maintain a strict policy of objectivity, because our integrity means everything to us. As William Shakespeare said, “Love all, trust a few, do wrong to none.”

New issues

The Hub Designs Newsletter will announce each new issue (primarily for people that don’t visit the online magazine regularly) and will summarize each month’s content in one easily digestible format. If you prefer to get the content in your e-mail inbox once a month, then the newsletter is the best way to do that.

We’ll continue to announce each new article on Twitter, as we have been for a while now. If you use Twitter.com – or other clients like TweetDeck, HootSuite, Seesmiq, etc. – look for tweets from @dan_power using the hashtags #MDM or #DataGovernance.

Our RSS feed will continue at http://feeds2.feedburner.com/hubdesigns.

Please let us know what you think!

HubDesignsMagazine.com will continue to be a great resource for practitioners looking for the latest MDM news, conference coverage, analyst briefings, research, professional positions, white papers, and best practices.

Please let us know what you think of this by commenting here, or by adding your comments on Twitter with a retweet >> New on Hub Designs Magazine: “Launching Hub Designs Magazine” at http://wp.me/p5Tdn-Dy #MDM.

Recently, it seemed like the number of briefing requests was increasing dramatically, so with the help of a suggestion from Julie Hunt, we decided to form a group called the Hub Designs MDM Think Tank, and to do the analyst briefings in a group format.

We modeled this group after the Boulder BI Brain Trust (BBBT) established by Claudia Imhoff. That group covers the business intelligence (BI) space, and we cover the master data management (MDM) space.

The mission of the Hub Designs MDM Think Tank is:

• to engage with vendors who want to conduct briefings on their products, solutions and marketing strategies,
• to write about those briefings in the form of magazine articles, blog postings, and social media,
• more broadly, to bring a greater understanding through analysis, education and collaboration of how vendor offerings connect with what companies need from master data management and data governance solutions.

Briefings are typically 60-90 minutes in length and consist of interactive discussion between the vendor conducting the briefing and the MDM Think Tank members regarding the vendor’s offering. The Think Tank is interested in both the strategic and technical aspects of the vendor briefing.

During the MDM Think Tank briefings, all participants will speak, listen, question and think. Good interactive discussion usually results in valuable insights and ideas for the vendor, and may uncover problem areas in the vendor’s strategy and offering. The MDM Think Tank is not going to ambush any vendor but we will ask hard questions that matter in regards to the value and viability of the vendor offerings for solving the problems of MDM and data governance.

Members include myself (Dan Power), Julie Hunt, James Parnitzke, Rob DuMoulin, William McKnight, Manish Sood and Gates Ouimette. If you’re interested in becoming a member, please contact me via the Hub Designs web site.

We’ve put together a web site that gives more details:

• Hub Designs MDM Think Tank – Home Page
• MDM Think Tank Members
• Vendor Briefing Request
• Frequently Asked Questions
• Contact Us

The group typically meets twice per month, which limits the available briefing opportunities somewhat. Interested MDM vendors should complete a brief application.

In order to maintain a balanced and unbiased relationship with the vendor community, we don’t accept any payment for these briefings. Based on the discussion with each vendor, some of the MDM Think Tank members will write articles or blog posts outlining what we’ve learned, in order to share that with the wider MDM community. Recent briefings include one from March 2011 with Talend, one from April 2011 with Varonis, and one in June 2011 with IBM on their Identity Insight product.