The following three-part blog provides a comprehensive description of the concepts concerning “data management” specifically and “capability” in general within the context of a framework comprised of ten (10) data management functions. The data management functions defined within this blog come from the writings of The Data Management Association (DAMA) and its Data Management Body of Knowledge (DMBOK v.1). The Data Management Body of Knowledge is a respected publication that attempts to formulate the concept of managing a corporation’s data as an asset. The DAMA DMBOK v.1 is the basis for the terminology used to define the ten (10) data management functions and capabilities.
The framework developed in writing this blog is a concept introduced by Estrada Consulting, Inc. and the author of this blog, and that facilitates our data management consulting services. The framework that defines the ten (10) data management functions is used throughout this blog and is intended to allow the reader to overlay each framework diagram representing the people, tools, and processes necessary to enable the data management functions.
Part 1 of this three-part blog will define the data management framework in general with the ten (10) data management functions and then incorporate other elements necessary to enable data management “capabilities.” The framework presented in Part 1 will be leveraged in Part 2 to depict the exclusive roles (people), tools, and processes involved in data management functions. Finally, Part 3 will describe in general what a minimal and optimal data management program may look like for your organization.
The sum of the three blog parts will attempt to explain how an approach that focuses on data management capability will enhance an organization’s ability to leverage data as an asset and enable its business strategy decisions. Unlike approaches that focus on information technology to enable business strategy, data management is a more comprehensive approach that leverages business knowledge and capabilities. This approach expects business inputs to inform the data management strategy.
As a key component of our data management consulting approach, data management also takes on an enterprise view of the organization and attempts to maximize business value while minimizing resource requirements. This is attained by delivering solutions that are fit for their purpose as defined by the business and by streamlining technology and processes.
Definitions
Data Management – A systematic approach consisting of ten (10) data management functions designed to help an organization plan for and develop strategies to manage data as an asset.
Data Management Capability – The result of successfully combining the data management functions with other elements inherent in any capabilities. These elements include a “purpose” statement for the data management effort, “metrics” to measure success, “people” with the necessary skills and experience, and “tools” applicable to the effort. They also include “processes” which are consistent yet flexible, and “information” in the form of documented business and IT policies, procedures, standards, and processes. Finally, data management requires corporate infrastructure (HR, legal, or other) to support the teams tasked to design and develop the data management capability.
Data Strategy – The combination of data handling abilities defined to address a specific business strategy. The combination of all data strategies is referred to as the data management program within this blog.
Data Management Program – This can also be called a Data Management Strategy. It is the packaged data management capabilities necessary for the organization to meet all business strategy requirements.
Data Management Framework
The goal of data management is to allow the organization to “manage data as an asset,” which is still a difficult concept to understand without context and professional consulting. It is easy to understand that data is valuable today for corporations to survive in the marketplace. It is easy to understand how to manage many physical assets like your car or home. The concept of managing data as an asset is not so clear even though we interact with it every day like we do with our car or home. Data management is an approach to describe how an organization uses its capabilities to effectively do this.
Similar to the functions we perform to manage our car (secure the door, operate the pedals, define the radio stations) data management describes ten (10) functions required to manage data. Your company owns many assets, and like all other organizations data allows it to describe, quantify, and assess its business capabilities, making it one of the most valuable assets.
By developing the people, processes, and tools necessary to establish a data management program, your company will have developed data management capabilities. It’s these data management capabilities that will enable your company to design and implement future data strategies. You can utilize the services of Estrada Consulting, Inc. (ECI ) to ensure that the data management program for your company focuses on establishing capabilities in each of the ten (10) data management functions. These are shown in the following data management framework.
Figure 1: Data Management FrameworkData management consists of ten (10) functions that business and IT define and develop to address business strategies and manage data as an asset. Figure 1: Data Management Framework, developed by ECI depicts the ten (10) data management functions. Data Governance sits at the top of the Data Management Framework and is established to help the organization make better decisions informed by its knowledge of prior projects, business and IT metadata, and data management capabilities, activities, and deliverables.
[Schedule a Free Consultation]
Fundamental to our data management consulting services, we emphasize that business strategies define a set of data requirements that typically necessitate the engagement of multiple data management functions. Depending on the business objective, an organization will typically engage a number of data management functions to satisfy the data-related requirements. As an example, if a business objective is to develop a mobile application to capture customer preferences for a product it sells, this will necessitate the need to engage the Data Security, Data Development Management, and Data Operations Management functions.
It would not necessarily require the engagement of other data management functions such as Document and Content Management nor Metadata Management, which are necessary to solve different business objectives. Therefore, not every organization will build data management capabilities around all the data management functions. However, most large organizations will need to build a data management capability for each of the data management functions with varying levels of maturity.
Data Management Functions
A brief definition of the ten (10) data management functions is given below, which will be referred to throughout this blog.
Data Governance: Gathers business and technical information from data stewards, business analysts, subject matter experts, and IT staff representing all data management function activities for the enterprise. This allows the enterprise to make tactical and strategic decisions to best utilize data management capabilities as an asset for the organization. Data Governance oversees data management function activities and reports progress to the respective Governance Council.
Data Operations Management: Develop strategies to ensure business and IT systems are performing based on business-defined service level agreements for availability and uptime. Best practices include maintaining M&O contracts and including M&O costs in future budget forecasts.
Data Architecture Management: Defines enterprise entities and relationships from data management consulting to physical implementation. This allows the enterprise to guide the implementation of strategic data initiatives.
Data Development: Develops database artifacts and user interfaces to capture and present business and IT system data. Data development is focused on the data captured in COTS and custom business applications which enhances data value and management capabilities. It also mitigates data errors. Best practices include the system development life cycle methodology for application development and service-oriented architecture to develop reusable service utilities.
Data Security Management: Develops and Implements data classification models and ensures data is kept in a secure manner based on its classification. Security management incorporates activities to secure the network, file, and database environments. Best practices for access control include Federated and Centralized Access Control and RBAC. Best practices for categorization and protection include FIPS Pub 199 and NIST (800-53).
Data Quality Management: Develops and implements quality assurance and control activities based on business-defined data management capabilities and quality standards. Best practices for understanding business needs include observation patterns, concepts of operations, and process-based information.
Document and Content Management: Develop strategies to categorize and index documents and business content made available through file management and web-based tools. Other services important to this function include digital signature and archival.
Data Warehousing and Business Intelligence Management: Develop strategies with data management consulting services to integrate and prepare enterprise data for presentation in support of enterprise business information initiatives. Common patterns used for exchanging data needed include message board integration, publish/subscribe pattern, transaction interception, hub and spoke. Patterns for structuring data for use in management capabilities include data warehouse star schema, data mart, and operational data store.
Metadata Management: Develop strategies to manage data about enterprise data including but not limited to physical data definitions, business rules, data lineage, and business application feature documentation. The artifacts delivered by a successful metadata program are central to the seamless communication of business and IT knowledge to develop other ways of managing data.
Master and Reference Data Management: Develop strategies to ensure the quality and integrity of the “Golden Record” from its source of truth through to the reporting environment. Develops data lineage documentation and works with data architects to ensure models represent the business’ data definitions. Best practices include master data management and data dictionaries.
Data Management as an Enterprise Capability
The data management program for any corporation is the combination of data management capabilities that are right-sized and sustainable, enabling a successful business strategy.
Figure 2: Data Management as an Enterprise Capability
In order to establish a data management capability that is sustainable for any of the ten (10) data management functions, the organization needs to ensure the full capability is defined. This is usually achieved with expert data management consulting. Depicted in Figure 2 is a representation of the required elements of a successful and sustainable “capability.” These elements include purpose, required results, people, tools, processes, metrics, information, and infrastructure.
The most important items to define at the outset of any data management effort include the purpose statement for the effort and the required results. These items are portrayed as the foundation of data management capabilities in Figure 2. No enterprise capability can last if the execution of its purpose cannot deliver value. Data Management should have one or more of the following items as its purpose:
- Ensure the business collects the data required to perform its mission requirements.
- Ensure the data collected is secure (protected against unauthorized modification, deletion, or addition).
- Ensure the data used in the business is the correct data for use with the appropriate meaning to those using the data.
- Prepare the organization for being a data-driven organization where decisions are enabled with the appropriate data and associated analysis to inform key decisions.
- Required results are synonymous with outcomes. Outcomes expected from having a Data Management capability include:
- Curated data (data that has been cleaned and validated for the purpose of its use) is available for key business operations and decisions.
- Data is secure and not impacted by unauthorized alteration.
- Data is managed as prescribed by the data owners and stewards.
Given that the data management capability has to achieve a known set of outcomes, the processes become clearer. Our data management consulting services can help organizations optimize these processes and align them with strategic objectives. Below are examples of essential data management processes, which have been categorized within their respective data management function.
- Data Governance
- Review/approve/monitor data management projects
- Develop the data governance charter
- Maintain data governance policy, procedure, and process documentation
- Review and approve business and its policies, capabilities, procedures, and standards
- Data Security Management
- Categorization of data to FIPS Pub 199
- Establish protection through implementation of NIST Controls (800-53)
- Detect and protect from internal/external data security threats
- Data Operations Management
- Develop and implement system backup and recovery policies and procedures
- Monitor and performance tune on-premises servers/ configure cloud servers
- Code/application release management
- Data Development Management
- Define/develop data
- Define/develop data extracts
- Define/develop data and coding standards
- Document and Content Management
- Define and develop document/record taxonomy
- Maintain document library
- Define/apply document archival policies
- Metadata Management
- Define and develop metadata taxonomy and standards
- Prepare metadata for use (templates, forms, format specifications)
- Maintain metadata catalog
- Data Warehouse and Business Intelligence Management
- Profile data and relevant management capabilities
- Define/develop data, reports, cubes, and visualizations
- Define/develop ETL processes
- Define/develop data analytics/science methodologies
- Data Quality Management
- Audit data against documented business processes, procedures, and rules
- Audit data against documented IT data standards, validation rules, and processes
- Review and document business requirements
- Master and Reference Data Management
- Create data flow diagrams
- Document data lineage
- Define and document enterprise master and reference data
- Data Architecture Management
- Define and develop enterprise system and data architecture models
- Define and develop data integration processes
- Develop data categorization standards/methodology
Resources (people) with the appropriate skills are essential to perform the roles necessary to execute the processes. Leveraging data management consulting can help identify skill gaps and recommend strategies for effective role fulfillment. Examples of the data management capabilities and functions in the respective roles (people) are provided below.
- Data Governance
- Data governance staff
- Data stewards, owners, stakeholders
- Subject matter experts
- Data Security Management
- Chief information security officer
- Network, system, and database administrators
- Compliance analyst
- Data Operations Management
- Server administrator
- Help/service desk staff
- Release manager
- Data Development Management
- Data developer
- User interface developer
- Document and Content Management
- Technical writer
- Librarian
- Metadata Management
- Technical writer
- Data owner, steward
- Data Warehouse and Business Intelligence Management
- Report/visualization developer
- ETL developer
- Data scientist
- Data Quality Management
- Data quality analyst
- Code quality analyst
- Master and Reference Data Management
- Data analyst
- Subject matter expert
- Data owner
- Data Architecture Management
- Data architect
- System architect
When individuals are executing the processes, there is key information needed for them to be able to accurately complete the work to deliver the process results expected. Engaging with data management consulting can ensure that they have access to structured guidance and insights necessary for their tasks. The following list of information is likely essential:
- Business policies, procedures, and data standards
- IT application development policies, procedures, standards, and templates
- IT data management development policies, capabilities, procedures, and standards
- IT security policies, procedures, and standards
- Detailed business requirements
- Business system documentation (user and system manuals)
- Training literature and videos
- Document and data taxonomies
- Data quality and performance reports
Each individual performing in a role should be able to tell if their performance is achieving the required results for their processes. This is possible with the measurement of the outcomes. The following list of metrics is likely essential:
- Network, system, server, and software performance metrics
- Service level agreements
- Business data standards
- IT policies, coding standards, naming conventions, and templates
- Survey results from data owner, steward, and stakeholders
Based upon the information included above, tools and technology need to be implemented to ensure the data management capabilities are efficient and effective for the planned volumes of data needed in the enterprise. The following list of tools and technology are likely essential:
- Database management system (DBMS)
- Metadata management platform
- Network security appliance
- Release management software
- Application development software
- Document management platform
- Reporting, visualization, and dashboard development software
- Testing software
- Identity and master data management software
- Data and process flow modeling software
- Data modeling software
Finally, infrastructure is the last piece essential to sustaining effective data management capability. Infrastructure represents all that the capability should take for granted from the organization, such as:
- Adequate facility space
- Responsive HR practices for hiring and related functions
- Legal counsel (if required)
- Financial processing (as applicable to data management projects)
Data Management capabilities that are developed within each of the data management functions will better enable an organization to address changes to data strategy as a result of changes to business strategy. Collaborating with ECI’s data management consulting experts can accelerate the development of these capabilities.
The extent to which the organization has developed the functional teams, invested in and gained experience using data management tools, and implemented the processes that define its data management capability will determine the organization’s ability to align its data strategies with the organization’s business strategies. Schedule a free consultation