BI Testing Training Deck

Business Intelligence Training Deck
Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Data warehouse and Data marts Introduction of ETL ETL test processes and scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases
BI Testing Services | Testing Center of Excellence 2
Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Introduction to Data warehouse Introduction of ETL ETL test scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases
What is Business Intelligence?

Business intelligence (BI) is a broad category of applications and technologies for gathering, storing, analyzing, and providing access to data to help enterprise users make better business decisions.
BI applications include the activities of decision support systems, query and reporting, online analytical processing (OLAP), statistical analysis, forecasting, and data mining.
Inputs to Business Intelligence
Basics(elements) of BI
Contents
Why BI Testing needed?

Data, its flow and its transformation in Business Intelligence Systems need to be carefully validated due to increasing reliance of Senior Executives across organizations, in all sectors, on this data to make data driven decisions which have significant impact on organizations. Importance The success of business decisions depends on the quality of underlying information It is difficult to obtain an Integrated view of the important dimensions of business to monitor, track and improve business performance Due to rapidly changing business environment, decisions may need to be based on near-real time data accuracy of data is very important Business Intelligence is essential for organizations that believe in adapting quickly to market changes and customer requirements and helps in modifying business rules according to the changing conditions. Effects of BI Testing Simpler faster cost-effective implementation Analytical mechanisms that enabled faster and more insightful decision-making Leads to improved efficiencies Improved Usability due to Integration Adapting quickly to changing business needs Cycle time is more
Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Introduction to Data warehouse Introduction of ETL ETL test scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases
How BI Testing is Different

BI Testing differs from testing of operational systems on several accounts. The key areas are described in this section below,
CHALLENGES in Business Intelligence Testing
Multiple, abstract sub-systems Sources Data Integration Extract, Match, Validate, Cleanse, Complete, Conform Data Structures Staging, ODS, EDW, Marts Presentation semantic layer, information delivery Multiple technologies & vendors RDBMS, ETL, Data Quality, MDM, Metadata Mgmt, Analytics & Reporting Interactive user interfaces to view data Data processed via backend data feeds BI systems not only need to be tested for validity of data processing as per business rules, but also for robust Data Integration & Reporting processes Extremely high, batch oriented Data processing BI Process Information presentation
Business Analysis
Complex Data Architecture
Technologies
Interfaces
I M P A C T
Organization Decisions
Data & BI Process Centric High Data Volumes Multiple Focus Areas
Strategic Planning
Contents
Basic Skill set for BI Tester

Knowledge of SQL. Basic knowledge of UNIX Understanding of Data warehouse concepts Knowledge of ETL processes and tool Knowledge of Reporting tool Basic knowledge of marketing, sales, purchase and finance processes to understand the business needs
Contents
Business Intelligence Workflow
Any tool, process or activity that can be used for obtaining the best information of supporting the decisionmaking process.
BI Testing Approach
Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Data warehouse and Data marts Introduction of ETL ETL test scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases
Data Warehouse
A Data warehouse is a central repository of data which is created by integrating data from one or more disparate sources. Data warehouses store current as well as historical data and are used for creating trending reports for senior management reporting such as annual and quarterly comparisons.
Important characteristics
Subject oriented Integrated Time- variant Non-volatile
Data Warehouse Process Flow
Data Marts
A data mart is a simple form of a data warehouse that is focused on a single subject (or functional area), such as Sales, Finance, or Marketing. Data marts are often built and controlled by a single department within an organization. Two types of Data Marts -Dependent -Independent
Dependent Data marts

Top Down Approach or Dependent Data Marts (W.H.Inmon)
Dependent Data marts
Independent Data marts

Bottom-Up Approach or Independent Data Marts (Ralph Kimball)
Independent Data marts
Data Warehouse - Dimensional Modeling Dimension Table

Dimension tables contain textual information that represents the attributes of the business Contain relatively static data Dimension tables are joined to a fact able through foreign key reference
Examples: Retail store name, zip code, product name, product category, day of week. Telecommunications -- call origin, call destination Banking customer name, account number, branch, account officer Insurance policy type, insured party
Data Warehouse - Dimensional Modeling Fact Table

Contain numerical metrics of the business Can hold large volumes of data Can grow quickly
Examples: Retail number of units sold, sales amount Telecommunications Length of call in minutes, average number of calls Banking Average monthly balance
Insurance Claims amount
Data Warehouse - Schemas

A schema is a collection of database objects, including tables, views, indexes, and synonyms. Data Warehouse environment usually transforms the relational data model into some special architectures. There are many schema models designed for data warehousing but the most commonly used are: Star Schema Snowflake Schema Fact constellation Schema Galaxy Schema
Star Schema Example
Snow Flake Schema Example
Galaxy Schema Example
Fact Constellation Schema Example
Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Data warehouse and Data marts Introduction of ETL ETL test processes and scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases
ETL Introduction
ETL is a process used to collect data from various sources, transform the data depending on business rules/needs and load the data into a destination database Extract, Transform, Load, this three database functions that are combined into one tool to pull data out of one database and place it into another database The process of updating the data warehouse.
ETL Tools
Informatica - Power Center IBM - Web sphere Data Stage SAP - Business Objects Data Integrator AB Initio
Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Data warehouse and Data marts Introduction of ETL ETL Test processes and Scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases
ETL TEST PROCESS - Data extraction

Purpose
To show that all source data, for every data specification, with all known data errors will be handled correctly
Scope
All data extraction programs to be tested on samples of all source data files Source data have been tested, have been analyzed Test extraction (and SA filling) for every source file Test extraction (and SA filling) for every source / domain spec. Check extraction (and SA-filling) for every data item Test every data item on boundary values, on coded values Test all validation output Test all counters and totaling options
Prerequisites Techniques and requirements
ETL
SA
SA ETL
SA
DM BI
Queries
DM
BI
OLAP Reporting
SA ETL DWH DM BI
Data mining
ETL TEST PROCESS Data transformation

Purpose
To show that all data transformation rules are implemented and do function as specified.
All data transformation programs to be tested against all transformation rules / specifications. Source data have been tested, have been analyzed Standard techniques to be applied for black box unit test Covering all data transformation rules as there are Coding and decoding of data values Consolidation of data records, production of totals Addition of linked data items
Scope
Prerequisites

Techniques and requirements
ETL
SA
SA ETL
SA
DM BI
Queries
DM
BI
OLAP Reporting
SA ETL DWH DM BI
Data mining
ETL TEST PROCESS Data loading

Purpose
To show that all data loading (in the data warehouse) will function undisturbed without errors, performing as required From (final) staging area to data warehouse itself. Staging area data are available in full size preferable with more than one increment, in order to test for linearity Well require performance requirements in full Performance testing techniques and analysis tools to be used
Scope

ETL SA
Prerequisites
Techniques and requirements
SA ETL
SA
DM BI
Queries
DM
BI
OLAP Reporting
SA ETL DWH DM BI
Data mining
ETL Test Scenario

Data insertion as per source target mapping sheet - Correctness of data based on transformation rules - Data types, length of source and targets - Duplicate data - Data loss - Data Quality Update of data as per defined update strategy Delete/Close scenarios as per defined strategy Data accuracy Metadata testing Scripts/Power jobs execution and dependencies
Contents
Introduction to Reporting
Business intelligence reporting describe the practice of analyzing large amounts of data in the form of human readable format. Reports are summaries or collections of information about an aspect of an organizations business. They contain views of the current data in your organizations database, organized and formatted the way you want. You can use two types of data sources when creating reports: detailed and summary.
BI Testing Services | Testing Center of Excellence
42
BI Reporting tool architecture
Reporting Process
Reporting Tools
Business Objects Cognos BI Crystal Reports Micro Strategy Oracle Reports
Contents
Reporting test scenarios

Prompt Type of prompt Description of prompt Default selection Values in prompt Search of value in prompt Minimum and Maximum selection Mandatory prompts Report Label and Headings Layout and Graphs Measures/Metrics Correctness of Data Page by and sorting Drilling Export
Contents
Trust BI Methodology
DELIVER Project Delivery Methodology
Inception
Requirement Gathering Solution Definition Functionality Matrix Architecture
Elaboration
Use Cases, Technical Design, Data Model, Report Specification, ETL Mapping, ETL Process
Construction
Database Objects, ETL, Reports
Transition
Deployment Production Support & Maintenance
TrustBI Methodology
Initiate & Plan
Knowledge Acquisition Process Understand Requirements, Architecture, Testing Scope, Success Criteria, Risks Test cycles & alignment with SDLC Test Data Mgmt requirements Test Environment Requirements
Design
Test Plan & Cases objective, prerequisite, expected results UAT Performance Module Integration Tests Base line regression tests Test Data Mgmt Profile Test Data Source Test data slice size, frequency, periodicity Test env. privileges
Prepare
Setup test environment Scripts / procedures to mask & copy test data (from production) Profile data for test case fulfillment Scripts / procedures to create / procure missing test data Create SQL & associate data sets & expected results for test cases
Execute
Run test procedures for new code Identify impact on existing code and run regression tests Record results
Evaluate
Conduct severity and causal analysis Raise Change Requests, if required Log results
The TrustBI Methodology is based on our proven TMap methodology The focus is on Business & Risk driven testing Test Intensity & Test Data Mgmt are directly proportional to the project risks that are required to be mitigated
Activities
Test Project Plan Test Strategy

Scope Test Data Mgmt Test environment mgmt Defect management Change management Configuration mgmt. Test metrics & reporting Standards & Tools
Deliverables
UAT plans & cases Performance Testing plans & cases SIT plan & cases Module Testing plan & cases Test Data Mgmt plan Test data volumes to be used Test data refresh approach Test data masking algorithms Test data creation process
Test Environment Test Data Test Data creation scripts Test Cases associated test scripts, test data and expected results
Test results Defect logs
Test results severity & root cause Change Requests
Contents
Sample test cases

ETL Sample test cases as below -Inserted later on Reporting test cases as below -Inserted later on
Q&A
Thank You

BI Testing Training Deck

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

BI Testing Training Deck

Uploaded by

Copyright:

Available Formats

Business Intelligence Training Deck

BI Testing Services | Testing Center of Excellence 2

BI Testing Services | Testing Center of Excellence 3

What is Business Intelligence?

BI Testing Services | Testing Center of Excellence 4

Inputs to Business Intelligence

BI Testing Services | Testing Center of Excellence 5

BI Testing Services | Testing Center of Excellence 6

BI Testing Services | Testing Center of Excellence 7

Why BI Testing needed?

BI Testing Services | Testing Center of Excellence 8

BI Testing Services | Testing Center of Excellence 9

How BI Testing is Different

Complex Data Architecture

BI Testing Services | Testing Center of Excellence 10

BI Testing Services | Testing Center of Excellence 11

Basic Skill set for BI Tester

BI Testing Services | Testing Center of Excellence 12

BI Testing Services | Testing Center of Excellence 13

Business Intelligence Workflow

BI Testing Services | Testing Center of Excellence 14

BI Testing Services | Testing Center of Excellence 15

BI Testing Services | Testing Center of Excellence 16

BI Testing Services | Testing Center of Excellence 17

BI Testing Services | Testing Center of Excellence 18

Data Warehouse Process Flow

BI Testing Services | Testing Center of Excellence 19

BI Testing Services | Testing Center of Excellence 20

Dependent Data marts

BI Testing Services | Testing Center of Excellence 21

Dependent Data marts

BI Testing Services | Testing Center of Excellence 22

Independent Data marts

BI Testing Services | Testing Center of Excellence 23

Independent Data marts

BI Testing Services | Testing Center of Excellence 24

BI Testing Services | Testing Center of Excellence 25

Data Warehouse - Dimensional Modeling Dimension Table

BI Testing Services | Testing Center of Excellence 26

Data Warehouse - Dimensional Modeling Fact Table

Insurance Claims amount

BI Testing Services | Testing Center of Excellence 27

Data Warehouse - Schemas

BI Testing Services | Testing Center of Excellence 28

Star Schema Example

BI Testing Services | Testing Center of Excellence 29

Snow Flake Schema Example

BI Testing Services | Testing Center of Excellence 30

Galaxy Schema Example

BI Testing Services | Testing Center of Excellence 31

Fact Constellation Schema Example

BI Testing Services | Testing Center of Excellence 32

BI Testing Services | Testing Center of Excellence 33

BI Testing Services | Testing Center of Excellence 34

BI Testing Services | Testing Center of Excellence 35

BI Testing Services | Testing Center of Excellence 36

ETL TEST PROCESS - Data extraction

Prerequisites Techniques and requirements

BI Testing Services | Testing Center of Excellence 37

ETL TEST PROCESS Data transformation

Techniques and requirements

BI Testing Services | Testing Center of Excellence 38

ETL TEST PROCESS Data loading

Techniques and requirements