ETL Informatica Testing

This Demo is based on ETL Informatica Testing and back end Testing

By, Peter L Annis

1

ETL Informatica Testing

Content
Set up the Test Environment Ready as per as per following details Source database configuration details Target database configuration details ETL Informatica details and which Version has to be used Complete understanding of Functional requirement System (FRS) ETL Testing Procedure Data Validation using Beyond Compare Tool CDC Functionality is required of the current Project Note : Depends up on client need
2

ETL Informatica Testing

Source Database Configuration Details

Install Oracle 9i Software after successfully installed Add the TNS Names tnsnames.ora file as per below path C:\ORACLE\ora92\network\ADMIN\ ODBC Configuration Details for Source database

ETL Informatica Testing

Source database
Start Run odbcad32

ETL Informatica Testing

Source database
To create the Test Connection for Source DB

ETL Informatica Testing

Source database

ETL Informatica Testing

Source database
Test connection created Successfully

ETL Informatica Testing

Source database
In Data Source Administrator We can able to see the source database Name

ETL Informatica Testing

Target Database
Our Target base will be SQL Server 2008 We can get trial version Try to download from the below:http://www.sqldbtools.com/Downloads.aspx?ProductId=2 Or From Microsoft site

ETL Informatica Testing

Target Database
Get the Target base connection details

We must know Server Name

UserID
Password Database Name

10

ETL Informatica Testing

Target Database
Target base connection is successful We can able to see the Database and Target Tables also

11

ETL Informatica Testing

Source Database
We can install Toad or PL SQL Developer Tool these are GUI interface and user friendly

Connecting to source Database (Oracle) But Im using PL/SQL Developer

12

ETL Informatica Testing

Source Database Tools

Source Database Connection We can use
Toad or PL SQL Developer Tool

These are user-friendly GUI Interface Free downloadable tools from web site

13

ETL Informatica Testing c

Source Database
Enter the Login Details UserName:xxxxx

Password: xxxxx
Database: xxxxx

After Successful Login

14

ETL Informatica Testing c

Source Database
File -- > SQL Script --> New Query window will be opened

15

ETL Informatica Testing

Table information for Source

Check the Data is available in the Source Table

16

ETL Informatica Testing

Table information for Target

Check the whether Target Table has the Data

17

ETL Informatica Testing

Common ETL Testing Procedure

18

ETL Testing Process

Common Testing Procedure/Process: Following things should be in place before test case design / Execution Requirements Source to Target Column mapping, Selection criteria ( Business Rules ) in Transformation mappings Look up condition Source and Target Database Flow of ETL
19

ETL Informatica Testing

ETL Testing Scope general

Verify the data and server refresh is done as per Design document Verify the data is available for Customer On time Verify the ETL workflow is successfully completed Verify the Session Log file is created and check the updated Date timestamp. Verify the ETL datas control fields is populated in the target table as per current ETL workflow ROW_ADD_STP, ROW_ADD_USER_ID, ROW_UPDATE_STP, ROW_UPDATE_USER_ID

20

ETL Informatica Testing

ETL Testing Procedure

Verify the row count of source and target table should be equal Verify that the total row count in source and target row count should be matched. Verify the values of source column should be matched with target value Verify the Data Type & Size of each field existed in source and Target Table as per Design Document Verify the Data Integrity as per design document Entity integrity Referential integrity

21

ETL Informatica Testing

ETL Testing Procedure

verify that the any Transformation logic rules have been implement between the Source to Target as per design document (i.e.) Aggregate Sequence generator Sorter Router Filter Lookup

22

ETL Informatica Testing

Data warehousing Architecture

23

Data Warehousing

24

ETL Informatica Testing

Data Warehouse Model

Developer

Metadata

End User

Operationa l Sources

Extract Transform Load

Data Warehouse

25

ETL Informatica Testing

Uses of Informatica in Data warehousing

26

ETL Informatica Testing

Power Centre Architecture

27

ETL Informatica Testing

Informatica Power center Details

Install the Informatica Power center 7.x version no will be depends on the Client After Successful initialization of Informatica Power center 7.x

28

ETL Informatica Testing

Informatica Configuration Details

29

ETL Informatica Testing

Repository Details

Creating the Repository Details Enter the Repository Name : Test/Stage/Dev User Name : xxxx

30

ETL Informatica Testing

Repository Details
Enter the Repository Name : Test/Stage/Dev User Name : xxxx Password :xxxxx Repository Details Host Name : Port Number : Try to Connect
31

ETL Informatica Testing

Workflow Monitor

32

ETL Informatica Testing

Workflow Monitor
Right Click Test Repository Folder

Enter Username : XXXX

Password : XXXX

Click on Connect

33

ETL Informatica Testing

Work Flow monitor

Uses of Work flow monitor Workflow monitor plays important role in the ETL Testing To Check the whether ETL workflow is successfully executed or failed To verify the session log information To Check the ETL run time for Date timestamp and Load summary details for
Source and Target Table data count

Suppose if the workflow is failed we can able figure out the failed reason
34

Workflow Details
Information need to get the session log Folder Name : PRESRC_KIT_TEST Worklet Name : wl_daily_Bo_trg_kit_Master session Log : s_m_stg_trn_sql_KIT_SALES_PLANT.log

35

ETL Informatica Testing

Workflow Details
Log File Checking Check whether the ETL Run Timestamp and Target table Timestamp should be matched Source & Target Table Count in session load summary Check whether ETL Workflow Session is successfully completed or failed
36

ETL Informatica Testing

Time Stamp Validation

Session Log and Target table data loading timestamp should be matched

37

ETL Informatica Testing

Record Count Validation

Target table Count is 663

Rules should be followed while taking source count also

38

ETL Informatica Testing

Record Count Validation

Check whether the Target Table count is should be matched with the Source count Right now target count also matching 663

39

ETL Informatica Testing

Data validation
As of now we had checked Whether the ETL Work flow is succeeded or failed Log File Date time Stamp Verification Session load summary details for source and target table total no. record count Source and Target table record count

40

ETL Informatica Testing

Data Type validation

Data type verification for both Source and Target table

41

ETL Informatica Testing

Data Type validation

42

ETL Informatica Testing

Data Type validation

1. Desc <Table_Name> to view the Data type Details

Compare with ETL Mapping Document for Source

43

ETL Informatica Testing

Data type Verification

Compare the Dataype details with the ETL Mapping document and Target Table Out Target Database is SQL Server 2008 By using SP_HELP <Table_Name> command We can view the data type details

44

ETL Informatica Testing

Data Validation
Source Table

45

ETL Informatica Testing

Data Validation
Export the Source table data and Save the file as Source.Xls

46

ETL Informatica Testing

Data Validation

47

ETL Informatica Testing

Data Validation
Open New Excel Sheet Paste Save Target.Xls

48

ETL Informatica Testing

Data Comparison Using Beyond Compare Tool

Beyond Compare Tools

49

Data Compare for Source & Target table

50

ETL Informatica Testing

Click Data Compare Browse the Source and Target File.xls Click on Open as New

51

ETL Informatica Testing

Data compare using Tool

52

ETL Informatica Testing

Data compare using Tool

There is no-mis matched data is available

53

ETL Informatica Testing

Overview
As of now we had checked Whether the ETL Work flow is succeeded or failed Log File Date time Stamp Verification Session load summary details for source and target table total no. record count Source and Target table record count Data type Compare with ETL Mapping Document and Database level Data validation for source and target table

54

ETL Informatica Testing

GOOD LUCK For ETL TESTING

55

ETL Informatica Testing