Posts

Showing posts from November, 2014

Data Warehousing - Testing

Introduction Testing is very important for data warehouse systems to make them work correctly and efficiently. There are three basic level of testing that are listed below:   Unit Testing   Integration Testing System testing UNIT TESTING In the Unit Testing each component is separately tested. In this kind of testing each module i.e. procedure, program, SQL Script, Unix shell is tested. This tested is performed by the developer. INTEGRATION TESTING   In this kind of testing the various modules of the application are brought together and then tested against number of inputs. It is performed to test whether the various components do well after integration. SYSTEM TESTING I n this kind of testing the whole data warehouse application is tested together. The purpose of this testing is to check whether the entire system work correctly together or not. This testing is performed by the testing team. Since the size of the whole data wareho...

Data Warehousing - Tuning

Introduction The data warehouse evolves throughout the period of time and the it is unpredictable that what query the user is going to be produced in future. Therefore it becomes more difficult to tune data warehouse system. In this chapter we will discuss about how to tune the different aspects of data warehouse such as performance, data load, queries ect. Difficulties in Data Warehouse Tuning Here is the list of difficulties that can occur while tuning the data warehouse. ·         The data warehouse never remain constant throughout the period of time. ·         It is very difficult to predict that what query the user is going to produce in future. ·         The need of the business also changes with time. ·         The users and their profile never remains the same with time. ·         The use...

Data Warehousing - Backup

Introduction There exist large volume of data into the data warehouse and the data warehouse system is very complex hence it becomes important to have backup of all the data which is available for the recovery in future as per the requirement. In this chapter I will discuss the issues on designing backup strategy. Backup Terminologies Before proceeding further we should know some of the backup terminologies discussed below. ·         Complete backup  - In complete backup the entire database is backed up at the same time. This backup includes all the database files, control files and journal files. ·           Partial backup  - Partial backup is not the complete backup of database. Partial backup are very useful in large databases because they allow a strategy whereby various parts of the database are backed up in a round robin fashion on daybyday basis, so that the whole database is ba...