Data warehouse system for a quick retrieval of data

Thesis Overview

<p> </p><p><strong>1.0 &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; INTRODUCTION &nbsp;</strong></p><p><strong>1.1 &nbsp; &nbsp; &nbsp; AN OVERVIEW OF A DATA WARE HOUSE SYSTEM</strong></p><p>Today, organizations uses large amount of data daily depending on the kind of organization. However, most of these organizations’ collect its useful data majorly through manual paper recording instead of sophisticated and automated systems. Due to the use of paper recording of data, there can be many mishap since paper is a bio gradable material and also slow and prone to natural disaster and damage.</p><p>&nbsp;It is this identification of problems in trends that enabled the decision of building a stronger and more reliable system of collecting, recording and analyzing data, and this is the main aim of this project work.</p><p>&nbsp;The end users are company managers, project managers, and university vice chancellor, Head of Department, stake holders, many team leaders, etc. It should be noted at this point that there is need for adequate training on the use of this proposed system before it can be used properly.</p><p>&nbsp;A data warehouse prerequisite is that database has to exist in the different organizational unit of an organization so that the data warehouse can collect information / records/ data by querying it into its own database.</p><p>&nbsp;Furthermore, it is multidimensional modeled and is used for the storage of histories, cleansed, validated, synthesized, operative, internal and external data. Stakeholders of a data warehouse system are interested in analyzing their business processes in a comprehensive and flexible way. Mostly they already have a comprehensive understanding of their organizational processes which they want to explore and analyze. What they actually need is a view of their organizational processes and its data which allows them have an extensive analysis of their data.</p><p>The design of the proposed data warehouse system is to take care of any form of database technology. So it will be built to be able to collect information / data in database such as oracle, SQL server, my SQL, access and from CSV file. I believe that all institutions can’t go outside these systems.</p><p>&nbsp; <strong>1.2 &nbsp; &nbsp; BACKGROUND REVIEW OF THE STUDY</strong></p><p>Since development come that triggered the necessity to record information in different areas of endeavor, it has always been difficult to manage large amount of data. This is still a serious problem in the developing economy such as Nigeria.</p><p>&nbsp;The present system used manual way of writing on paper and recording. Their process is very slow and the proposed system, data warehouse is been introduced to solve all this problems. This new system will be capable of retrieving data from any kind of database.</p><p>Also, with the use of the present system, heads of various departments finds it difficult to gather all information needed by them. Data coming from various units also varies which bring about inconsistencies. Data warehouse is useful because it is capable of retrieving all these information from different sub-system databases and collecting it into the data warehouse thus, bringing a great deal of speed and confidence in the part of management leaders.</p><p>&nbsp;Considering the limitations of manual systems, data warehouse were developed to meet the growing demand for management of information and analysis that could not be met by the present systems. The present system was unable to meet the need of fast processing which greatly reduced response time.</p><p><strong>1.3 &nbsp; &nbsp; &nbsp; STATEMENT OF THE PROBLEM</strong></p><p>Before the advent of data warehouse, organizations including Universities used manual means of recording and reporting data. Materials used were pen, ink and paper. These records can be photocopied and reported. There were so many disadvantages associated with this material especially the paper which has a time span. Based on these challenges, I seek to alleviate the problem by implementing a data warehouse that is electronically driven.</p><p>In the present system, data or records that were considered old would be removed from its storage for quick response time. This was done for the purpose of making the response time easier to maintain. This is done to give way to the new records /data coming in. when data warehouse are designed properly and implemented, they can bring a large number of advantages to the organization/universities that use them. They can give an organization a forecast of how the organization is performing as a whole. It can help executives, managers and stakeholders on how to make crucial decisions that can help an organization or institution to succeed.</p><p><strong>1.4 &nbsp; &nbsp; &nbsp; OBJECTIVES OF THE STUDY</strong></p><p>The main objective of this project work is to design a Data Warehouse for collection of data from separate database sources and store it in a data warehouse for further administrative uses/function, in a conducive format that is readily usable. To achieve this, the following are the objectives to be fulfilled.</p><p>1. &nbsp; &nbsp; Discuss the exiting ways or techniques of managing datas, records and reporting and identifying their limitations based on literature survey.</p><p>2. &nbsp; &nbsp; Propose an architecture addressing identified limitations.</p><p>3. &nbsp; &nbsp; Evaluate the proposed architecture for its viability</p><p>4. &nbsp; &nbsp; And lastly, address the scope for its future work</p><p><strong>1.5 &nbsp; &nbsp; &nbsp; SCOPE OF THE STUDY</strong></p><p>This study is proposed to Caritas University, Enugu. This proposed system will be able to bring together data from different departments and sections of Caritas University Enugu and put the data into a centralized data warehouse in a format that is conducive to making strategic decisions.</p><p><strong>1.6 &nbsp; &nbsp; &nbsp; SIGNIFICANCE OF THE STUDY</strong></p><p>Data warehouses when designed and implemented properly, they can bring a large number of advantages to the organization / Universities that use them. The can give an organization a forecast on how the organization is performing as a whole, ensuring a competitive advantage, thus can be applied in other fields such as police stations, production companies, hospital, Banks etc.</p><p><strong>&nbsp;1.7 &nbsp; &nbsp; LIMITATIONS OF THE STUDY</strong></p><p>Having mentioned the usefulness of the data warehouse, a quiet number of factors may also affect this study. The factors are:</p><p>1. &nbsp; &nbsp; The acceptance of implementing this project work into the school system.</p><p>2. &nbsp; &nbsp; The present knowledge base on database management.</p><p>3. &nbsp; &nbsp; The cost of carrying out the project.</p><p><strong>1.8 &nbsp; &nbsp; &nbsp; DEFINITION OF TERMS / VARIABLES</strong></p><p>DATA CLEANSING- the process of ensuring that all values in a dataset are consistent and accurate</p><p>DATA MINING- the extraction of hidden predictive information from large database</p><p>DATA NAVIGATION- the process of viewing different dimensions, slices, and levels of details of multidimensional databases.</p><p>DATA VISUALISATION- The visual interpretation of complex relationships in multidimensional data.</p><p>DATA WAREHOUSE- a system for storing and delivering massive quantities of data.</p><p>METADATA- the information of the data stored in database</p><p>OLAP- Online Analytic Processing</p><p>OLTP- Online Transaction Processing</p><p>DATABASE- A collection of logically related data to meet the information need of the organization</p><p>DBMS- Database management software that enables the user to define, maintain control the database</p><p>MANAGEMENT INFORMATION SYSTEM- Collection of people, database and devices produced to use in providing routine information to manager and decision makers of the organization</p><p>DATABASE DESIGN- The process of creating a design that will support task to the mission statement and mission required database system.</p> <br><p></p>