While performing this step, it should be ensured that the load function is performed accurately, but by utilizing minimal resources. the extracted and transformed data, is then loaded to a target data repository which is usually the databases. Loading is the final stage of the ETL process. Generally, processes used for the transformation of the data are conversion, filtering, sorting, standardizing, clearing the duplicates, translating and verifying the consistency of various data sources. In this step, entire data is analyzed and various functions are applied on it to transform that into the required format. Transformation is the next process in the pipeline. Extraction process also makes sure that every item’s parameters are distinctively identified irrespective of its source system. Being the most vital step, it needs to be designed in such a way that it doesn’t affect the source systems negatively. The storage systems can be the RDBMS, Excel files, XML files, flat files, ISAM (Indexed Sequential Access Method), hierarchical databases (IMS), visual information etc. Let me explain each of these processes in detail:Įxtraction of data is the most important step of ETL which involves accessing the data from all the Storage Systems. It refers to a trio of processes which are required to move the raw data from its source to a data warehouse or a database. ETL stands for Extract, Transform and Load.
0 Comments
Leave a Reply. |