In this step you will become familiar with the ETL user interface, and run the ETL process you just added to the server.
ETL User Interface
The web part
Data Transforms lists all of the ETL processes that are available in the current folder. It lets you review current status at a glance, and run any transform manually or on a set schedule. You can also reset state after a test run.
For details on the ETL user interface, see
ETL: User Interface.
Run the ETL Process
- If necessary, click the ETLs tab, to return to the main page including the Data Transforms web part.
- Click Run Now for the "Demographics >>> Patients" row to transfer the data to the Patients table.
- You will be taken to the ETL Job page, which provides updates on the status of the running job.
- Refresh your browser until you see the Status field shows the value COMPLETE
- Click the ETLs tab to see the records that have been added to the Patients table. Notice that 36 records (out of over 200 in the source Demographics query) have been copied into the Patients query. The ETL process is filtering to show female members of the ARV treatment group.
Experiment with ETL Runs
Now that you have a working ETL process, you can experiment with different scenarios.
Suppose the records in the source table had changed; to reflect those changes in your target table, you would rerun the ETL.
- First, roll back the rows added to the target table (that is, delete the rows and return the target table to its original state) by selecting Reset State > Truncate and Reset.
- Confirm the deletion in the popup window.
- Rerun the ETL process by clicking Run Now.
- The results are the same because we did not in fact change any source data yet. Next you can actually make some changes to show that they will be reflected.
- Edit the data in the source table Demographics:
- Click the ETLs tab.
- Scroll down to the Demographics dataset - remember this is our source data.
- Click Edit next to a record where the Gender is M and the Treatment Group is ARV. You could also apply column filters to find this set of records.
- Change the Gender to "F" and save.
- Rerun the ETL process by first selecting Reset > Truncate and Reset, then click Run Now.
- The resulting Patients table will now contain the additional matching row for a total count of 37 matching records.
