We’ll now look at the steps that make up this Data Acquisition.
Data Acquisition is where we acquire the raw data that we need, from each of our sources. We attempt to acquire this data in a fast and efficient manner, putting the minimal of stress on source systems, which may still be active systems.
We may consider the implication of and data inconsistencies, where we are acquiring data from active systems; however, we will manage any inconsistencies in a later steps of our data migration.
As with the overall orchestration of our data migration, we will also orchestrate each of the individual sources that will make up our Data Acquisition.
Depending on our overall data migration architecture, we may be acquiring data from a single, or from multiple sources.
Our Sample Data
For this tutorial, we will be auto-generating our data using the Framework Class routines.DataHelper. routines.DataHelper includes a number of methods that allow you to generate high quality and volume data for testing.
By generating data in this way, it will be easy for you to understand this tutorial and to adapt the example Jobs for use in your own data migration, using you own data sources.
We do not need to say too much more on Data Acquisition right now, as this will be dependent on your own source systems.