module 03 discussion scaling challenges
For this assignment, you will formulate plan to deal with large data sets. This assignment is based off a fictitious scenario where you as the analyst must complete an ETL process on a large dataset. You will need to consider the issues faced when dealing with Big Data and draft a plan to deal with it. The submitted paper should be a minimum of one page and include the following detail:
- Address why Big Data creates challenges for ETLs.
- List and describe some of the pain points for dealing with large data sets.
- Prescribe a plan (remedy) for dealing with these pain points.