I have an ETL project in which there is a lot of data that needs to be cleaned up. We are talking about many complex transformations. The process should take place at night and should end after a certain time (10 hours). For this purpose, it is best to use ETL on all processor cores in the system.
What is best used to perform complex ETL transformations in a multiprocessor environment:
SSIS
or
Dot Net Framework 4 (let me qualify this. I can write and use the application using entities and parallel tasks to perform the complex data transformations that are required. Writing an application to perform ETLing is not a problem, m is trying to use the best tool for the job.)
I know this is an unfair question; that SSIS is technology, and point-to-network is the foundation, but still ...
user220583
source
share