All geek questions in one place

Run 100+ SSIS packages in parallel with the parent package

I have more than 100 child packages, and I need to run them in parallel from the parent package. To do this, I will have to create 100+ Execute Package tasks, and then 100+ File Connections. It does not look attractive to me, and it is repeated and error prone. Is there any other way to do this. Remember two things.

  • Children's package Execution should be performed in parallel (so there is no for cycle and material)

  • I use the CheckPoint function to restart and therefore require a flow control at compile time (no script components)

UPDATE: even if you have massive equipment, windows limit the number of simultaneous tasks that you can run at the same time due to the inherent design problem. Although I achieved parallel execution using tasks, I had to limit it to 25 parallel packages at a time to avoid accidental crashes due to problems with Windows.

+3
source share
3 answers

I give up. AFKAYA no. I decided to create more than 100 tasks, one job per package and use the same schedule. Creating jobs was easier with Dynamic SQL.

0
source

Should they be file connections? Have you looked at the options for packages that are stored in the SSIS package repository and listed them there.

100 + , 100+ .

0

Source: https://habr.com/ru/post/1726872/

More articles:


All Articles