I have a transformation that can have any number of SQL statements in a field in my stream. Right now it has 41 SQL statements but it can have more as time goes on. I want to be able to execute a specified number of these in parallel. I added a sequence to add a repeating number to my stream (1-10), but I am not even sure that's needed. Now the purpose is to execute each SQL statement in this steam that will export dataset and output it to a CSV. I want to be able to run a specified number of these in parallel so I am not waiting for each SQL statement to run one after another.
Any ideas how to make this happen?
Any ideas how to make this happen?