Hello All,
The option "Use batch update for inserts" in table output step seem to generate a group of insert statements, as opposed to "single multi-row insert statements", as stated in wiki
"Enable if you want to use batch inserts. This feature groups inserts statements to limit round trips to the database.".
But this feature seem to have been bottleneck in terms of performance in the columnar db platforms like Amazon Redshift.
So I would like to explore, if there is anything that could make the table output step generate the single multi-row insert statements.
Please share your thoughts or let me know, if I am missing something...
Thanks,
Sujen
The option "Use batch update for inserts" in table output step seem to generate a group of insert statements, as opposed to "single multi-row insert statements", as stated in wiki
"Enable if you want to use batch inserts. This feature groups inserts statements to limit round trips to the database.".
But this feature seem to have been bottleneck in terms of performance in the columnar db platforms like Amazon Redshift.
So I would like to explore, if there is anything that could make the table output step generate the single multi-row insert statements.
Please share your thoughts or let me know, if I am missing something...
Thanks,
Sujen