Hi folks,
I was wondering if anyone had any resources for testing ETL transforms they could share with me.
So far I have found the following through my searches:
Here's a stackoverflow question dealing with this exact issue: http://stackoverflow.com/questions/9...-jobs/15837725
I searched the kettle forums for 'testing' and nothing popped up.
I ask this because I have a homegrown framework but would love to know if there's something a bit more standard out there. I'd prefer something that can be driven from the command line and used for regression testing as our data ETL process changes over time.
Any advice for the best way to test kettle transformations? Is this a problem that isn't solved because it is not really a problem?
Thanks.
I was wondering if anyone had any resources for testing ETL transforms they could share with me.
So far I have found the following through my searches:
- http://code.google.com/p/testkitchen/ (not released since 2010)
- http://wiki.pentaho.com/display/EAI/Black+Box+Testing (I couldn't find code referenced in this post from 2007)
- some homegrown combination of the data grid, csv files, golden tables and dbunit
Here's a stackoverflow question dealing with this exact issue: http://stackoverflow.com/questions/9...-jobs/15837725
I searched the kettle forums for 'testing' and nothing popped up.
I ask this because I have a homegrown framework but would love to know if there's something a bit more standard out there. I'd prefer something that can be driven from the command line and used for regression testing as our data ETL process changes over time.
Any advice for the best way to test kettle transformations? Is this a problem that isn't solved because it is not really a problem?
Thanks.