Hi,
I have transformation in which i am getting an excel input data feed and write it into a table.
I have a date column in my excel, and need to check whether it contains valid date values in 'yyyy-MM-dd' format.
I retrieve the column as a string in excel input and trying to validate the data type using 'data validator' & used conversion mask 'yyyy-MM-dd'; defined error handling for that step and feed the errors to a text output. the assumption was, rows with empty/invalid date will be written into the error text file and only the valid dates will be passed to subsequent steps. instead i am getting errors on data validator step like 'unparsable date'. the other option i know is insert entire data into staging table and validate it using stored procedures.
need to know how to validate incoming fields and log the error data separately in Kettle itself.
Lourdhu.A
I have transformation in which i am getting an excel input data feed and write it into a table.
I have a date column in my excel, and need to check whether it contains valid date values in 'yyyy-MM-dd' format.
I retrieve the column as a string in excel input and trying to validate the data type using 'data validator' & used conversion mask 'yyyy-MM-dd'; defined error handling for that step and feed the errors to a text output. the assumption was, rows with empty/invalid date will be written into the error text file and only the valid dates will be passed to subsequent steps. instead i am getting errors on data validator step like 'unparsable date'. the other option i know is insert entire data into staging table and validate it using stored procedures.
need to know how to validate incoming fields and log the error data separately in Kettle itself.
Lourdhu.A