Quantcast
Viewing all articles
Browse latest Browse all 16689

problem in automating Hive table extraction due to date-parameter difficulty

Hi All,

I have a transformation which picks data from Hive table and load it to the mysql database.

The query extracting Hive's database is "select * from hive_table where days=20130903" which is in yyyyMMdd format.

I need to execute the same transformation on daily basis. as I need to automate this what would be the parameter for days column which increases by 1 on daily basis.

I dont know how to provide the date parameter to the same query in table input step.

Please provide your inputs. It will be great help.
Thanks in advance.
Malibu

Viewing all articles
Browse latest Browse all 16689

Trending Articles