Hi,
I have created a mapreduce application using Pentaho big data plugin libraries & pentaho hadoop shims libraries.
Transformation (.ktr) and the Hadoop Job (.kjb) files are running smoothly on Spoon.
Using the same .ktr, .kjb and plugin.properties from Spoon environment on eclipse is failing.
any thoughts?
Configuration reads:
FileObject pluginProperties = VFS.getManager().resolveFile(System.getProperty("user.home") + "/workspace/PDIMapReduceApps/plugin.properties");
HadoopConfiguration config = new HadoopConfiguration(pluginProperties, "cdh42", "cloudera", new HadoopShim());
Error is
java.lang.NullPointerException
at org.pentaho.hadoop.PluginPropertiesUtil.loadProperties(PluginPropertiesUtil.java:60)
at org.pentaho.hadoop.PluginPropertiesUtil.loadPluginProperties(PluginPropertiesUtil.java:80)
at org.pentaho.di.job.entries.hadooptransjobexecutor.JobEntryHadoopTransJobExecutor.loadPMRProperties(JobEntryHadoopTransJobExecutor.java:970)
at org.pentaho.di.job.entries.hadooptransjobexecutor.JobEntryHadoopTransJobExecutor.execute(JobEntryHadoopTransJobExecutor.java:779)
at com.impetus.di.MapOnlyWebLogsTransformationJobExecutor.main(MapOnlyWebLogsTransformationJobExecutor.java:91)
2014/02/16 04:51:19 - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) :
2014/02/16 04:51:19 - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : java.lang.NullPointerException
2014/02/16 04:51:19 - at org.pentaho.hadoop.PluginPropertiesUtil.loadProperties(PluginPropertiesUtil.java:60)
2014/02/16 04:51:19 - at org.pentaho.hadoop.PluginPropertiesUtil.loadPluginProperties(PluginPropertiesUtil.java:80)
2014/02/16 04:51:19 - at org.pentaho.di.job.entries.hadooptransjobexecutor.JobEntryHadoopTransJobExecutor.loadPMRProperties(JobEntryHadoopTransJobExecutor.java:970)
2014/02/16 04:51:19 - at org.pentaho.di.job.entries.hadooptransjobexecutor.JobEntryHadoopTransJobExecutor.execute(JobEntryHadoopTransJobExecutor.java:779)
2014/02/16 04:51:19 - at com.impetus.di.MapOnlyWebLogsTransformationJobExecutor.main(MapOnlyWebLogsTransformationJobExecutor.java:91)
I have created a mapreduce application using Pentaho big data plugin libraries & pentaho hadoop shims libraries.
Transformation (.ktr) and the Hadoop Job (.kjb) files are running smoothly on Spoon.
Using the same .ktr, .kjb and plugin.properties from Spoon environment on eclipse is failing.
any thoughts?
Configuration reads:
FileObject pluginProperties = VFS.getManager().resolveFile(System.getProperty("user.home") + "/workspace/PDIMapReduceApps/plugin.properties");
HadoopConfiguration config = new HadoopConfiguration(pluginProperties, "cdh42", "cloudera", new HadoopShim());
Error is
java.lang.NullPointerException
at org.pentaho.hadoop.PluginPropertiesUtil.loadProperties(PluginPropertiesUtil.java:60)
at org.pentaho.hadoop.PluginPropertiesUtil.loadPluginProperties(PluginPropertiesUtil.java:80)
at org.pentaho.di.job.entries.hadooptransjobexecutor.JobEntryHadoopTransJobExecutor.loadPMRProperties(JobEntryHadoopTransJobExecutor.java:970)
at org.pentaho.di.job.entries.hadooptransjobexecutor.JobEntryHadoopTransJobExecutor.execute(JobEntryHadoopTransJobExecutor.java:779)
at com.impetus.di.MapOnlyWebLogsTransformationJobExecutor.main(MapOnlyWebLogsTransformationJobExecutor.java:91)
2014/02/16 04:51:19 - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) :
2014/02/16 04:51:19 - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : java.lang.NullPointerException
2014/02/16 04:51:19 - at org.pentaho.hadoop.PluginPropertiesUtil.loadProperties(PluginPropertiesUtil.java:60)
2014/02/16 04:51:19 - at org.pentaho.hadoop.PluginPropertiesUtil.loadPluginProperties(PluginPropertiesUtil.java:80)
2014/02/16 04:51:19 - at org.pentaho.di.job.entries.hadooptransjobexecutor.JobEntryHadoopTransJobExecutor.loadPMRProperties(JobEntryHadoopTransJobExecutor.java:970)
2014/02/16 04:51:19 - at org.pentaho.di.job.entries.hadooptransjobexecutor.JobEntryHadoopTransJobExecutor.execute(JobEntryHadoopTransJobExecutor.java:779)
2014/02/16 04:51:19 - at com.impetus.di.MapOnlyWebLogsTransformationJobExecutor.main(MapOnlyWebLogsTransformationJobExecutor.java:91)