Quantcast
Channel: Pentaho Community Forums
Viewing all articles
Browse latest Browse all 16689

BigQuery error with pentaho 8.2 using table output step

$
0
0
We did a pentaho big query with a simple data row generator for 3 coloum and the same column was added to the target ( big query) . Here we used table output step to write to the target


We are able to successfully connect and browse the big-query schema and tables on the target using target connections but how ever when we try to run the etl it fails with the below error



Table output.0 - The Simba driver for a Google Big Query database connection does not support regular DDL statements. Please use the GBQ Bulk Loader step to create your table.



We also checked the jira for same error but it says its fixed on 8.2 but still no go

The detailed row level logging is as follows



2019/02/19 20:11:33 - Spoon - Using legacy execution engine
2019/02/19 20:11:33 - CI-Test - Transformation is pre-loaded.
2019/02/19 20:11:33 - CI-Test - nr of steps to run : 7 , nr of hops : 6
2019/02/19 20:11:33 - Spoon - Transformation opened.
2019/02/19 20:11:33 - Spoon - Launching transformation [CI-Test]...
2019/02/19 20:11:33 - Spoon - Started the transformation execution.
2019/02/19 20:11:33 - CI-Test - Dispatching started for transformation [CI-Test]
2019/02/19 20:11:33 - CI-Test - Nr of arguments detected:0
2019/02/19 20:11:33 - CI-Test - This is not a replay transformation
2019/02/19 20:11:33 - CI-Test - I found 2 different steps to launch.
2019/02/19 20:11:33 - CI-Test - Allocating rowsets...
2019/02/19 20:11:33 - CI-Test - Allocating rowsets for step 0 --> Data grid
2019/02/19 20:11:33 - CI-Test - prevcopies = 1, nextcopies=1
2019/02/19 20:11:33 - CI-Test - Transformation allocated new rowset [Data grid.0 - Table output 2.0]
2019/02/19 20:11:33 - CI-Test - Allocated 1 rowsets for step 0 --> Data grid
2019/02/19 20:11:33 - CI-Test - Allocating rowsets for step 1 --> Table output 2
2019/02/19 20:11:33 - CI-Test - Allocated 1 rowsets for step 1 --> Table output 2
2019/02/19 20:11:33 - CI-Test - Allocating Steps & StepData...
2019/02/19 20:11:33 - CI-Test - Transformation is about to allocate step [Data grid] of type [DataGrid]
2019/02/19 20:11:33 - CI-Test - Step has nrcopies=1
2019/02/19 20:11:33 - Data grid.0 - distribution activated
2019/02/19 20:11:33 - Data grid.0 - Starting allocation of buffers & new threads...
2019/02/19 20:11:33 - Data grid.0 - Step info: nrinput=0 nroutput=1
2019/02/19 20:11:33 - Data grid.0 - output rel. is 1:1
2019/02/19 20:11:33 - Data grid.0 - Found output rowset [Data grid.0 - Table output 2.0]
2019/02/19 20:11:33 - Data grid.0 - Finished dispatching
2019/02/19 20:11:33 - CI-Test - Transformation has allocated a new step: [Data grid].0
2019/02/19 20:11:33 - CI-Test - Transformation is about to allocate step [Table output 2] of type [TableOutput]
2019/02/19 20:11:33 - CI-Test - Step has nrcopies=1
2019/02/19 20:11:33 - Table output 2.0 - distribution activated
2019/02/19 20:11:33 - Table output 2.0 - Starting allocation of buffers & new threads...
2019/02/19 20:11:33 - Table output 2.0 - Step info: nrinput=1 nroutput=0
2019/02/19 20:11:33 - Table output 2.0 - Got previous step from [Table output 2] #0 --> Data grid
2019/02/19 20:11:33 - Table output 2.0 - input rel is 1:1
2019/02/19 20:11:33 - Table output 2.0 - Found input rowset [Data grid.0 - Table output 2.0]
2019/02/19 20:11:33 - Table output 2.0 - Finished dispatching
2019/02/19 20:11:33 - CI-Test - Transformation has allocated a new step: [Table output 2].0
2019/02/19 20:11:33 - CI-Test - This transformation can be replayed with replay date: 2019/02/19 20:11:33
2019/02/19 20:11:33 - CI-Test - Initialising 2 steps...
2019/02/19 20:11:33 - Data grid.0 - Released server socket on port 0
2019/02/19 20:11:33 - Table output 2.0 - Released server socket on port 0
2019/02/19 20:11:33 - Table output 2.0 - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : An error occurred intialising this step:
2019/02/19 20:11:33 - Table output 2.0 - The Simba driver for a Google Big Query database connection does not support regular DDL statements. Please use the GBQ Bulk Loader step to create your table.
2019/02/19 20:11:33 - Table output 2.0 - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : Error initializing step [Table output 2]
2019/02/19 20:11:33 - CI-Test - Step [Data grid.0] initialized flawlessly.
2019/02/19 20:11:33 - CI-Test - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : Step [Table output 2.0] failed to initialize!
2019/02/19 20:11:33 - Spoon - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : CI-Test: preparing transformation execution failed
2019/02/19 20:11:33 - Spoon - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : org.pentaho.di.core.exception.KettleException:
2019/02/19 20:11:33 - Spoon - We failed to initialize at least one step. Execution can not begin!
2019/02/19 20:11:33 - Spoon -
2019/02/19 20:11:33 - Spoon -
2019/02/19 20:11:33 - Spoon - at org.pentaho.di.trans.Trans.prepareExecution(Trans.java:1272)
2019/02/19 20:11:33 - Spoon - at org.pentaho.di.ui.spoon.trans.TransGraph$30.run(TransGraph.java:4287)
2019/02/19 20:11:33 - Spoon - at java.lang.Thread.run(Thread.java:748)
2019/02/19 20:11:33 - CI-Test - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : Errors detected!
2019/02/19 20:11:33 - CI-Test - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : Errors detected!



Can some body advise us if there is something missing on this ? or Anyone connected successfully to big-query and done a data load ?

Viewing all articles
Browse latest Browse all 16689

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>