Quantcast
Channel: Pentaho Community Forums
Viewing all 16689 articles
Browse latest View live

ERROR: prepared statement "S_2" already exists

$
0
0
hi,

when am trying to push data from MS SQL to PDAdmin am getting the following error.

able output.0 - ERROR (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49 by buildguy) : Because of an error, this step can't continue:
2016/05/04 15:22:28 - Table output.0 - ERROR (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49 by buildguy) : org.pentaho.di.core.exception.KettleDatabaseException:
2016/05/04 15:22:28 - Table output.0 - Error performing rollback on connection
2016/05/04 15:22:28 - Table output.0 - ERROR: prepared statement "S_2" already exists
2016/05/04 15:22:28 - Table output.0 -
2016/05/04 15:22:28 - Table output.0 - at org.pentaho.di.core.database.Database.rollback(Database.java:854)
2016/05/04 15:22:28 - Table output.0 - at org.pentaho.di.core.database.Database.rollback(Database.java:832)
2016/05/04 15:22:28 - Table output.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable(TableOutput.java:332)
2016/05/04 15:22:28 - Table output.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.processRow(TableOutput.java:118)
2016/05/04 15:22:28 - Table output.0 - at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)
2016/05/04 15:22:28 - Table output.0 - at java.lang.Thread.run(Unknown Source)
2016/05/04 15:22:28 - Table output.0 - Caused by: org.postgresql.util.PSQLException: ERROR: prepared statement "S_2" already exists
2016/05/04 15:22:28 - Table output.0 - at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2198)
2016/05/04 15:22:28 - Table output.0 - at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1927)
2016/05/04 15:22:28 - Table output.0 - at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:255)
2016/05/04 15:22:28 - Table output.0 - at org.postgresql.jdbc2.AbstractJdbc2Connection.executeTransactionCommand(AbstractJdbc2Connection.java:814)
2016/05/04 15:22:28 - Table output.0 - at org.postgresql.jdbc2.AbstractJdbc2Connection.rollback(AbstractJdbc2Connection.java:867)
2016/05/04 15:22:28 - Table output.0 - at org.pentaho.di.core.database.Database.rollback(Database.java:845)
2016/05/04 15:22:28 - Table output.0 - ... 5 more
2016/05/04 15:22:28 - Table input.0 - Finished reading query, closing connection.
2016/05/04 15:22:28 - Table output.0 - Finished processing (I=0, O=999, R=1000, W=0, U=0, E=1)
2016/05/04 15:22:28 - test - Transformation detected one or more steps with errors.
2016/05/04 15:22:28 - test - Transformation is killing the other steps!
2016/05/04 15:22:28 - Table input.0 - Finished processing (I=10939, O=0, R=0, W=10938, U=0, E=0)
2016/05/04 15:22:28 - test - ERROR (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49 by buildguy) : Errors detected!
2016/05/04 15:22:28 - Spoon - The transformation has finished!!
2016/05/04 15:22:28 - test - ERROR (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49 by buildguy) : Errors detected!
2016/05/04 15:22:28 - test - ERROR (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49 by buildguy) : Errors detected!

http post request in Carte web service Kettle

How to set default value for a parameter from a query

$
0
0
I'm trying to set a multiselect on a dashboard that gets its options from a mdx query, but by default none of them apear selected, therefore the associated parameter is empty.

I just want that each available option in the select component appears selected by default and the associated parameter contains each option.

extra row from JS putRow

$
0
0
Hi,

I am trying to create a few rows using JS and the following code (also attached the ktr):

var max = 5;
var pfx = "abc";
for (index = 1; index <= max; index++) {
var value = pfx + "&index=" + index ;
var row = createRowCopy(getOutputRowMeta().size());
var idx = getInputRowMeta().size();
row[idx++] = index;
row[idx++] = value;
row[idx++] = max;
putRow(row);
}

I was expecting 5 rows, but it generated 6, and the 'value' in last two rows are the same with 'index=5'.


test index value max
1.0 1 abc&index=1 5
1.0 2 abc&index=2 5
1.0 3 abc&index=3 5
1.0 4 abc&index=4 5
1.0 5 abc&index=5 5
1.0 6 abc&index=5 5

I had to add another 'unique rows' step to filter out the duplicates. Could you please help?

TIA,
Chong
Attached Files

Performance tuning tips - Oracle

$
0
0
I am trying to accumulate the expertise around the oracle performance issues that you came across and the solutions / workarounds that you have used to rectify. Please , everyone can post their encountered scenarios and the ways it could be handled. It could be of more help. I know , there are information available in forums and other blogs , but the information is scattered. Thanks for any help

Sequence between Transformation and Job linked with hop

$
0
0
hi ,

I understand about steps inside transformation run in parallel.
Just wanted get inputs on the below scenario-

I have a transformation connected to job and job connected to step "wait for" and "wait for" again connected with first transformation .
So I what to do couple of things in loop also hv exit condition.

Just wanted to confirm if all these will run in sequence i.e transformation ---> job ---> wait for --->transformation--->job---?wait for ..and so on....


If you have any thumb rules pls share as well....hi ,

I understand about steps inside transformation run in parallel.
Just wanted get inputs on the below scenario-

I have a transformation connected to job and job connected to step "wait for" and "wait for" again connected with first transformation .
So I what to do couple of things in loop also hv exit condition.

Just wanted to confirm if all these will run in sequence i.e. transformation ---> job ---> wait for --->transformation--->job-àwait for ..and so on....


If you have any thumb rules pls share as well....

Thanks,
Nand

Saving LOG_FIELD on log transformation table results on encoding error

$
0
0
I am trying to configure Log when executing a transformation.
However, when I select LOG_FIELD to be saved on the log transformation table,
PDI couldn't insert the logs on the table.
The error thrown is

ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : Unable to write log record to log table [log_trs]
ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : org.pentaho.di.core.exception.KettleDatabaseException:
Error inserting/updating row
ERROR: character with byte sequence 0xef 0xbf 0xbd in encoding "UTF8" has no equivalent in encoding "LATIN1"

I googled and found that this byte sequence is the BOM character.

How could I solve this problem?

Best,

Orair.

Formatting multiple Date Formats

$
0
0
Hi, I'm very new to this program, only using it for a college assignment. I have a list of dates, similar to the attached file, in multiple different date formats. I need to convert them into the same date format, for example dd/MM/yyyy. Was wondering if anyone had a suggesting as to how to go about this.

Thanks

##
Edit:Solved the issue, no need to reply
Attached Files

which version JDK for kettle 6.1.0.1

$
0
0
Hi All,

We want to use the kettle 6.1.01. Which version JDK should we choose. JDK 1.6 or JDK 1.7 or JDK 1.8

Thanks for you help

"setvariables.ktr" at transformation level

$
0
0
Hi,

I'm new here. I have created a job to run my transformation by including "setvariables.ktr" at start as I used config.properties file. It is running fine and giving the expected result.
I have tried by introducing those setvariables.ktr steps in my transformation itself but it is not working and throwing error.

My question is, is it possible to use the setvariables.ktr in my transformation itself instead of creating a new job for that ?



Thanks in advance...

CST for Pentaho 6.1.0

$
0
0
Hi Guys,

I have installed pentaho 6.1 & installed additional component CST with all upstream required component. Install is successful but when I try to use CST functionality it won't supported.

http://pentaho-bi-suite.blogspot.in/...n-pentaho.html

This seems to me an issue with community startup tabs and may not be compatible with the upgraded versions 6.1 because it was working fine until pentaho version 6.0.

Any help on this fix would be greatly appreciable.

Regards,
Shameem.

custom DelegatingRole - methods never called (?)

$
0
0
Hello,

I've implemented a custom DelegatingRole, following the Doc https://help.pentaho.com/Documentati.../Multi-Tenancy section Delegate Roles. I did all six steps described. I'm using remote deugging to see that my MDXOlap4jConnection is called to set my custom role. But I'm surprised that code in DelegatingRole overridden methods is never called. Do you have any ideas? What am I missing?


Thanks for any hint
JS

Pentaho : Hadoop Copy Files JOb execution from Java

$
0
0
Hi Guys,

I am trying to execute a job which copies files from local to HDFS on HDP sandbox VM and I am able to run the Job from the Spoon UI successfully,
but when i invoke the job from the Java it's not copying files to HDFS & it is not logging any error.The job exits with success.
To run a job which uses big data plugin from java is any additional setup required ?

Note :

I am able to execute jobs/transformations which do not use big data plugin steps ?

Any thoughts on how to run these jobs (HadoopCopyStep)? Any help is extremely appreciated

runTrans throws RunTransServlet.Error.UnexpectedError everytime

$
0
0
Hi, I am newbie in PDI. I have created a transformation and trying to run it through a third party application (Java) by calling /kettle/runTrans/?trans=full_path_to_trans.ktr&my_param=my_param_value over http. I've managed to configure cluster carte server and repository as well.

Here is the master-server-config.xml -

<slave_config>
<slaveserver>
<name>master-8080</name>
<hostname>localhost</hostname>
<port>8080</port>
<username>cluster</username>
<password>cluster</password>
<master>Y</master>
</slaveserver>
</slave_config>

Here is the slave-server-config.xml -
<slave_config>
<masters>
<slaveserver>
<name>master-8080</name>
<hostname>localhost</hostname>
<port>8080</port>
<username>cluster</username>
<password>cluster</password>
<master>Y</master>
</slaveserver>


</masters>


<report_to_masters>Y</report_to_masters>


<slaveserver>
<name>slave1-8081</name>
<hostname>localhost</hostname>
<port>8081</port>
<username>cluster</username>
<password>cluster</password>
<master>N</master>
</slaveserver>

<repository>
<name>my-repo</name>
<username>amdin</username>
<password></password>
</repository>

</slave_config>

Here are the commands, I run the servers -
Carte.bat localhost master-server-config.xml
Carte.bat localhost slave-server-config.xml

Both servers runs fine. My transformation does well when I run that in Spoon but throws the following error everytime I run it with Carte -
<webresult>
<result>ERROR</result>
<message>&#x21;RunTransServlet.Error.UnexpectedError&#x21;</message>
<id/>
</webresult>
When I runs first time General - Connected to repository 'my-repo' appears in logs. And after that nothing happens.

Please help. Your assistance would be greatly appreciable.
Thanks.

How can I set the number of attributes to be selected using cfssubseteval?

$
0
0
I'm trying to use cfssubseteval with BestFirst. I want to select N attributes based on correlation.
Do you guys have any sugestion?

Error while opening a report without authenticating to Pentaho CDE User Console

$
0
0
Hi,

I get the following error when I try to open a report without logging in to Pentaho CDE User Console
Could not load dashboard: exception while getting tree rooted at path "/public/cde/components" Reference number: 3c9866d2-24da-4041-a737-5c5116c4a422

I had removed security/authentication for the report by making changes in the
applicationContext-spring-security.xml file as I need it to display on another website.
We have secured the report using reverse proxy.

Once I login to Pentaho CDE User Console, the error goes away and the report is displayed.
So in order to not encounter the error I need to first login to Pentaho User Console and then open the reports with the URL.

Has anyone encountered this error. And what could be its cause.

Thanks,
Delsie

GET XML only grabbing top element

$
0
0
Using the Get XML Data input and there are 1:n entries of <sku> under the <skus> element but it is only pulling the first sku in the list.

Using the xpath /catalog/product/skus

If I change the xp to /catalog/product/skus I can get all the skus but I am having trouble accessing any of nodes related to sku such as sku_name

<catalog>
<version>5</version>
<product>
<product_id>1</product_id>
<product_name>1911 C-MORE COMP MOUNT</product_name>
<product_url>http://www.brownells.com/optics-mounting/rings-mounts-amp-bases/handgun-bases/1911-c-more-comp-mount-prod1.aspx</product_url>
<product_image_url>http://www.brownells.com/userdocs/products/p_005100000_1.jpg</product_image_url>
<brand_name>ALLCHIN</brand_name>
<ffl_required>No</ffl_required>
<categories>
<category>
<category_id>10007</category_id>
<category_name>Optics &amp; Mounting</category_name>
</category>
<category>
<category_id>10129</category_id>
<category_name>Rings, Mounts &amp;amp; Bases</category_name>
</category>
<category>
<category_id>10253</category_id>
<category_name>Handgun Bases</category_name>
</category>
</categories>
<skus>
<sku>005100000</sku>
<sku_name>1911 AUTO C-MORE COMP MOUNT</sku_name>
<sku_description>U2luZ2xlIHNpZGUgZGVzaWduIGhlbHBzIGVsaW1p</sku_description>
<RetailPrice>89.9900</RetailPrice>
<SpecialPrice>0.0000</SpecialPrice>
<New_Item>No</New_Item>
<Rebate_Available>No</Rebate_Available>
<Clearance_Item>No</Clearance_Item>
<Sale_Item>No</Sale_Item>
<sku_availability>Out Of Stock</sku_availability>
<InventoryCount>0</InventoryCount>
<sku_url>http://www.brownells.com/optics-mounting/rings-mounts-amp-bases/handgun-bases/c-more-mount-sku005100000-1-33.aspx</sku_url>
<product_image_url>http://www.brownells.com/userdocs/skus/p_005100000_1.jpg</product_image_url>

</skus>
</product>
<product>
<product_id>8</product_id>
<product_name>LEVER ACTION LEVER SCOUT MOUNT</product_name>
<product_url>http://www.brownells.com/optics-mounting/rings-mounts-amp-bases/rifle-bases/lever-action-lever-scout-mount-prod8.aspx</product_url>
<product_image_url>http://www.brownells.com/userdocs/products/p_006000020_2.jpg</product_image_url>
<brand_name>XS SIGHT SYSTEMS</brand_name>
<ffl_required>No</ffl_required>
<categories>
<category>
<category_id>10007</category_id>
<category_name>Optics &amp; Mounting</category_name>
</category>
<category>
<category_id>10129</category_id>
<category_name>Rings, Mounts &amp;amp; Bases</category_name>
</category>
<category>
<category_id>10255</category_id>
<category_name>Rifle Bases</category_name>
</category>
</categories>
<skus>
<sku>006000020</sku>
<sku_name>ML-6000R-N MARLIN 1895 45-70 SCOUT MNT</sku_name>
<sku_description>TGlnaHR3ZWlnaHQsIFdlYXZlci1zdHlsZSBtb3Vu</sku_description>
<RetailPrice>45.0000</RetailPrice>
<SpecialPrice>0.0000</SpecialPrice>
<New_Item>No</New_Item>
<Rebate_Available>No</Rebate_Available>
<Clearance_Item>No</Clearance_Item>
<Sale_Item>No</Sale_Item>
<sku_availability>In Stock</sku_availability>
<InventoryCount>4</InventoryCount>
<sku_url>http://www.brownells.com/optics-mounting/rings-mounts-amp-bases/rifle-bases/marlin-1895-scout-mount-sku006000020-8-55.aspx</sku_url>
<product_image_url>http://www.brownells.com/userdocs/skus/p_006000020_2.jpg</product_image_url>

<sku>006000031</sku>
<sku_name>ML-6002R-N MARLIN 1894 SCOUT MOUNT</sku_name>
<sku_description>TGlnaHR3ZWlnaHQsIFdlYXZlci1zdHlsZSBtb3Vu</sku_description>
<RetailPrice>45.0000</RetailPrice>
<SpecialPrice>0.0000</SpecialPrice>
<New_Item>No</New_Item>
<Rebate_Available>No</Rebate_Available>
<Clearance_Item>No</Clearance_Item>
<Sale_Item>No</Sale_Item>
<sku_availability>In Stock</sku_availability>
<InventoryCount>8</InventoryCount>
<sku_url>http://www.brownells.com/optics-mounting/rings-mounts-amp-bases/rifle-bases/marlin-1894-scout-mount-sku006000031-8-64.aspx</sku_url>
<product_image_url>http://www.brownells.com/userdocs/skus/p_006000031_2.jpg</product_image_url>



</skus>
</product>
</catalog>

How to clear db cache for batch processes?

$
0
0
Recently we made a "minor" change on a database table. A char varying column was dropped and added again as an integer.

All scheduled jobs with a database lookup for this specific field as a key started to complain with an error stating no way to compare a char var with an integer.

For on-line transformations we solved the problem with Tools>>Clear cache ... but we couldn't find any way to do it for all scheduled jobs. So we decided to reboot the machine where the jobs run, hopping that restarting all services would do the trick.

Well, it doesn't!

Does this mean we have to open manually every single transaction and do a clear cache? Is this info stored on the transformation itself so no way to force a clear cache globally?

We would appreciate an explanation on how is this stored and how can we solve it. There are some dozen jobs afected, it's not a tremendous work, but easy to forget someone that will crash unexpectedly.

Thks

Date difference (Calculator gives me strange answers)

$
0
0
Hi everyone, I am a bit stick when it comes to the following that I am trying to do in a transformation.
I am trying to subtract 2 dates from each other and get the difference in days from this subtraction. Unfortunately I am getting a bad answer no matter what way I try it.

First, I tried by using the "calculator" and the date A - date B (in days) function. But I always seem to get 01-01-1970 as an answer, which you will see in the screenshots I provided is wrong.

Second, I tried by fooling the transformation into just taking the day number of the data portion and subtracting those from each other, however then I get an answer which is always correct but has always "+1" day.
I made sure my formatting of the date is according to the one used in my CSV file dd-mm-yy. Nevertheless, I still get these problems.

Please see my zip file for screenshots, as I tried to embed them into the post, but they were to small to make something out on for some reason (site compression?).

I am right now a bit stumped, do any one of you have any ideas?


Thanks in advance.
Attached Files

Enterprise Application Integration (EAI) possible with PDI?

$
0
0
EAI supports interoperability among different applications, and is mostly enabled through Web services or data services.

I wonder if PDI is a good tool to integrate different systems (i.e. ERP, Webshop, etc.).

What do you think?
Viewing all 16689 articles
Browse latest View live