Quantcast
Channel: Pentaho Community Forums
Viewing all 16689 articles
Browse latest View live

JSON Error

$
0
0
Here i am facing a problem with Json input step in pdi 6.1, which is already worked in pdi 6.0. I am trying to get the comments array from Json.

could you please tell me how can we fix in pdi-ce-6.1 version?
I am getting error as

"JSON Input.0 - ERROR (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49 by buildguy) : Unexpected Error : java.lang.ClassCastException: [B cannot be cast to java.lang.String".

Here i am attaching snapshot, describes the way comments array path defined in Json input step.
Attached Images

dynamically define which job is run in Job Executor

$
0
0
Hello all!

I have a transformation that first cleans up in some tables and based of the result of that cleansing figures out which Jobs need to be run to propagate these changes. More simple:
  1. get a list of all tables from metadata
  2. delete in these tables, often based on a timestamp value being older than a threshold
  3. if any rows were deleted, run a job that propagates the changes to the next data layer


So far, so good; after step 3 I got all the information I need: the Jobs that need to be run, the path to them and their names. I thought I'd now simply take the Job Executor step, feed it with the data in my stream and I'm done. Unfortunately, the Job Executor only accepts hard-coded Jobs or parameters but can't dynamically start a Job based on the row read from the stream.

Does anyone know a workaround?
Attached Images

Issues with passing variables from job to transformation

$
0
0
I am attempting to create a job that runs a transformation. I need to pass some variables down the the transformation from the job in order to send a file path for a property/xml file. I have tried everything I can think of but I cannot see the variable or get variable in the transformation after I have set the variable in the job. What am I doing wrong? I have been stuck on this part, I cannot find any instructions or examples on how to pass these down.

Any help is appreciated.

Edit crosstab

$
0
0
How do I edit a crosstab? When I right click on the crosstab in the structure panel and select "Edit Crosstab", I get a NullPointerException.

line chart

Converting MS-Access VBA code with recordsets to PDI steps

$
0
0
Hi! I'm seeking for help on basic conversion tips from subs written in Visual Basic for Applications (VBA) on Microsoft Access 2003 to PDI steps.
For example, the VBA code creates a recordset on a table, loops for all the records.
In that loop, the code reads the first record of a client number, work some conditions on columns and compares with values of the next record of that same client.
After, some of these records (with modifications) are written into another table (another recordset), and then loops on the records of another client.
I've done lots of reading (blogs), example testings from many books, but still haven't found what I was looking for.
The best I got, was to load (one Table Input per record) the infos of the records, "Multiway Merge Join" them into a Javascript step (Modified), in a 2 dimension array.
From this array, I could "convert" the loops and conditions, put the values of the table cells into variables to output them in a file (later on a table).
If Javascript is best to use (we have many ETLs to convert), a name of a useful GUI to write-debug-trace code would be nice to have.
I migrated my data from MS-Access to PostgreSQL and use PDI v6.0 Community Edition.
Thanks in advance for your support guys!

How to execute formula on excel output file on the excel fields/columns?

$
0
0
pentahoo.PNG
Want to implement the formula in column 'F' but pentaho doesn't allow excel fields to be used in the formula sheet but the fields from sql table that i have,any idea how this can be implemented?
Attached Images

Error Running a Job in Carte HTTP Status 401 - /kettle/registerJob/ - Unauthorized

$
0
0
Hi,

I am using Pentaho Community edition ver 6.

I am able to submit a Transformation from Spoon to my remote Carte server (slave) and it runs to completion.

However, submitting a Job that encompasses only this Transformation results in an error in Spoon: HTTP Status 401 - /kettle/registerJob/ - Unauthorized

I am unable to find any info on ways to troubleshoot.

error - org.pentaho.di.core.exception.KettleDatabaseException

$
0
0
I have gone over forums with my current error, and please help me understand what I need to change.

I have job that currently works by looking up database IPs and table names to perform extraction on 76 servers. I have converted this code to a new job, which performs table joins, because each server has four tables that I need but two different schemas ( tricky part!). I have managed to create variables and use a get variables step to inject the schema in my query as shown below:

before:
Select pa."PATNO",pa."RECTYP",pa."FILLRM",pa."ISADATE", pa."ISDDATE",pa."UDSTAT", pa."DCSTAT",pa."IATME",
pa."ISDOB", pa."SEX",pa."AGE", pa."PTYPE",pa."FINCL",pa."HSSVC", pa."HSTNUM", pa."AINS1",ins."INSNME", pa."DASTA",
pa."DIAGN", pa."DIAG9",pa."PDCD",pa."ODC1", pa."ODC2",pa."ODC3", pa."ODC4",pa."PPDESC",pa."PPDTE",
pa."OPC1",pa."OPC2",pa."OPD1",pa."OPD2",pa."PPDSC",pa."PREVAD",pa."ACLVL", pa."AVGLOS", pa."ADTYP",
pa."ADSRC",pa."OBSFLG",pa."ADTBY",pa."BILAMT",pa."INSYN",pa."INSTYP",pa."ATTPHY",pa."VIP", pa."DRG",
rx."UDSCHDT",rx."UDSCHTM",rx."UDADMDT",rx."UDADMTM",rx."UDENTDT",rx."UDENTTM",rx."UDFILLSTS",rx."UDADMDOSE",
rx."UDNDC",fm."FXGENNAME",fm."FXCOMNM",fm."FXMNDN",fm."FXROUTE",rx."UDFREQ",fm."FXIUM",fm."FXICF",fm."FXPCF",
fm."FXCHG",fm."FXBULK",fm."FXCLS",fm."FXCPR",fm."FXMNE",fm."FXRND",fm."FXDOSE",fm."FXDIUM",fm."FXSTORD",
fm."FXCHFL",fm."FXEXTMP",fm."FXEXTDAYS",fm."FXBCF",fm."FXMNDF",rx."UDSET#",rx."UDMULTI",rx."UDCGRP",
rx."UDHOLDSTS",rx."UDADMUN"
from "HOSPF${facility_variable}"."PATIENTS" pa
left join "ORDERF${facility_variable}"."RXUDTRAN" rx
on pa."PATNO" = rx."UDPAT#"
left join "ORDERF${facility_variable}"."RXFORXP" fm
on rx."UDNDC" = fm."FXNDC"
left join "HOSPF${facility_variable}"."INSPLAN" ins
on pa."AINS1" = ins."INSCO"
where pa."ISADATE" >= '01/01/15'
and pa."ISADATE" <= '12/31/15'


after:

2016/05/26 17:18:56 - Medhost_DOT_extraction.0 - ERROR (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49 by buildguy) : Unexpected error
2016/05/26 17:18:56 - Medhost_DOT_extraction.0 - ERROR (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49 by buildguy) : org.pentaho.di.core.exception.KettleDatabaseException:
2016/05/26 17:18:56 - Medhost_DOT_extraction.0 - An error occurred executing SQL:
2016/05/26 17:18:56 - Medhost_DOT_extraction.0 - Select pa."PATNO",pa."RECTYP",pa."FILLRM",pa."ISADATE", pa."ISDDATE",pa."UDSTAT", pa."DCSTAT",pa."IATME",
2016/05/26 17:18:56 - Medhost_DOT_extraction.0 - pa."ISDOB", pa."SEX",pa."AGE", pa."PTYPE",pa."FINCL",pa."HSSVC", pa."HSTNUM", pa."AINS1",ins."INSNME", pa."DASTA",
2016/05/26 17:18:56 - Medhost_DOT_extraction.0 - pa."DIAGN", pa."DIAG9",pa."PDCD",pa."ODC1", pa."ODC2",pa."ODC3", pa."ODC4",pa."PPDESC",pa."PPDTE",
2016/05/26 17:18:56 - Medhost_DOT_extraction.0 - pa."OPC1",pa."OPC2",pa."OPD1",pa."OPD2",pa."PPDSC",pa."PREVAD",pa."ACLVL", pa."AVGLOS", pa."ADTYP",
2016/05/26 17:18:56 - Medhost_DOT_extraction.0 - pa."ADSRC",pa."OBSFLG",pa."ADTBY",pa."BILAMT",pa."INSYN",pa."INSTYP",pa."ATTPHY",pa."VIP", pa."DRG",
2016/05/26 17:18:56 - Medhost_DOT_extraction.0 - rx."UDSCHDT",rx."UDSCHTM",rx."UDADMDT",rx."UDADMTM",rx."UDENTDT",rx."UDENTTM",rx."UDFILLSTS",rx."UDADMDOSE",
2016/05/26 17:18:56 - Medhost_DOT_extraction.0 - rx."UDNDC",fm."FXGENNAME",fm."FXCOMNM",fm."FXMNDN",fm."FXROUTE",rx."UDFREQ",fm."FXIUM",fm."FXICF",fm."FXPCF",
2016/05/26 17:18:56 - Medhost_DOT_extraction.0 - fm."FXCHG",fm."FXBULK",fm."FXCLS",fm."FXCPR",fm."FXMNE",fm."FXRND",fm."FXDOSE",fm."FXDIUM",fm."FXSTORD",
2016/05/26 17:18:56 - Medhost_DOT_extraction.0 - fm."FXCHFL",fm."FXEXTMP",fm."FXEXTDAYS",fm."FXBCF",fm."FXMNDF",rx."UDSET#",rx."UDMULTI",rx."UDCGRP",
2016/05/26 17:18:56 - Medhost_DOT_extraction.0 - rx."UDHOLDSTS",rx."UDADMUN"
2016/05/26 17:18:56 - Medhost_DOT_extraction.0 - from "HOSPF029"."PATIENTS" pa
2016/05/26 17:18:56 - Medhost_DOT_extraction.0 - left join "ORDERF029"."RXUDTRAN" rx
2016/05/26 17:18:56 - Medhost_DOT_extraction.0 - on pa."PATNO" = rx."UDPAT#"
2016/05/26 17:18:56 - Medhost_DOT_extraction.0 - left join "ORDERF029"."RXFORXP" fm
2016/05/26 17:18:56 - Medhost_DOT_extraction.0 - on rx."UDNDC" = fm."FXNDC"
2016/05/26 17:18:56 - Medhost_DOT_extraction.0 - left join "HOSPF029"."INSPLAN" ins
2016/05/26 17:18:56 - Medhost_DOT_extraction.0 - on pa."AINS1" = ins."INSCO"
2016/05/26 17:18:56 - Medhost_DOT_extraction.0 - where pa."ISADATE" >= '01/01/15'
2016/05/26 17:18:56 - Medhost_DOT_extraction.0 - and pa."ISADATE" <= '12/31/15'

If you notice in the error log, my schema name is correctly replaced, but that seems to be where the error is coming from.


2016/05/26 17:18:56 - Medhost_DOT_extraction.0 - offending row : [facility_variable String(3)]
2016/05/26 17:18:56 - Medhost_DOT_extraction.0 -
2016/05/26 17:18:56 - Medhost_DOT_extraction.0 - Error setting value #1 [String(3)] on prepared statement
2016/05/26 17:18:56 - Medhost_DOT_extraction.0 - Descriptor index not valid.

My current understanding is that Kettle prepares connection statements in advance and therefore when the schema name is applied that is throwing off the SQL query. Is this correct? How can I fix this?

Thanks

Slow ness in PDI-CE-6.1

$
0
0
Hi,

I am trying to open PDI application but it is very slow comparatively older versions(i.e. pdi-ce-6.0). Assuming because of more plug-ins added in latest version (6.1).

If it is NOT the case, could you please tell me how can i achieve this slowness issue.

windows,java 1.7, File repository,MySQL database.

Thanks,
Ranala

step REST Client doesn't work with self signed certificate

$
0
0
Hello,

I am running pdi-ce-6.1.0.1-196.
I have succeed to make work step REST Client with self signed certificate adding the certificate to the jre cacert
keytool -import -noprompt -trustcacerts -alias xxx -file xxx -keystore cacerts -storepass xxx

It does work perfectly when I launch the transformation from spoon locally but it doesn't work when I execute it on a carte server (which is running on the same server so that uses the same java).

2016/05/27 10:07:51 - REST Client 2 2.0 - ERROR (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49 by buildguy) : Because of an error, this step can't continue:
2016/05/27 10:07:51 - REST Client 2 2.0 - Can not result from [https://url.com/aaa]
2016/05/27 10:07:51 - REST Client 2 2.0 - javax.net.ssl.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
2016/05/27 10:07:51 - REST Client 2 2.0 - ERROR (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49 by buildguy) : org.pentaho.di.core.exception.KettleException:
2016/05/27 10:07:51 - REST Client 2 2.0 - Can not result from [https://url.com/aaa]
2016/05/27 10:07:51 - REST Client 2 2.0 - javax.net.ssl.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
2016/05/27 10:07:51 - REST Client 2 2.0 -
2016/05/27 10:07:51 - REST Client 2 2.0 - at org.pentaho.di.trans.steps.rest.Rest.callRest(Rest.java:229)
2016/05/27 10:07:51 - REST Client 2 2.0 - at org.pentaho.di.trans.steps.rest.Rest.processRow(Rest.java:449)
2016/05/27 10:07:51 - REST Client 2 2.0 - at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)
2016/05/27 10:07:51 - REST Client 2 2.0 - at java.lang.Thread.run(Thread.java:745)
2016/05/27 10:07:51 - REST Client 2 2.0 - Caused by: com.sun.jersey.api.client.ClientHandlerException: javax.net.ssl.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
2016/05/27 10:07:51 - REST Client 2 2.0 - at com.sun.jersey.client.apache.DefaultApacheHttpMethodExecutor.executeMethod(DefaultApacheHttpMethodExecutor.java:213)
2016/05/27 10:07:51 - REST Client 2 2.0 - at com.sun.jersey.client.apache.ApacheHttpClientHandler.handle(ApacheHttpClientHandler.java:175)
2016/05/27 10:07:51 - REST Client 2 2.0 - at com.sun.jersey.api.client.Client.handle(Client.java:648)
2016/05/27 10:07:51 - REST Client 2 2.0 - at com.sun.jersey.api.client.WebResource.handle(WebResource.java:680)
2016/05/27 10:07:51 - REST Client 2 2.0 - at com.sun.jersey.api.client.WebResource.access$200(WebResource.java:74)
2016/05/27 10:07:51 - REST Client 2 2.0 - at com.sun.jersey.api.client.WebResource$Builder.post(WebResource.java:568)
2016/05/27 10:07:51 - REST Client 2 2.0 - at org.pentaho.di.trans.steps.rest.Rest.callRest(Rest.java:173)
2016/05/27 10:07:51 - REST Client 2 2.0 - ... 3 more
2016/05/27 10:07:51 - REST Client 2 2.0 - Caused by: javax.net.ssl.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target



Does anyone know how to debug it or/and to make it work?

Thank you.

Erwan

How to run Pentaho Data Integration 5.2 job file from windows batch file?

$
0
0
Dear All,

I am working on Pentaho Data Integration 5.2.
I have installed Pentaho Data Integaration 5.2 software on Microsoft Windows Server 2008 Enterprise
Here, what I have to do is that, I have created a pentaho job file in PDI 5.2. Also, I have created the windows batch file.
Problem is,I don't know the commands to run pentaho job file from batch file.
However, I have made an attempt to create a batch file wherein commands to run pentaho job files have been discovered. But it seems to be
errorneous. Below is the given listing of commands used in batch file:-
c:
cd /d "C:\Users\batchopr\Desktop\data-integration\"
call Kitchen.bat /file:D:\EDELCAP\MIS\Dedupe\DEDUPE_MAIN.kjb -
logfile=D:\EDELCAP\MIS\Dedupe\DEDUPE_MAIN.txt
exit

This needs to be rectified.

I request to provide assistance on the above mentioned problem statement or any new suggestions are welcomed.

Thanks in advance.

Yours Sincerely,
Swati Chari

Save Transformation level error in Database table

$
0
0
Hi everybody,

(Case)
1. Have a one transformation and save it
2. Add table input step (have enabled database connection)
3. use any wrong query "select * from temp"
4. save and execute transformation
5. Of course here we will have error visible in red color

Code:

2016/05/27 18:33:42 - Spoon - Save as...2016/05/27 18:33:42 - Spoon - Save file as...
2016/05/27 18:33:58 - Spoon - Save as...
2016/05/27 18:33:58 - Spoon - Save file as...
2016/05/27 18:34:13 - Spoon - Transformation opened.
2016/05/27 18:34:13 - Spoon - Launching transformation [z_delete]...
2016/05/27 18:34:13 - Spoon - Started the transformation execution.
2016/05/27 18:34:13 - z_delete - Dispatching started for transformation [z_delete]
2016/05/27 18:34:13 - Table input.0 - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : Unexpected error
2016/05/27 18:34:13 - Table input.0 - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : org.pentaho.di.core.exception.KettleDatabaseException:
2016/05/27 18:34:13 - Table input.0 - An error occurred executing SQL:
2016/05/27 18:34:13 - Table input.0 - select * from temp
2016/05/27 18:34:13 - Table input.0 - Invalid object name 'temp'.
2016/05/27 18:34:13 - Table input.0 -
2016/05/27 18:34:13 - Table input.0 -    at org.pentaho.di.core.database.Database.openQuery(Database.java:1722)
2016/05/27 18:34:13 - Table input.0 -    at org.pentaho.di.trans.steps.tableinput.TableInput.doQuery(TableInput.java:224)
2016/05/27 18:34:13 - Table input.0 -    at org.pentaho.di.trans.steps.tableinput.TableInput.processRow(TableInput.java:138)
2016/05/27 18:34:13 - Table input.0 -    at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)
2016/05/27 18:34:13 - Table input.0 -    at java.lang.Thread.run(Thread.java:745)
2016/05/27 18:34:13 - Table input.0 - Caused by: java.sql.SQLException: Invalid object name 'temp'.
2016/05/27 18:34:13 - Table input.0 -    at net.sourceforge.jtds.jdbc.SQLDiagnostic.addDiagnostic(SQLDiagnostic.java:368)
2016/05/27 18:34:13 - Table input.0 -    at net.sourceforge.jtds.jdbc.TdsCore.tdsErrorToken(TdsCore.java:2820)
2016/05/27 18:34:13 - Table input.0 -    at net.sourceforge.jtds.jdbc.TdsCore.nextToken(TdsCore.java:2258)
2016/05/27 18:34:13 - Table input.0 -    at net.sourceforge.jtds.jdbc.TdsCore.getMoreResults(TdsCore.java:632)
2016/05/27 18:34:13 - Table input.0 -    at net.sourceforge.jtds.jdbc.JtdsStatement.executeSQLQuery(JtdsStatement.java:477)
2016/05/27 18:34:13 - Table input.0 -    at net.sourceforge.jtds.jdbc.JtdsStatement.executeQuery(JtdsStatement.java:1304)
2016/05/27 18:34:13 - Table input.0 -    at org.pentaho.di.core.database.Database.openQuery(Database.java:1711)
2016/05/27 18:34:13 - Table input.0 -    ... 4 more
2016/05/27 18:34:13 - Table input.0 - Finished reading query, closing connection.
2016/05/27 18:34:13 - Table input.0 - Finished processing (I=0, O=0, R=0, W=0, U=0, E=1)
2016/05/27 18:34:13 - z_delete - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : Errors detected!
2016/05/27 18:34:13 - Spoon - The transformation has finished!!
2016/05/27 18:34:13 - z_delete - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : Errors detected!
2016/05/27 18:34:13 - z_delete - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : Errors detected!
2016/05/27 18:34:13 - z_delete - Transformation detected one or more steps with errors.
2016/05/27 18:34:13 - z_delete - Transformation is killing the other steps!
2016/05/27 18:34:34 - Spoon - Save as...
2016/05/27 18:34:34 - Spoon - Save file as...

Requirement:
I want to save the error (generated above), along with transformation name and stepname in a database table.


Please help how can i achieve this

Geospatial query

$
0
0
I have a geospatial table like this:

Attribute | Latitude | Longitude

I have a polygon with 4 vertexes. I know the coordinates (latitude and longitude) of each vertex.

I need to extract from my table only the rows which coordinates are inside the polygon.

It is possible using Kettle?

Thanks in advance!

Unique rows

$
0
0
How to select the second match of unique rows?

rec# id name address group_number
5 1 abc xyz 1
6 1 abc jkl 1
5 2 abc xyz 1
6 2 abc jkl 1

From the above scenario I need the bold one

Cheers,
Harris

Saiku: Error executing query. Please check the server logs or contact your administra

$
0
0
I created my cube with Schema Workbench and published it successfully to "SampleData". But, when I try to open it in Saiku and create some scenarios, I get this error: "error executing query. Please check the server logs or contact your administrator!"

Please find in the attachment the server logs.

Please I need your help.
Attached Files

PDF Renderer Margins

$
0
0
PUC generates PDFs of reports with really wide margins (1" +). I want to reduce the margins. Any ideas how I might be able to do so?

Pre-selected value in FilterComponent

$
0
0
Hi,

I'm using FilterComponent in my dashboard and in some cases it should have a pre-selected value. I have tried leaving the parameter value empty as it works with SelectComponent. But it didn't work with FilterComponent. So the parameter is set, but the user tends to think it's not as the FilterComponent has no selection.

Is there any way to set it up?

Thanks in advance.

CDE table component export to excel

$
0
0
Hi all,

I have an export button to export a table component to excel.
My question is, in the excel i exported the column name is the original name in sql database instead of the name i assign in the SQL query.
Is there any way i can change the column name before exporting?

Thanks!

"" was unexpected at this time

$
0
0
Hello,
I'm trying to run Pentaho CE pdi-ce-6.1.0.1-196 on Windows 7 64 bit desktop but when I execute Spoon.bat the command window flash very quickly and nothing happens. Running SpoonDebug.bat, I see the following line:

Files\Java\jre1.8.0_92\bin\javaw.exe"" was unexpected at this time.

The pdi-ce-6.1.0.1-196.zip was downloaded and then extracted to C:\data\data-integration.
Java version: jre1.8.0_92

I looked on this forum and just Googled and it looks like the issue is with the path but none of the suggestions seem to help. Anything else I should try to troubleshoot this?

It looks like the path to the Java JRE is being cut off. I tried to specify this by updating the environment variables but none of the attempts worked. Environment path settings I tried but did not work.

PENTAHO_JAVA=javaw.exe
PENTAHO_JAVA=java.exe
PENTAHO_JAVA=C:\Program Files\Java\jre1.8.0_92\bin\javaw.exe
PENTAHO_JAVA=C:\Progra~1\Java\jre1.8.0_92\bin\javaw.exe

Thanks in advance.
Ho
Viewing all 16689 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>