Quantcast
Channel: Pentaho Community Forums
Viewing all 16689 articles
Browse latest View live

HBase connection

$
0
0
Hi,

I'm using GA release 5.4.0.1-130
when I'm trying to configure / use hbase input I've got following error message
Not a host:port pair:

As I'm understand this is compatibility problem between client (Pentaho PDI) in this case and zookeeper

I've seen some suggestion in replacing jar files in pentaho big_data plugin in order to make it work, have not tried it because
1. they was not very clear
2. source did not look reliable

I can not change production zookeeper installation, so my only option to reconfigure pdi

does anyone have any suggestion ?

thx

Ilia

ConnectionServiceimpl.ERROR_0009 Ubuntu Server

$
0
0
Good afternoon

I 'm trying to implement Community Pentaho BI server in my company, but I had problems when creating data sources to MySQL. ConnectionServiceimpl.ERROR_0009 : When I try to create a Connection error me .

This implementation 'm doing on a ubuntu server and JDK 1.7.0 installed and already installed and configured libmysql -java start-pentaho.sh the beginning of that origin. I do not know what else to do. I appreciate your help

CTOOLS:LineChart:Dual Layered X-Axis :How can I create one?

$
0
0
All,

I using Pentaho 5.4 with the latest version of CTOOLs.

I am trying have my X-Axis in my Line Chart being dual layered like below. This is a fairly common feature in MS Excel, and we trying to convert these from Excel Graphs to a graph generated by CTOOLS. Any Idea on how make my X-Axis look like the below?


NumberofSurveys: 15 Surveys 20 Surveys 25 Surveys
Months: August-2015 September-2015 October-2015

Note: I would not need to say "Months:" nor "Number of Surveys" those are just the names of the columns, but I just need it show the values.

troubleshooting Table out Bulk Insert error

$
0
0
Greetings,

I have a Kettle ETL running transformations between tables in a MSSQL server.

Everything appears to be working, but on record 720,000, it errors out with this error:

2015/08/11 19:37:14 - Table output.0 - Connected to database [buyerhero] (commit=1000)
2015/08/11 19:37:33 - Table output.0 - linenr 50000
2015/08/11 19:37:40 - Table output.0 - linenr 100000
2015/08/11 19:37:47 - Table output.0 - linenr 150000
2015/08/11 19:37:54 - Table output.0 - linenr 200000
2015/08/11 19:38:01 - Table output.0 - linenr 250000
2015/08/11 19:38:08 - Table output.0 - linenr 300000
2015/08/11 19:38:16 - Table output.0 - linenr 350000
2015/08/11 19:38:25 - Table output.0 - linenr 400000
2015/08/11 19:38:34 - Table output.0 - linenr 450000
2015/08/11 19:38:42 - Table output.0 - linenr 500000
2015/08/11 19:38:50 - Table output.0 - linenr 550000
2015/08/11 19:38:58 - Table output.0 - linenr 600000
2015/08/11 19:39:05 - Table output.0 - linenr 650000
2015/08/11 19:39:13 - Table output.0 - linenr 700000
2015/08/11 19:39:16 - Table output.0 - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : Because of an error, this step can't continue:
2015/08/11 19:39:16 - Table output.0 - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : org.pentaho.di.core.exception.KettleException:
2015/08/11 19:39:16 - Table output.0 - Error batch inserting rows into table [PropertyParameters].
2015/08/11 19:39:16 - Table output.0 - Errors encountered (first 10):
2015/08/11 19:39:16 - Table output.0 - Arithmetic overflow error converting expression to data type int.
2015/08/11 19:39:16 - Table output.0 -
2015/08/11 19:39:16 - Table output.0 -
2015/08/11 19:39:16 - Table output.0 - Error updating batch
2015/08/11 19:39:16 - Table output.0 - Data truncation
2015/08/11 19:39:16 - Table output.0 -
2015/08/11 19:39:16 - Table output.0 -
2015/08/11 19:39:16 - Table output.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable(TableOutput.java:342)
2015/08/11 19:39:16 - Table output.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.processRow(TableOutput.java:118)
2015/08/11 19:39:16 - Table output.0 - at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)
2015/08/11 19:39:16 - Table output.0 - at java.lang.Thread.run(Unknown Source)
2015/08/11 19:39:16 - Table output.0 - Caused by: org.pentaho.di.core.exception.KettleDatabaseBatchException:
2015/08/11 19:39:16 - Table output.0 - Error updating batch
2015/08/11 19:39:16 - Table output.0 - Data truncation
2015/08/11 19:39:16 - Table output.0 -
2015/08/11 19:39:16 - Table output.0 - at org.pentaho.di.core.database.Database.createKettleDatabaseBatchException(Database.java:1386)
2015/08/11 19:39:16 - Table output.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable(TableOutput.java:289)
2015/08/11 19:39:16 - Table output.0 - ... 3 more
2015/08/11 19:39:16 - Table output.0 - Caused by: java.sql.BatchUpdateException: Data truncation
2015/08/11 19:39:16 - Table output.0 - at net.sourceforge.jtds.jdbc.JtdsStatement.executeBatch(JtdsStatement.java:947)
2015/08/11 19:39:16 - Table output.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable(TableOutput.java:285)
2015/08/11 19:39:16 - Table output.0 - ... 3 more
2015/08/11 19:39:16 - Table output.0 - Finished processing (I=0, O=719999, R=720000, W=719000, U=0, E=1)

I don't know what the problem is. How do I troubleshoot?
Thank you.

How to generate CSV using table input

$
0
0
Hi guys could you help me out with how to generate a csv file using a table input. The table is being extracted from an existing database using sql. I want to transform it into a csv file. the verison i am usin g is 5.4.0.1-130

Error while running a spoon job in java

$
0
0
Hi,

I have developed a job in spoon GUI(PDI-5.4.0.1). The job has only three transformations interconnected with each other.I am getting the following error while running the job through java:
Couldn't find starting point in this job.

Launching a job through spoon always allows me to define the starting point in the launch window but I am unable to set the value through java.

Please help

Error while get mail by imap on kettle

$
0
0
Hi,

I would like to receive mail using IMAP SSL protocol.
When i test it on localhost i have no problem (i'm using outlook imap), but when i test it on my pentaho server (using my imap server), i have this error :

Code:

2015/08/12 08:08:11 - Kitchen - Start of run.
2015/08/12 08:08:16 - test_mail - Start of job execution
2015/08/12 08:08:16 - test_mail - Starting entry [Get mails (POP3/IMAP)]
2015/08/12 08:08:18 - Get mails (POP3/IMAP) - ERROR (version 5.3.0.0-213, build 1 from 2015-02-02_12-17-08 by buildguy) : Unexpected error:
2015/08/12 08:08:18 - Get mails (POP3/IMAP) - Error while connecting to host [server imap] with username [user] on port [993].
2015/08/12 08:08:18 - Get mails (POP3/IMAP) - sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
2015/08/12 08:08:18 - Get mails (POP3/IMAP) - ERROR (version 5.3.0.0-213, build 1 from 2015-02-02_12-17-08 by buildguy) : org.pentaho.di.core.exception.KettleException:
2015/08/12 08:08:18 - Get mails (POP3/IMAP) - Error while connecting to host [server imap] with username [user] on port [993].
2015/08/12 08:08:18 - Get mails (POP3/IMAP) - sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at org.pentaho.di.job.entries.getpop.MailConnection.connect(MailConnection.java:318)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at org.pentaho.di.job.entries.getpop.JobEntryGetPOP.execute(JobEntryGetPOP.java:976)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at org.pentaho.di.job.Job.execute(Job.java:716)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at org.pentaho.di.job.Job.execute(Job.java:859)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at org.pentaho.di.job.Job.execute(Job.java:532)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at org.pentaho.di.job.Job.run(Job.java:424)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) - Caused by: javax.mail.MessagingException: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target;
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  nested exception is:
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  javax.net.ssl.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at com.sun.mail.imap.IMAPStore.protocolConnect(IMAPStore.java:670)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at javax.mail.Service.connect(Service.java:295)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at javax.mail.Service.connect(Service.java:176)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at javax.mail.Service.connect(Service.java:125)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at org.pentaho.di.job.entries.getpop.MailConnection.connect(MailConnection.java:305)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  ... 5 more
2015/08/12 08:08:18 - Get mails (POP3/IMAP) - Caused by: javax.net.ssl.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at sun.security.ssl.Alerts.getSSLException(Unknown Source)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at sun.security.ssl.SSLSocketImpl.fatal(Unknown Source)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at sun.security.ssl.Handshaker.fatalSE(Unknown Source)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at sun.security.ssl.Handshaker.fatalSE(Unknown Source)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at sun.security.ssl.ClientHandshaker.serverCertificate(Unknown Source)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at sun.security.ssl.ClientHandshaker.processMessage(Unknown Source)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at sun.security.ssl.Handshaker.processLoop(Unknown Source)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at sun.security.ssl.Handshaker.process_record(Unknown Source)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at sun.security.ssl.SSLSocketImpl.readRecord(Unknown Source)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at sun.security.ssl.SSLSocketImpl.performInitialHandshake(Unknown Source)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at com.sun.mail.util.SocketFetcher.configureSSLSocket(SocketFetcher.java:549)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at com.sun.mail.util.SocketFetcher.createSocket(SocketFetcher.java:354)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at com.sun.mail.util.SocketFetcher.getSocket(SocketFetcher.java:211)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at com.sun.mail.iap.Protocol.<init>(Protocol.java:116)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at com.sun.mail.imap.protocol.IMAPProtocol.<init>(IMAPProtocol.java:115)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at com.sun.mail.imap.IMAPStore.newIMAPProtocol(IMAPStore.java:685)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at com.sun.mail.imap.IMAPStore.protocolConnect(IMAPStore.java:636)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  ... 9 more
2015/08/12 08:08:18 - Get mails (POP3/IMAP) - Caused by: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at sun.security.validator.PKIXValidator.doBuild(Unknown Source)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at sun.security.validator.PKIXValidator.engineValidate(Unknown Source)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at sun.security.validator.Validator.validate(Unknown Source)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at sun.security.ssl.X509TrustManagerImpl.validate(Unknown Source)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at sun.security.ssl.X509TrustManagerImpl.checkTrusted(Unknown Source)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at sun.security.ssl.X509TrustManagerImpl.checkServerTrusted(Unknown Source)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  ... 24 more
2015/08/12 08:08:18 - Get mails (POP3/IMAP) - Caused by: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at sun.security.provider.certpath.SunCertPathBuilder.engineBuild(Unknown Source)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  at java.security.cert.CertPathBuilder.build(Unknown Source)
2015/08/12 08:08:18 - Get mails (POP3/IMAP) -  ... 30 more
2015/08/12 08:08:18 - test_mail - Starting entry [Write to file 2]
2015/08/12 08:08:18 - test_mail - Finished job entry [Write to file 2] (result=[true])
2015/08/12 08:08:18 - test_mail - Finished job entry [Get mails (POP3/IMAP)] (result=[true])
2015/08/12 08:08:18 - test_mail - Job execution finished
2015/08/12 08:08:18 - Kitchen - Finished!
2015/08/12 08:08:18 - Kitchen - Start=2015/08/12 08:08:11.996, Stop=2015/08/12 08:08:18.942
2015/08/12 08:08:18 - Kitchen - Processing ended after 6 seconds.

So what i did is :
Create IMAP certificate and insert it in a new keystore (named pentaho.jks)

I think we have to configure a tomcat connector located in server.xml file, but i don't know how to configure this connector.

Does somebody have any idea ?

Cheers !

Thibaud

Refresh data after I select all select components

$
0
0
Is it possible that:
For example I hava tree select components in my CDE, like yearSelect , monthSelect and dateSelect; I want CDE refresh data after I select all three select components rather than refresh data immediately after I select yearSelect or monthSelect or dataSelect.



It will be of great help if u provide solution step wise/with example.
Thanks in advance.


CDE TUTORIAL


How can we using DB Functions (Concat, Datepart, etc)

$
0
0
Hi All,

I am new to Pentaho. I have installed the trail version and trying to create a basic report.
My DB is Oracle XE 11 R2 and I was trying to concatenate firstname and lastname in Pentaho Metadata Editor (PME).
Unfortunately I was not able to find any way to perform this action.
Any kind of answers are appreciated.

Thank you

Error processing an XML using "GetDataFromXML" step when xml contains multiple CDATA

$
0
0
Hi,

Can anyone suggest me a way to process an XML which contains multiple CDATA in it. One such problematic record set is given below:

<fields-list>
<field id="id001" type="TEXT" name="Username">
<field-value>
<value><![CDATA[<city><![CDATA[<name>Chennai</name>]]></city>]]>
</value>
</field-value>
</field>
</fields-list>


Note: As per the standard XML convention, if the closing delimiter of inner CDATA "]]>" symbol is replaced by "]]&gt;" then everything works fine. However the challenge is I cannot just find and replace "]]>" with "]]&gt;" as this the <value> tag content is populated by user input on a text-area field which in turn is fitted into this XML template. So the input keyed in by user can prone to be a buggy input when compared against the XML standards.

Having said that "get data from xml" does not allow me to fetch the content in the value tag when such an input is provided by the user. Also even when the "Validate xml?" option is turned off, still the validation is performed by this pentaho step and it is resulting into error due to this buggy format.

Can anyone assist on how to address this issue ?


Many Thanks

Optimizing XML input --- Using Get XML vs. REST client

$
0
0
My challenge is I want to get 30 XML documents per day into a SQL database as quickly as possible. The exact output is unimportant for this question.


The XML documents are located/ accessible via a web URL, and passing authentication parameters.


I can accomplish this using the "Get data from XML" or "Rest client" step (followed by XML input).


Advantages of the XML step: I can get 30 pages at at a time. It allows the input of an unlimited number of URL sources.

Disadvantage: Serial processing ... is fetches and parses each document before moving to the next. It's much slower. Multiple copies won't help because the 'fetching' is required to be serial by the application -- it's the 'parsing' that is sequential vs. parallel.



REST Client step -- the advantage of this step is that it takes 1 second to fetch the whole document. I can have a dozen Rest client steps fetch sequential XML pages, and pass them to ONE XML parsing step which will parse everything at once. The entire process is almost 10x faster.


Disadvantage: Reaping the benefit of this requires me to have 7 (weekly) or 30 REST client steps in Pentaho's visual interface --- a confusing mess to look at and maintain.


Now, I CAN pass the URL via a field. Maybe that would help me ... a field of 30 values passed through a single REST step.

But then my question is ... how do I generate such a field?

I mean ... say I just want to generate a dummy field that is just sequential integers, like 1,2,3,4,5,6,7 ..... I don't see such a step in Pentaho. Looks like you can have a single constant, or a random number, but not something sequential or based on row number, etc. Right?

Any thoughts welcome.

ETL Metadata Injection problems running in kitchen

$
0
0
I have a job which executes successfully when run in Spoon, but fails when executed in kitchen.bat. I've traced the error to a Text File Input step that has field attributes passed by ETL Metadata Injection. Field names preceding the ETL Metadata Injection step are fine, but are "missing" after execution of the Text File Input step. Furthermore, the Text File Input step reads the correct number of records, but field names are null.

Does anyone know if this is a known issue or have an idea for a work around?

Thanks,

PDI 5.3
Windows

Embedded Report App unable to render bar chart

MySql query to make CCC bar chart in Community Edition Dashboard

$
0
0
All the help so far i have found is using MDX datasource query, nothing mentions about using MySql to generate charts, i can make a query but don't know how to integrate it with the chart then. how to define Value Columns, Category Columns, Series???

Please help in this regard
Shahzad:(

Get files with FTPS

$
0
0
Hi,

strait to problem: I am trying to download maybe 100 xlsx files from cloud. When I run Get files with FTPS step the download begins but on random file it stops and sais PIPE NOT CONNECTED ERROR. BUT it only happens sometime, not every job run. It is like connection dropped in the middle of download but I am on very stable internet connection and downloading using another client is always OK.
This is only happening when I am running job on local machine. Never happen on server yet.

Image of a error:
http://imgur.com/53zkPOC

Any help appreciated.

EDIT1: OK I take it back, now it happens every time after 3-4 files downloaded :/
Attached Images

How to set time-period-type setting dynamically??

$
0
0
Dear Forum,

I have a XY-Line chart crated by Pentaho Report Designer.
And I used Time Series collector.

In this collector, there is "time-period-type" property and we can set "hour, minutes, millisecond,year, etc".
I would like to set this property dynamically.

If anyone knows about it, please let me know.

Thank you and regards,
Kyi

Different flow for different types of error in a step

$
0
0
Hi,

I have a transformation which copies rows from Table Input A to Table Output B. I want to have a error handling step with Table Output B in such a way that different types of error has different flow.
For example,
1) If the error is due to data length in Table Output B, I want to write in a log file.
2) If the error is due to null values in not null column in Table Output B, I want to update a table C.

How can I achieve this?

How to export to Excel

$
0
0
Hi Guys,
Anyone have found an answer to this?
I have the same situation and cannot find a solution!

Pasing parameters when scheduling a Report

$
0
0
I need to schedule a report by using the scheduling API.
The following link is a sample of what I need to do, but I can't figure out how to set the parameters for the report.

https://help.pentaho.com/Documentati...duler_job.html

Where do I put the report parameters in this xml structure?
Can anybody point me to an example for this?
thank you

ORA-28040: No matching authentication protocol using Kettle 3.2

$
0
0
Hi,

Could you please help me regarding below issue. using Oracle 11.2.0.1.0 - 64bit Production, PDI -CE-3.2.0, java 1.8 getting below issue.

Error occurred while trying to connect to the database
Error connecting to database: (using class oracle.jdbc.driver.OracleDriver)
ORA-28040: No matching authentication protocol



i have added below items in sql.net ora file as well but no luck . i have tried with ojdbc14,ojdbc5, ojdbc6.jar files as well.

SQLNET.ALLOWED_LOGON_VERSION_CLIENT = 8

SQLNET.ALLOWED_LOGON_VERSION = 8

Thank you
Viewing all 16689 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>