Quantcast
Channel: Pentaho Community Forums
Viewing all 16689 articles
Browse latest View live

get data from .csv files which are online

$
0
0
Hi ,

I have a requirment to get data from .csv files which are online.

eg https://myserver.name.co.us/csv/

I have username/password of the above location.

There are many .csv files.
How do i do this. Which transform should I use ? What will be the source transform in PDI ?
A detail answer which examples will be of great help.

Thanks in advance
V

Single XML to be split into different tables

$
0
0
:oHi,

I have attached XML where I need to convert this into multiple tables.How do I do it and what are the transactions i need to pass.Can anyone help me out in this.
Attached Files

Could not load WSDL file:

$
0
0
I am trying the Currency Converter which is provided in ..\data-integration\samples\transformations folder.
But it gives me following error.


Unable to load WSDL from specified URL to extract the URL service
2016/08/24 12:36:50 - Web services lookup.0 - Could not load WSDL file:
2016/08/24 12:36:50 - Web services lookup.0 - java.net.ConnectException: Connection refused: connect
2016/08/24 12:36:50 - Web services lookup.0 - Connection refused: connect

Please let me know what is that?

Unable to connect Redshift to Pentaho Report Designer

$
0
0
We are unable to connect redshift to Pentaho Report Designer .


Attached is the error screenshot we get while connectig


I am using Pentaho Report Designer 1.7.0 and the driver selected is com.mysql.jdbc.Driver


Please let us know how can we connect this.

Redshift-error-pic.jpg
Attached Images

To Create job and tranformation dependencies.

$
0
0
I come across new requirement from my client,

I am trying to create job and transformation dependencies by using job control table(audit table maintain transformation or jobs final status)
Means transformation 2 will start after transformation 1 will successful compete. means transformation excute will depends on previous status of trasforatmion.

like
1.if transformation 1 failed then job will abort and job runnig status will save in audit table
2. when transformation 1 successes then only transformation 2 will start based status value in audit table.

pleas suggest approach.

Thanks I advance....

Pentaho 4.4.* vs 5.* minimal logging level difference

$
0
0
Hi,

I noticed that there is a difference between minimal logging level of pentaho jobs in Pentaho 5.* compared to Pentaho 4.4.*.
For example in 4.4:

4.jpg

While in Pentaho 5:

5.jpg

The difference is that in Pentaho 4 with minimal logging the names of the transformations and jobs executes in the current job are printed while in Pentaho 5 they are not.
This is major issue in our migration project.

Does anyone know if this is by design or it is a bug?

Thanks for your help.

Regards
Attached Images

FYI: useful help page on PDI Performance Tuning Tips

$
0
0
I was taking a stroll through the 6.1 server documentation and found this lovely page chock full o' PDI performance tuning tips.

URL: https://help.pentaho.com/Documentati...P0/100/040/010

(Documentation > 6.1 > Administer Pentaho Systems > Optimize BA Server Performance > PDI Performance Tuning Tips)

I may have glanced at this when first evaluating PDI, however it didn't "stick" -- going through this now shows a wealth of great context for writing transformations effectively.

Passing this along in case others are in a similar boat (RTFM, adam!) -- many of these tips are simple one-offs that can easily become standard practice, once they're identified.

Excel Export - CDE - Thousand Separator formatting

$
0
0
Good afternoon,

I've been looking around but havent found a solution for my problem.

I've sucessfully implemened the export component with my tables and charts to export to Excel.
But the issue is that the formatting is in US format "#.###,##", and my company is requesting that I change this to "#.###,##". Is there anyway I can force the excel export to use european standarts?

Best regards,
Marco Damião

carte server memory limitation and utilization

$
0
0
Hi Team,

I have a Linux box with 128GB RAM. 2 Carte Servers (of similar config) need to be up and running. At run time it will be decided which Pentaho Job will run on which carte server. Assuming this Linux box is completely dedicated for executing pentaho jobs ( and nothing else runs on it ) need clarifications on below points.

1. What are the ideal memory configuration for each carte server?
2. Is there any max limit for carte servers memory? Like it shouldn't be more than 24GB or 32GB or so...
3. Is there any limitation on max memory usage? Like if a carte server has 24GB, then usage should not exceed 18GB (75%) or so...

Other Issues :
Able to see some issue with respect to memory leakage in carte. Even when all jobs have completed, JVM statistics show high memory usage.
Garbage collection happens only after reaching certain limit, is there a way handle garbage collection in a better way?
Also when Garbage Collection is running, job execution becomes very very slow.

Regards,
Malleshwar

Execute Pentaho Jobs on Apache / Apache Tomcat

$
0
0
Hi Team,

As we can execute Pentaho Jobs on carte server without using any DB as repository, is there a way to execute them on existing Apache / Apache Tomcat servers without configuring a DB repository?If yes then how to configure the Apache Server to run Pentaho Jobs?

Regards,
Malleshwara

Concat two strings

$
0
0
Hi All,

This is the issue i am facing.

PDE 5.2.0


q.JPG

Table input >>> CSV output

these are the two fields i need to concatenate and put it in a single field called ENGDESC.


var engdesc = designation2 + " " + variant_description2;

desired output = BUTEE "SOUPLE"
Output Now = "BUTEE ""SOUPLE"""

Please help as i don't know why these extra double quotes are coming. ?? And how to eliminate those

Chinmaya
Attached Images

copy rows is not working

$
0
0
Hi ...

my job that i want to implement : Fetch a column from a table that consists of schema names that you have in your DB, make this as a variable, further use this variable in an input table, to call a table that is present in those schemas and populate an output table which would have data from all those schemas.

I am a new user of pentaho. I have an Job wherein I have to fetch the rows from a table, this table consists of a column that enlists my schema names that I am using in my Oracle Database, further to that I have to use this column that holds schema names that I fetched from the previous step as variables so that i can call a table present in these schemas and load it to the target table. I have used the 'copy rows' feature to fetch the rows from the table, and I
have assigned the column as my variable(this sums up my 1st transformation) .Next to this I created a new transformation in which I have used input table I gave all the necessary connections and here while fetching the table from the database I passed a query: select * from ${variable}.table_name. this query is not fetching me any table as the variable that I have set in the previous transformation is not fetching the rows as a result my output table is not getting populated. I have given all my tables same connection to my master schema. (in my Oracle Database the tables from different schemas can be fetched from my master schema ).

I need help to solve this problem.

I am hereby attaching my KTRs and my Job
Attached Files

Remove security from Pentaho 6.1 CE

$
0
0
I'm using Pentaho CE 6.1 , i trying to remove security by Allowing Anonymous Access, i folowed the tuto from Pentaho 6.1 EE founded in official help https://help.pentaho.com/Documentation/6.1/0P0/150/040 , but i didn't find the same classes used in CE . Any one done in in Community Edition ? and what was the changes to make in comparaison with Entreprise Edition ?

Thank's

process to connect the kettle from server to client system

$
0
0
Hi ,
I am Afroz, i am going to implement the pentaho kettle in my office.
so any one tell me the process to connect the kettle from server to client system
and how to assign the user logins creation

please..........

Export EXCEL- Reporting

$
0
0
Hello,
I want to improve the export from Excel pentaho designer, in fact, when I export my condition in excel I have about 20 minutes to edit the file by deleting the empty rows and columns, I want to have an excel that contains the table, as it is in reporting, well structured!
can you please help me and advise me

Creating oracle sequence from Mysql sequence value from table.

$
0
0
Hi,

Kettle 5.4.0

I'm migrating a Mysql database into an Oracle DB.

I'm stuck at a step where in mysql a table is used to keep track of a counter (one column, one row), whereas in the same schema for Oracle, this is a sequence.

What I'd like to do is to read the value from this table, and pipe it through to a 'set sequence' transformation and use the value as the start value.

Is that possible?

Kind regards,

For reference the schema statements are this
Mysql:
Code:

create table item_sequence ( next_val bigint );
insert into item_sequence values (1)

Oracle:
Code:

create sequence identityiq.spt_work_item_sequence start with 1 increment by 1 nocache;

Using an older plugin

$
0
0
Hi,

I'm looking to upgrade our version of Pentaho up to the latest version. We're on an older version of Kettle, not quite sure how the numbers line up with pdi. In any case, we have an old plugin called "Export Mysql Data" that is used in a large number of ETLs. When I open up the jobs in the DI, it tells me that plugin does not exist despite it still being in the Plugins folder.

I assume it is simply outdated and needs to be updated somehow.

Does anyone have any experience with this? Is there a trick to getting it to use older plugins?


Thanks!

Installing Pentaho Data Integration Community Edition on AWS Ubuntu

$
0
0
Hello,
I have scoured the web to find a good reference for installing Pentaho Kettle on a headless Ubuntu machine, but have not found any.I would appreciate if anyone could share the steps on how to install Kettle on Ubuntu including the setting of the JAVA environment and running the spoon.sh file.
Thank you

how to make select component mandatory field to select in the dashboard

$
0
0
hi
I have developed a dropdown list using select component and this is mandatory to select. If i click submit button without selecting it should show the error of not selecting this filter. how to do this. i tried using jquery to add required attribute to select tag but its not working. please help me.

Thanks and Regards
Preethi

Web Service

$
0
0
Hi,

I woulk like to know how can I call a Web Wervice (http URL) in Pentaho CDE in other to extract data from the web service
Viewing all 16689 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>