Quantcast
Channel: Pentaho Community Forums
Viewing all 16689 articles
Browse latest View live

how to compare 2 fields

$
0
0
I need to set the value of field depending on the comparison between other fields.
How can I perform this transformation?

Thanks

LuKe

Sub-Transformation / Mapping errors when running Maria's transformations.

$
0
0
From the beginning of chapter 11 in Maria Roldan's book, I've configured a transformation and sub-transformation exactly as described in her book. I get the errors below. I've also used Maria's own transformations that she wrote (from the downloads included with the book) and rec'd the same errors. I can preview the data from the file, but the rest of the transformation doesn't work. thx.

2015/02/13 16:36:30 - 6130_calculating_statistics_with_the_use_of_a_subtransformations - Dispatching started for transformation [6130_calculating_statistics_with_the_use_of_a_subtransformations]
2015/02/13 16:36:30 - 6161_map_statistics - Dispatching started for transformation [6161_map_statistics]
2015/02/13 16:36:30 - Examinations.0 - Opening file: file:///C:/Pentaho/book_downloads/5040OS_Code/5040OS_11_Code/pdi_files/input/exam1.txt
2015/02/13 16:36:30 - Examinations.0 - Finished processing (I=18, O=0, R=0, W=13, U=1, E=0)
2015/02/13 16:36:30 - input.0 - Finished processing (I=0, O=0, R=13, W=13, U=0, E=0)
2015/02/13 16:36:30 - Sort rows.0 - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : Error comparing rows: org.pentaho.di.core.exception.KettleValueException:
2015/02/13 16:36:30 - Sort rows.0 - Unexpected conversion error while converting value [subject_score Number] to a Number
2015/02/13 16:36:30 - Sort rows.0 - java.lang.String cannot be cast to java.lang.Double
2015/02/13 16:36:30 - Sort rows.0 - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : Error comparing rows: org.pentaho.di.core.exception.KettleValueException:
2015/02/13 16:36:30 - Sort rows.0 - Unexpected conversion error while converting value [subject_score Number] to a Number
2015/02/13 16:36:30 - Sort rows.0 - java.lang.String cannot be cast to java.lang.Double
2015/02/13 16:36:30 - Sort rows.0 - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : Error comparing rows: org.pentaho.di.core.exception.KettleValueException:
2015/02/13 16:36:30 - Sort rows.0 - Unexpected conversion error while converting value [subject_score Number] to a Number
2015/02/13 16:36:30 - Sort rows.0 - java.lang.String cannot be cast to java.lang.Double
2015/02/13 16:36:30 - Sort rows.0 - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : Error comparing rows: org.pentaho.di.core.exception.KettleValueException:
2015/02/13 16:36:30 - Sort rows.0 - Unexpected conversion error while converting value [subject_score Number] to a Number
2015/02/13 16:36:30 - Sort rows.0 - java.lang.String cannot be cast to java.lang.Double
2015/02/13 16:36:30 - Sort rows.0 - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : Error comparing rows: org.pentaho.di.core.exception.KettleValueException:
2015/02/13 16:36:30 - Sort rows.0 - Unexpected conversion error while converting value [subject_score Number] to a Number
2015/02/13 16:36:30 - Sort rows.0 - java.lang.String cannot be cast to java.lang.Double
2015/02/13 16:36:30 - Sort rows.0 - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : Error comparing rows: org.pentaho.di.core.exception.KettleValueException:
2015/02/13 16:36:30 - Sort rows.0 - Unexpected conversion error while converting value [subject_score Number] to a Number
2015/02/13 16:36:30 - Sort rows.0 - java.lang.String cannot be cast to java.lang.Double
2015/02/13 16:36:30 - Sort rows.0 - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : Error comparing rows: org.pentaho.di.core.exception.KettleValueException:
2015/02/13 16:36:30 - Sort rows.0 - Unexpected conversion error while converting value [subject_score Number] to a Number
2015/02/13 16:36:30 - Sort rows.0 - java.lang.String cannot be cast to java.lang.Double
2015/02/13 16:36:30 - Sort rows.0 - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : Error comparing rows: org.pentaho.di.core.exception.KettleValueException:
2015/02/13 16:36:30 - Sort rows.0 - Unexpected conversion error while converting value [subject_score Number] to a Number
2015/02/13 16:36:30 - Sort rows.0 - java.lang.String cannot be cast to java.lang.Double
2015/02/13 16:36:30 - Sort rows.0 - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : Error comparing rows: org.pentaho.di.core.exception.KettleValueException:
2015/02/13 16:36:30 - Sort rows.0 - Unexpected conversion error while converting value [subject_score Number] to a Number
2015/02/13 16:36:30 - Sort rows.0 - java.lang.String cannot be cast to java.lang.Double
2015/02/13 16:36:30 - Sort rows.0 - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : Error comparing rows: org.pentaho.di.core.exception.KettleValueException:
2015/02/13 16:36:30 - Sort rows.0 - Unexpected conversion error while converting value [subject_score Number] to a Number
2015/02/13 16:36:30 - Sort rows.0 - java.lang.String cannot be cast to java.lang.Double
2015/02/13 16:36:30 - Sort rows.0 - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : Error comparing rows: org.pentaho.di.core.exception.KettleValueException:
2015/02/13 16:36:30 - Sort rows.0 - Unexpected conversion error while converting value [subject_score Number] to a Number
2015/02/13 16:36:30 - Sort rows.0 - java.lang.String cannot be cast to java.lang.Double
2015/02/13 16:36:30 - Sort rows.0 - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : Error comparing rows: org.pentaho.di.core.exception.KettleValueException:
2015/02/13 16:36:30 - Sort rows.0 - Unexpected conversion error while converting value [subject_score Number] to a Number
2015/02/13 16:36:30 - Sort rows.0 - java.lang.String cannot be cast to java.lang.Double
2015/02/13 16:36:30 - Sort rows.0 - Finished processing (I=0, O=0, R=13, W=13, U=0, E=0)
2015/02/13 16:36:30 - some statistics.0 - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : Unexpected error
2015/02/13 16:36:30 - some statistics.0 - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : org.pentaho.di.core.exception.KettleValueException:
2015/02/13 16:36:30 - some statistics.0 - Number : Unable to compare with value [Number]
2015/02/13 16:36:30 - some statistics.0 -
2015/02/13 16:36:30 - some statistics.0 - Unexpected conversion error while converting value [subject_score Number] to a Number
2015/02/13 16:36:30 - some statistics.0 - java.lang.String cannot be cast to java.lang.Double
2015/02/13 16:36:30 - some statistics.0 -
2015/02/13 16:36:30 - some statistics.0 -
2015/02/13 16:36:30 - some statistics.0 - at org.pentaho.di.core.row.value.ValueMetaBase.compare(ValueMetaBase.java:3444)
2015/02/13 16:36:30 - some statistics.0 - at org.pentaho.di.trans.steps.groupby.GroupBy.calcAggregate(GroupBy.java:487)
2015/02/13 16:36:30 - some statistics.0 - at org.pentaho.di.trans.steps.groupby.GroupBy.processRow(GroupBy.java:198)
2015/02/13 16:36:30 - some statistics.0 - at org.pentaho.di.trans.step.RunThread.run(RunThread.java:60)
2015/02/13 16:36:30 - some statistics.0 - at java.lang.Thread.run(Unknown Source)
2015/02/13 16:36:30 - some statistics.0 - Caused by: org.pentaho.di.core.exception.KettleValueException:
2015/02/13 16:36:30 - some statistics.0 - Unexpected conversion error while converting value [subject_score Number] to a Number
2015/02/13 16:36:30 - some statistics.0 - java.lang.String cannot be cast to java.lang.Double
2015/02/13 16:36:30 - some statistics.0 -
2015/02/13 16:36:30 - some statistics.0 - at org.pentaho.di.core.row.value.ValueMetaBase.getNumber(ValueMetaBase.java:1598)
2015/02/13 16:36:30 - some statistics.0 - at org.pentaho.di.core.row.value.ValueMetaBase.compare(ValueMetaBase.java:3326)
2015/02/13 16:36:30 - some statistics.0 - at org.pentaho.di.core.row.value.ValueMetaBase.compare(ValueMetaBase.java:3411)
2015/02/13 16:36:30 - some statistics.0 - ... 4 more
2015/02/13 16:36:30 - some statistics.0 - Caused by: java.lang.ClassCastException: java.lang.String cannot be cast to java.lang.Double
2015/02/13 16:36:30 - some statistics.0 - at org.pentaho.di.core.row.value.ValueMetaBase.getNumber(ValueMetaBase.java:1527)
2015/02/13 16:36:30 - some statistics.0 - ... 6 more
2015/02/13 16:36:30 - some statistics.0 - Finished processing (I=0, O=0, R=2, W=0, U=0, E=1)
2015/02/13 16:36:30 - 6161_map_statistics - 6161_map_statistics
2015/02/13 16:36:30 - 6161_map_statistics - 6161_map_statistics
2015/02/13 16:36:30 - Filter rows.0 - Finished processing (I=0, O=0, R=2, W=2, U=0, E=0)
2015/02/13 16:36:30 - Add sequence.0 - Finished processing (I=0, O=0, R=13, W=13, U=0, E=0)
2015/02/13 16:36:31 - Mapping (sub-transformation).0 - Finished processing (I=0, O=0, R=13, W=0, U=0, E=1)
2015/02/13 16:36:31 - 6130_calculating_statistics_with_the_use_of_a_subtransformations - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : Errors detected!
2015/02/13 16:36:31 - Spoon - The transformation has finished!!
2015/02/13 16:36:31 - 6130_calculating_statistics_with_the_use_of_a_subtransformations - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : Errors detected!
2015/02/13 16:36:31 - 6130_calculating_statistics_with_the_use_of_a_subtransformations - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : Errors detected!
2015/02/13 16:36:31 - 6130_calculating_statistics_with_the_use_of_a_subtransformations - 6130_calculating_statistics_with_the_use_of_a_subtransformations
2015/02/13 16:36:31 - 6130_calculating_statistics_with_the_use_of_a_subtransformations - 6130_calculating_statistics_with_the_use_of_a_subtransformations

Waiting the completion of a transformation

$
0
0
I'm merging 2 different excel file in to a single excel file.

I'm using a dummy step to collect the rows from the two files.

I would like to perform first the import from one file and then the import from the second. Is this operation possible?

LuKe

Btable : setting the background color of a cell

$
0
0
Hi,

In the postexecution of a bTable, I try this :

this.ph.dataTableSettings[0].nTable.childNodes[1].childNodes[1].cells[1].bgColor="#ff0000";

But it does nothing.

What is wrong, knowing that the following is working:

this.ph.dataTableSettings[0].nTable.childNodes[1].childNodes[1].cells[1].hidden=true;


Thank you

Benoit

Exeute sql step

$
0
0
I have created transformation which includes table input,sql step and excel o/p step. 1)Table input-->Run a query and get the field "query" which includes sql query
"select * from dual"
2)Execute sql step-->Dynamically passing that query field using '?' and enabling variable substitution 3)Excel o/p-Expecting o/p is the sql query should be triggered and get the result in excel o/p
But i can't get the fiels from execute sql step..How i can do this???
Thanks
Kavitha S

Getting files from Google Drive

$
0
0
Hi to all,
I'm trying to download files from google drive and loading them to Postgres table, is there any script to do that, i have Google spreadsheet input but i dono how to create Private key file, how do i create that file.

Thanks

Details from table component

$
0
0
I have a table component and row-column intersection number of items per band. I can intercept line number and column number of user clicks. according to row-column, I would like to return an excel with the items name of detail (if row-column is 200, in excel I would enter the names and codes of 200 elements). I thought of using ktr with parameters (row and column). How can I launch this ktr? how can I do it click in the table? how could I do instead?
sorry for my english

Thanks in advance
Ettore

Re:DataBase Dump Folder

$
0
0
Hi,

I want to move MYSQL Database Dump folder from cilent server to my local sever

So could any one help me on how to start this.

Match couples - Data mining/Texmining - Cluster

$
0
0
I'm trying to do a system to match couples. A person must complete a form with age, country, hobbies, preference, sex with all of these data I'd like to know who's the best person to match with another person. I'll use clusters with WEKA so i need to know the best person to match with another person. I need some suggestions to do this. Someone knows some similar work to read, test or have any other ideas?


Thanks Greetings

Probability distribution of prediction for MLP

$
0
0
Hi,
what is the method used by WEKA to output the probability distribution of the predictions
in case of multi-layer perceptron?
Many thanks in advance.

-- Luigi

How to integrate the CDC cache with Saiku cache

$
0
0
Hi

I've installed saiku and cdc (community distribute cache) on pentaho CE, but seems like saiku us still using it's own cache. How should I integrate saiku's cache to CDC so that I have a all in one cache control from pentaho ce

JVM Memory Usage and Performance

$
0
0
I'm new to Kettle and I've setup a test ETL environment with pdi-ce-5.0.0.209 on Windows Server 2008 R2(Java 8u31, 4 CPUs, 64GB RAM). I've setup a transform that takes a table input from MS SQL 2008 R2(only 4 fields, but 500 million rows) and a table output to Postgres 9.3.4

In Spoon.bat I've set Java options =-Xmx60416m MaxPermSize1024m
Transform setting Nr Rows in rowset: 100000
Table Output: Nr of copies:3 Commit size:100000

After everything gets "warmed up" I can get 80,000+ r/s transferred into PGSQL! Once the JVM consumes it's allocation of RAM(about 45mins) performance hits the floor and CPU on the machine running Spoon.bat bounces 70-100%. It doesn't crash or lock up, but it's really slow.

Can someone explain why this is happening? Do I have a bad setting somewhere? Java seems to really like all that memory, but I'm afraid that's all I can give it. What do I need to tweak?

Questions Regarding Pentaho Kettle - New User

$
0
0
Hi,

I have some questions concerning Pentaho Kettle software as I am a new user to it:

- Is this software could be used to do migration to database from any DBMS to another (for example from Oracle to Microsoft SQL Developer)?

- Is the migration done online? without locking/stopping the whole migrated database?

- If the migration could be done online, what is criteria used to do migration? I am speaking of the used algorithm or technique to order tables to be migrated.

Thanks a lot.

Blocking step not working properly

$
0
0
Hi!

I am having an issue with blocking step.

I have one blocking step in my transformation, which is not working properly, as the status of the following steps is changed to Finished before the blocking step and stream look up step placed after that are finished. In addition, the blocking step and this stream look up get stuck, and only part of the rows are processed. Therefore, the steps after them do not process all data, and thus the output is incorrect.

The transformation works fine if I run it with 1 day data (defined in table input), but if I try to run it for 1 month (=much more data), for example, this problem occurs. The transformation is quite big and the other blocking steps work normally.

Any ideas how I could fix this?
Attached Images

Dynamic meta injection - How to create?

$
0
0
Hello,

I created a simple transformation (Read-XLSX-template.ktr) that reads XLSX file template (number of columns, its names and order) and pass it through to another transformation using metadata injection step.
Now I would like to reuse this (Read-XLSX-template.ktr) transformation and make it dynamic.
Everything works like a charm as long as transformation in ETL Metadata Injection step is manually set. When I replace it with variable everything crashes.

Is there any way to make ETL Metadata Injection step dynamic ?

Schedule job using pentaho user console scheduler

$
0
0
Hi,
I am new in kettle world.
Please suggest about job scheduling using pentaho user console as done in reports(.prpt)..
or suggest anything else.

classification & predicting

$
0
0
I'm working on predicting political sentiment from social media ,I have positive & negative tweets but what i can do if a tweet has 2 opinions for 2 or more candidates how i can classify it?
example:

tweet class
---------------------------------------
mark is good 1
john is bad 0
Mary is good but jem is bad ??
and i have files each file contain tweets a bout each candidate , how i can use Weka to predict the winner candidate ?
Thank you

Is it possibile writing two or more Excel sheets in same transformation?

$
0
0
Hi,

I'm trying to write two different Excel sheets in the same file. I write first in to an Excel file (Excel Output) and then I use an Excel Writer to try to append another sheet, but I get this error:

2015/02/16 20:03:49 - Microsoft Excel Writer.0 - ERROR (version 5.2.0.0, build 1 from 2014-09-30_19-48-28 by buildguy) : Error opening new file
2015/02/16 20:03:49 - Microsoft Excel Writer.0 - ERROR (version 5.2.0.0, build 1 from 2014-09-30_19-48-28 by buildguy) : java.io.IOException: Your file contains 1631 sectors, but the initial DIFAT array at index 0 referenced block # 1953. This isn't allowed and your file is corrupt

How could I do this operation?

LuKe

Kettle - Spoon General Availability Release - 5.2.0.0
Ubuntu 14.10 64 bit
java version "1.7.0_75"
OpenJDK Runtime Environment (IcedTea 2.5.4) (7u75-2.5.4-1~utopic1)
OpenJDK 64-Bit Server VM (build 24.75-b04, mixed mode)

Integration Pentaho CE 5.0 + CAS server

$
0
0
Hi,

I'm trying to integrate CAS with Pentaho.


After configuring login to CAS server call, I put username and password, CAS creates the ticket and redirect http://localhost/pentaho:8080/j_spri...01.example.org, but not login and not error.


I get this screen and this is what appears in the log:

Code:

INFO: Server startup in 27492 ms
2015-02-16 20:00:12,046 INFO [org.jasig.cas.web.flow.InitialFlowSetupAction] - <Setting path for cookies to: /cas-server-webapp-4.0.0/>
2015-02-16 20:00:17,891 INFO [org.jasig.cas.authentication.PolicyBasedAuthenticationManager] - <AcceptUsersAuthenticationHandler successfully authenticated admin+password>
2015-02-16 20:00:17,893 INFO [org.jasig.cas.authentication.PolicyBasedAuthenticationManager] - <Authenticated admin with credentials [admin+password].>
2015-02-16 20:00:17,897 INFO [com.github.inspektr.audit.support.Slf4jLoggingAuditTrailManager] - <Audit trail record BEGIN
=============================================================
WHO: audit:unknown
WHAT: supplied credentials: [admin+password]
ACTION: AUTHENTICATION_SUCCESS
APPLICATION: CAS
WHEN: Mon Feb 16 20:00:17 CET 2015
CLIENT IP ADDRESS: 0:0:0:0:0:0:0:1%0
SERVER IP ADDRESS: 0:0:0:0:0:0:0:1%0
=============================================================


>
2015-02-16 20:00:17,900 INFO [com.github.inspektr.audit.support.Slf4jLoggingAuditTrailManager] - <Audit trail record BEGIN
=============================================================
WHO: audit:unknown
WHAT: TGT-1-51HRaWK6gFsniZwgfjYXRZeWhZvAj1OdMLRfdxK3bwxeQsz2Ic-cas01.example.org
ACTION: TICKET_GRANTING_TICKET_CREATED
APPLICATION: CAS
WHEN: Mon Feb 16 20:00:17 CET 2015
CLIENT IP ADDRESS: 0:0:0:0:0:0:0:1%0
SERVER IP ADDRESS: 0:0:0:0:0:0:0:1%0
=============================================================


>
2015-02-16 20:00:17,905 INFO [org.jasig.cas.CentralAuthenticationServiceImpl] - <Granted service ticket [ST-1-EPd3o0xQzrFv9JEMdbCf-cas01.example.org] for service [http://localhost:8080/pentaho/j_spring_cas_security_check] for user [admin]>
2015-02-16 20:00:17,906 INFO [com.github.inspektr.audit.support.Slf4jLoggingAuditTrailManager] - <Audit trail record BEGIN
=============================================================
WHO: admin
WHAT: ST-1-EPd3o0xQzrFv9JEMdbCf-cas01.example.org for http://localhost:8080/pentaho/j_spring_cas_security_check
ACTION: SERVICE_TICKET_CREATED
APPLICATION: CAS
WHEN: Mon Feb 16 20:00:17 CET 2015
CLIENT IP ADDRESS: 0:0:0:0:0:0:0:1%0
SERVER IP ADDRESS: 0:0:0:0:0:0:0:1%0
=============================================================


>
2015-02-16 20:00:17,934 INFO [com.github.inspektr.audit.support.Slf4jLoggingAuditTrailManager] - <Audit trail record BEGIN
=============================================================
WHO: audit:unknown
WHAT: ST-1-EPd3o0xQzrFv9JEMdbCf-cas01.example.org
ACTION: SERVICE_TICKET_VALIDATED
APPLICATION: CAS
WHEN: Mon Feb 16 20:00:17 CET 2015
CLIENT IP ADDRESS: 127.0.0.1
SERVER IP ADDRESS: 127.0.0.1
=============================================================


>
2015-02-16 20:00:21,338 INFO [org.jasig.cas.ticket.registry.support.DefaultTicketRegistryCleaner] - <Beginning ticket cleanup.>
2015-02-16 20:00:21,339 INFO [org.jasig.cas.ticket.registry.support.DefaultTicketRegistryCleaner] - <0 tickets found to be removed.>
2015-02-16 20:00:21,339 INFO [org.jasig.cas.ticket.registry.support.DefaultTicketRegistryCleaner] - <Finished ticket cleanup.>
2015-02-16 20:02:01,616 INFO [org.jasig.cas.services.DefaultServicesManagerImpl] - <Reloading registered services.>
2015-02-16 20:02:01,616 INFO [org.jasig.cas.services.DefaultServicesManagerImpl] - <Loaded 1 services.>
2015-02-16 20:04:01,616 INFO [org.jasig.cas.services.DefaultServicesManagerImpl] - <Reloading registered services.>
2015-02-16 20:04:01,616 INFO [org.jasig.cas.services.DefaultServicesManagerImpl] - <Loaded 1 services.>

Captura de pantalla 2015-02-16 a la(s) 20.00.58.jpg

Anybody help me please?

Thanks and regards.

Navigating through hierarchies in Saiku Analytics.

$
0
0
Hi, I just made a mondrian cube which I'm testing in Pentaho BI server using Saiku Analytics Plugin (which seems to be the nicest tool). In JPivot, I could open the parent hierarchy tab to uncover its children, but I haven't found anything similar in Saiku.

Is there a way to click, for example, the year "2014" to reveal every month? If there is, can I do the same in the graphic view?

Hope you understand my problem, I found it difficult to explain.

Best regards.
Viewing all 16689 articles
Browse latest View live