Quantcast
Channel: Pentaho Community Forums
Viewing all 16689 articles
Browse latest View live

make transformation database transactional and log errors

$
0
0
Hi All,


I have a requirement to make transformation database transactional and log errors with error description to text file (only on rollback), how can i do this both at a time.. any help/hints will be appreciated



Regards,
Mateen

shell script error while executing job

$
0
0
Hi All,

I am getting following error while executing shell script in job (execute job inside script on windows platform)

2015/05/20 12:24:56 - Shell - ERROR (version 5.2.0.0, build 1 from 2014-09-30_19-48-28 by buildguy) : (stderr) =256m""=="" was unexpected at this time.

Please find attachment for job j_test.kjb

i need to work on this, any hints will be appreciated

Regards,
Mateen
Attached Files

Ideas for logging errors / rejections from Lookup step

$
0
0
I have been searching the forum but I cant seems to get the question right so all the answers are irrelevant.

What I would ideally like to do is catch the error output from a DB Lookup step (ie where the lookup failed).
Then log this fact, along with values from the row in error, to a generic error table.
Last time I did this was in Pl/Sql and the table was a value pair basically column/field name and field value.
So the one construct was used for all processes.

With kettle I can see that you can right click and select 'Define Error Handling'
that requires a target step. Unfortunately all the doco simply send this to the dummy step so I cant really guess what type of step it should refer to.
AND the step has to be one of the outputs from the lookup step.

To experiment I sent the reject stream to a 'Text File Output' step and the reject row does get logged (to a file).
However nothing set in 'Define Error Handling' appears there and in fact that whole bit can be turned off and the results are the same

I don't want to write a whole pile of files from every lookup and then have to write another job to go and gather them up - all with different formats by now; then to put them, by magic, into the database so users or administrators can see the errors along with other outputs.

Does anybody have any suggestions as to a more appropriate step type to send errors to?
Also how to turn a row of a stream into value pairs (opposite of Row Denormaliser (and the opposite is not Row Normaliser))

Thanks

JC

Bar Chart Color by one column from the SQL query

$
0
0
Hi, all.
I have the sql query as following:
select time, level, value
from tab1

I want the the bar chart color by level column, what do I need to configure for that?
Thank you for you answer and suggestion.

Regards,
Tiger

HDFS to HDFS via PDI

$
0
0
Hello:

I want to read data from a HDFS, after process the data put the data to another HDFS. Can Kettle do this? thank you

How to enlarge the dashboard panel of a particular report

$
0
0
Hi All,

I appreciate and thank you if anyone of you assist me in enlarging the report if we click on the particular panel of the dashboard. As of now, we could view the report within the panel which is very very small with horizontal and vertical scroll bars, which is not actually good looking. Expecting your valuable answers..

Regards,

Abdur Rahmaan

How to fetch the node name of XML tag

$
0
0
Hi I need to fetch the node name of XML tag. I'm using get data from XML function.

Eg:

<test>
<test1>
<branch>
<name>abc</name>
<current/>
<location>xyz</location>
</branch>
</test1>
</test>

I need to get 'current' from the above example.

how to use an field value as the file name of the html.

$
0
0
hi,

i need to use the field value as the file name of generated HTML. Text file output is used and 'use field name as File name' function is used but its throwing error, data is not avaliable but the data is present in the table. Any help would be really appreciated.


Thanks
Appurv

C-Tools Update Has Broken My PRPT Reports

$
0
0
Hi All,

I hope someone here can help.

I am currently running the 4.8.0 version of the web application.

On Monday I updated C-tools using the "ctools-installer.sh" script (which is now v.1.48). After the update I double checked my CDE dashboards and CDA files to check they were all fine which they were.

Anyway yesterday I got a report that the PRPT reports weren't working. Looking in Chrome's Developer Tools it seems to be a problem with "/system/pentaho-cdf/js/lib/CCC/jquery.tipsy.js" - "Uncaught TypeError: Cannot read property 'fn' of undefined" related to this line "$.fn.tipsy = function(options, arg) {".

Any ideas?

Involuntary trimming with Text file input?

$
0
0
Hi, I'm a student using Kettle to try to preprocess some txt files and separate them.

The process works fine, and it separates the categories just fine, however, Kettle seems to be trimming the longer lines on its own initiative.

For example, a line that in the "Get fields" GUI shows up as 270 chars long is shown fine. I've set the field to have 350 and there's also no trimming. However, the actual file, and the "Preview Rows" GUI is trimming them.

Anyone have an idea?

Thanks!

Regards

How to store in PUC Analysis Month number value instead Month name value

$
0
0
Is possible somehow store column number instead column name in filter of saved analysis? My version of Pentaho User Console is 5.3. This is my level element in mondrian for month:
Stored values in database:
Values in month_name are: [Jan, Feb, Mar, Apr,...] Values in month_number are: [1,2,3,..]
HTML Code:

<Level name="month" visible="true" column="month_number" ordinalColumn="month_number" nameColumn="month_name" type="String" uniqueMembers="false" levelType="TimeMonths" hideMemberIf="Never" caption="%{polymis.dimension.timedimension.hierarchy.level.month.caption}">
        <Annotations>
          <Annotation name="AnalyzerDateFormat">
            <![CDATA[[yyyy].['Q'q].[MMM]]]>
          </Annotation>
        </Annotations>
      </Level>

Above you can see that i use column="month_number" so i thought that the value that will be stored in analysis file below like filtered value, but instead there is the value from "month_name", for me this is invalid because i use localized values of months, so when i turned my language into another one this will not work for me in Pentaho user console. The stored value should be rather
HTML Code:

<filters>
        <filter formula="[timedimension].[month_name]" viewFilterEnum="MULTIPLE">
            <predicates>
                <predicate ordinal="1" operatorEnum="EQUAL">
                    <member formula="[timedimension].[2010].[Q1].[Mar]" caption="Mar" pos="0"/>
                </predicate>
            </predicates>
        </filter>
    </filters>

The result should be like below or something like that
HTML Code:

<member formula="[timedimension].[2010].[Q1].[3]" caption="Mar"
    pos="0"/>

NullPointerException when starting job

$
0
0
I have got the following exception when starting a job, any idea?

Code:

Kettle Run Job Error: null: java.lang.NullPointerException
        at org.pentaho.di.core.logging.Log4jBufferAppender.getLogBufferFromTo(Log4jBufferAppender.java:87) [kettle-core.jar:4.4.3]
        at org.pentaho.di.core.logging.Log4jBufferAppender.getLogBufferFromTo(Log4jBufferAppender.java:152) [kettle-core.jar:4.4.3]
        at org.pentaho.di.core.logging.Log4jBufferAppender.getBuffer(Log4jBufferAppender.java:158) [kettle-core.jar:4.4.3]
        at org.pentaho.di.core.logging.Log4jBufferAppender.getBuffer(Log4jBufferAppender.java:171) [kettle-core.jar:4.4.3]
        at org.pentaho.di.core.logging.Log4jBufferAppender.getBuffer(Log4jBufferAppender.java:167) [kettle-core.jar:4.4.3]
        at org.pentaho.di.job.Job.execute(Job.java:617) [kettle-engine.jar:4.4.3]
        at org.pentaho.di.job.Job.execute(Job.java:495) [kettle-engine.jar:4.4.3]
        at org.pentaho.di.job.Job$execute.call(Unknown Source)
        at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:45) [groovy-all-2.0.7.jar:2.0.7]
        at org.pentaho.di.job.Job$execute.call(Unknown Source)

NullPointerException when starting job

$
0
0
I have got the following exception when starting a job, any idea?

Code:

Kettle Run Job Error: null: java.lang.NullPointerException
    at org.pentaho.di.core.logging.Log4jBufferAppender.getLogBufferFromTo(Log4jBufferAppender.java:87) [kettle-core.jar:4.4.3]
    at org.pentaho.di.core.logging.Log4jBufferAppender.getLogBufferFromTo(Log4jBufferAppender.java:152) [kettle-core.jar:4.4.3]
    at org.pentaho.di.core.logging.Log4jBufferAppender.getBuffer(Log4jBufferAppender.java:158) [kettle-core.jar:4.4.3]
    at org.pentaho.di.core.logging.Log4jBufferAppender.getBuffer(Log4jBufferAppender.java:171) [kettle-core.jar:4.4.3]
    at org.pentaho.di.core.logging.Log4jBufferAppender.getBuffer(Log4jBufferAppender.java:167) [kettle-core.jar:4.4.3]
    at org.pentaho.di.job.Job.execute(Job.java:617) [kettle-engine.jar:4.4.3]
    at org.pentaho.di.job.Job.execute(Job.java:495) [kettle-engine.jar:4.4.3]
    at org.pentaho.di.job.Job$execute.call(Unknown Source)
    at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:45) [groovy-all-2.0.7.jar:2.0.7]
    at org.pentaho.di.job.Job$execute.call(Unknown Source)

How to Load Data to Pre-Formatted or Template Excel File using pentaho kettle

$
0
0
Hi All,

I need to extract data from different datasources and have to feed the resulting data into a predefined excel file template using Kettle.
The data should be fed into specific cells of the file, and need to attach the logo in one of the cell.
How could i feed the data into the predefined/template excel file?
Can we achieve it using "excel writer --> use template" step

Regards,
Lourdhu.A

Evitar duplicados de Pentaho a SQL Server

$
0
0
Buenos días,

tengo una tabla con datos en SQL Server que se rellenan con datos que vienen de Pentaho, si la tabla esta vacía no tengo problemas, ya que con Pentaho quito los duplicados de los origenes. El problema lo tengo si el dato ya se encuentra en la tabla de SQL, que el Pentaho me da error de clave primaria duplicada.

¿Hay alguna forma de evitar esto?

Muchas gracias!

Saludos.

Execute a process arguments with spaces

$
0
0
Need assistance with use of Execute a process transformation step in Kettle 5.3. Does anyone know how to handle the situation where an argument contains spaces. For example, if the argument contains the following:

//risokcmfsp001/data_fab/common/Extra/ETL/Conversions/Mass Analyzer Reports/AnalyzeX.exe

the error Cannot run program "//risokcmfsp001/data_fab/common/Extra/ETL/Conversions/Mass Analyzer Reports/AnalyzeX.exe": CreateProcess error=2, The system cannot find the file specified occurs.

If the spaces in "Mass Analyzer Reports" are removed leaving "MassAnalyzerReports", the Execute process step runs good. I have tried enclosing with single and double quotes and brackets without any success.

Would appreciate any help.

Sciptable datasource

$
0
0
Hi,

I want a sparkline in my dashboard. I saw the example AddIn Reference and datasource is scriptable.

So, i need to read my values of sparkline from a sql query. How can i "embed" that query in my code?

Here is what im trying to do:

Code:

import org.pentaho.reporting.engine.classic.core.util.TypedTableModel;


String[] columnNames = new String[]{
" ",
" "
};


Class[] columnTypes = new Class[]{
String.class,
String.class
};


TypedTableModel model = new TypedTableModel(columnNames, columnTypes);
String param0 = (String) dataRow.get("param1");
model.addRow(new Object[]{ new String(param0)
,new String(/*here should appear my values like ""12,44,11,..."*/)
});


return model;

setVariable vs setParameter

$
0
0
Hello Group,

I am trying to call some transformation from a Java code by setting up input message.The code snippet is below

String msg = "random message"
try {
KettleEnvironment.init();
TransMeta metaData = new TransMeta("Simple.ktr");
Trans trans = new Trans(metaData);
trans.setVariable("data", msg); //trans.setParameter("data", msg);
trans.execute(null);
trans.waitUntilFinished();

if (trans.getErrors() > 0) {
System.out.print("Error Executing transformation");
}
} catch (KettleException e) {

e.printStackTrace();
}

Can someone please help me understand the difference between setVariable vs setParameter. Also is there a best way I can pass the input to transformation from a Java code.

Thanks & Regards,
Santosh

Transformation Filename or Specify by Name and Directory

$
0
0
Hi All,


I am new to file repository, using file repositiory in PDI CE 5.3 edition. i have observed different types of options in transformation settings i.e Transformation Filename and Specify by Name and Directory.


Currenly i am saving my transformations using Specify by Name and Directory option. could you please suggest me which one is best and reusable option ? if at all in future i want to import my assets into database repository which option is best one?


Thank you

5.4 Release

$
0
0
I have been waiting for the 5.4 release for a bit now, it has several fixes in it which will help me.

I see on JIRA that it doesn't seem to have any blockers.

My conundrum is whether to push my 5.3 release to production (production is at 5.1) or whether to wait x days for 5.4.

Anyone have release gossip on 5.4? Just trying to avoid pushing 5.3 and a week later pushing 5.4 and annoying my grumpy IT manager.

I know I could build CI ... but that presents more problems.

Thanks!
Viewing all 16689 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>