Quantcast
Channel: Pentaho Community Forums
Viewing all 16689 articles
Browse latest View live
↧

Replace repository with file system...

May 29, 2013, 7:52 am
$
0
0
Hi,
we are considering to replace repository with file system to store transformations and jobs in order to:
- To make more efficient the runtime repository loading in memory
- To improve versioning of kettle resources (files .ktr,.kjb)
This is a big change for our projects so we would know if this is a good solution according to the “Kettle RoadMap”.
We mean, for example, using file system instead of repository, in the future, we will loose some kettle’s features, components, compatibility?

Thank you!!
BI_PDI
↧
Search

Need Help Getting Original Record After Parsing Error

May 29, 2013, 7:57 am
$
0
0
Hello,

I have a transformation with a CSV File Input step that writes records that have errors to a file in a CSV File Output step. The problem is that I only get a partial record written to the file when there is an error and I need the original record. I've tried using a RowListener on the input step but only get the correctly formatted records and a RowListener on the output step only gets the incomplete record where the error occurred. Is there a way to get the complete record where the error occurred?

Thanks in advance!
↧
↧

Mondrian 4.0.0 pom has dependencies for jsp-api and servlet-api and should not

May 29, 2013, 8:02 am
$
0
0
I'm using Mondrian 4.0.0-SNAPSHOT in my maven/Tomcat project and I'm getting it from the Pentaho maven repo (http://repository.pentaho.org/artifactory/repo/). All the dependencies get downloaded nicely. However, there are 2 dependencies in the Mondrian pom that are causing trouble on Tomcat 7 because they are Servlet container specific and target an older servlet spec:


Code:


<dependency>



      <groupId>javax.servlet</groupId>



      <artifactId>jsp-api</artifactId>



      <version>2.0</version>



      <scope>compile</scope>



    </dependency>



<dependency>



      <groupId>javax.servlet</groupId>



      <artifactId>servlet-api</artifactId>



      <version>2.4</version>



      <scope>compile</scope>



</dependency>
These should be removed or should be optional shouldn't they? Is there are workaround for this in the short term?
↧

When will Mondrian 4 be released?

May 29, 2013, 8:14 am
$
0
0
Is there a target date for when the stable release of Mondrian 4 will be available? I am starting a project now to deliver in August and I'm not sure if I should use Mondrian 3.5 or Mondrian 4. Any recommendations?

Also, if I use 3.5 I am not sure which 3.5 to use. In the official Pentaho maven repo (http://repository.pentaho.org/artifactory/repo/) I see Mondrian versions up to 3.5.7 but these are not listed as stable releases on sourceforge. If I were to use Mondrian 3.5 should I use Mondrian 3.5.0 as listed on Sourceforge as the latest stable release or should I use Mondrian 3.5.7, which appears to be the latest release available in the official Pentaho Maven repo?

Thanks for any advice.

Colin
↧

ETL Metadata Injection and SPlit Fields version 4.4.0

May 29, 2013, 11:21 am
$
0
0
Would anybody tell how to make work Metadata Injection and Split Fields? Examples I have won't working. I have version 4.4.0 of PDI.
↧
↧

"=IFNA" PDI-style?

May 29, 2013, 12:43 pm
$
0
0
Any ideas on how to do it? I'm running a simple division calc on Calculator step, which SHOULDN'T have division by 0... but while testing, I've stumbled upon one near the very end. Any ideas on how to "IFNA, set 0", instead of letting Calculator step explode with that error? =p
↧

Email transformation step and attachments.

May 29, 2013, 1:31 pm
$
0
0
My goal is to create dynamic emails that for each row would send a different set of attachments.

so for example:
- for source row TOM - I would send email with 2 files attached, lets say c:\temp\tom1.txt and c:\temp\tom2.pdf
- for source row JERZY - I would send email with just one file attached - c:\temp\jerzy\test.txt
and so on.

I have been trying to utilize the "send Mail" transformation step and the "dynamic filenames" attachment section, but cannot make it work to identify and attach just 2 out of many files in the folder.
Tried different regular expression, but it either sends everything in a folder - or no attachments at all.

Does anyone know how to set that up or has examples of this working?

Please help - I could not find any existing answers or samples. :) !!!!
↧

Looping tru the ResultSet and executing Transformations based on Parameter

May 29, 2013, 2:20 pm
$
0
0
We got this working; just wanted to know if there is a better way to do this.

This is what we needed.
Query a table to get the "Tenants" and the "Source Versions" records. Loop through the records and call different transformations based on the "Source Version".

This is how we accomplished this.
Parent Job --> calls a Transformation which has a "Table Input" and a "Copy Rows to Result" step --> Child Job which "Executes for every input row" and "copies pervious result set to parameters", which calls the version specific Transformation based on the Source Version parameter (eg:${repo_path}/prep_pg_stream_${analytics_version}.ktr).

We tried to use "Execute SQL" to get the records in the job instead of using Transformation, but that doesn't seem to pass the Result Set to parameters. We are trying to see if there is a way to avoid the additional Transformation and Job in here, for this simple looping.

Thanks in advance.
loop_setup.jpg
Attached Images
↧
Search

Access input-coded database

May 29, 2013, 2:30 pm
$
0
0
Hi,

I need to get data from a few hundred access 2000 files (all the same structure), but these files are encoded. If I open one and use the encode/decode option I can save a new version of the file and access it with pentaho.

Obviously, I don't want to manually decode every file. Is there a way to connect pentaho to a coded access file? Or to batch decode every file in the folder?

I hope I'm clear!

Thanks!

Guillaume
↧
↧

Web services lookup step: No success on retrieving data from SOAP wsdl

May 29, 2013, 2:53 pm
$
0
0
The webservice that I want to retrieve data from, has the following SOAP input structure:

Code:
<soap:Envelope xmlns:soap="http://www.w3.org/2003/05/soap-envelope" xmlns:str="http://www.webservice.com" xmlns:xsd="http://xml.services.common.webservice.com/xsd">
  <soap:Header/>
  <soap:Body>
      <str:getData>
        <!--Optional:-->
        <str:rec>
            <!--Optional:-->
            <xsd:auth_LoginName>login</xsd:auth_LoginName>
            <!--Optional:-->
            <xsd:auth_Password>password</xsd:auth_Password>
        </str:rec>
        <!--Optional:-->
        <str:param1>1</str:param1>
        <!--Optional:-->
        <str:param2>2</str:param2>
        <!--Optional:-->
        <str:param3>3</str:param3>
      </str:getData>
  </soap:Body>
</soap:Envelope>
I built a transformation this way, where the Generate Rows step of course contains the values for param1, param2 and param3:

transformation.png

The three tabs of the Webservices lookup step I filled out this way:

tab1.jpg

tab2.jpg

tab3.jpg

But the XML result file remains empty (although the same request via soapUI gets success!):

<?xml version="1.0" encoding="UTF-8"?>
<Rows>
</Rows>

Have you any ideas, why?
I suppose, it has to do with the cascaded rec-structure for "LoginName" and "Password", because PDI can not know the inside names of this rec-container, as long I have no chance to announce it to PDI. How can I fix that?

Any hints will be welcome, thanks a lot!
Attached Images
↧

How to use CDE table Component display large amounts of data?

May 29, 2013, 11:13 pm
$
0
0
I want to use CDE table Component show one hundred thousand data, but firefox pop script unresponsive. Please help me!
and Paginate server-side how to use？
↧

Stuck: getting filename from the previous input

May 30, 2013, 12:45 am
$
0
0
Hi All,
I have first grabbed a csv file and used "Replace string" to transform the file to ".txt" type and then changed the encoding of a file with "Change file encoding" tranformation. The new file is stored in "newfilename" output column of this transformation.

I want to use this filename as input for the next steps. I figured out I have to use "Text file input" to grab the filename from previous step. My problem is with this field - 'Field in the input to use as filename' for which I have assigned "newfilename" because the entire path and filename of the file is in that column. But "Preview" gives me the following message "specify atleast one text sample in the file list.when reading filenames from previous steps this file will not be used."

Please help me! Thanks!
↧

Create a TABLE from Excel Input

May 30, 2013, 2:28 am
$
0
0
Hello Every1,

How can i create a table from taking the Excel input.
Say, My excel coulms are Emp_Name and Sal.

I want to create a temp table/table dynamically with the columns in the excel.
↧
↧

Problem using Date mask

May 30, 2013, 2:43 am
$
0
0
Hello,

I'm currently trying to get my data according to a specific format for my date column.

I tried to follow some topics saying that I should add a new "concept" in the concept editor and then add a property of "Mask for Number or Date" and finally applying it to my column.

Once done, when I get into the query editor, no changes appear, does anyone already get this issue ?

Thanks all
↧

Resource-field definition

May 30, 2013, 2:44 am
$
0
0
In my resource bundles file this is the definition for a resource-message field:
res_msg_field_1=Report date: $(report.date, date, dd MMMM, yyyy - HH:mm)

How I define a resource-field in the resource bundles file?

Thanks
↧
Search

edit table

May 30, 2013, 7:48 am
$
0
0
Hi,
How can i edit the colors of a table component?
Is it possible to delete the row "Showing 1 to x of x entries" at the bottom of the table?
I have tried the column type "trendArrow". How can i change the image of the arrow?
Thanks
↧

Mondrian OLAP and formula in PRD reports

May 30, 2013, 8:50 am
$
0
0
My report uses an MDX query as a data source. I have no problems with grouping or showing data on screen. What I wanted to do is use one of the fields returned from Mondrian in a formula, specifically to alter the visibility of the element on canvas. The formula I tried is

=IF([Income Statement].[Account Number] >= 900000; true(); false())

The formula simply does not work. No warnings, no errors, just silently not performing the task. Any guidance towards a solution or method of troubleshooting would be appreciated.

OLAP_and_Formula.jpg
Attached Images
↧
↧

Which approach - any advice

May 30, 2013, 9:28 am
$
0
0
Hi I'm looking for some advice on the best way to manage a big project in Pentaho.

We're working with a large number of different data streams (over 400) that are published as CSV files online. We have no ownership over the publication procedures, so we often get inconsistent data, e.g. columns renamed, new rows added to the header, different date formats.

The data is transaction data, so there are no more than 12 columns in the most complex files and often only four or five columns in each file. Obviously there is a lot of data commonality here, with each file containing at least the following columns: buyer, supplier, value and date.

It seems that I can take one of two options to handle this:

1. Create a transformation for each data stream and maintain / update those as each data file changes.

2. Create a form of look up table that indicates what data is in which column and in what format the data is in, and then create a transformation for each single format variation. (e.g. Org 1 = date(mm/dd/yyyy), value($0.00), buyer(varchar255), supplier(varchar255).

The second option looks the most efficient in the long-term, but it seems complex to develop and might stretch my meagre skills. If the best option is the second one, what would be the best way to implement this option.

Any advice?

W
↧

Move File in javascript fails in linux

May 30, 2013, 10:35 am
$
0
0
Hi!

I have a transformation that have a javascript step, in it I am creating the full path and filename of the file to move and the destination path with the new filename.

Then I am calling the move file method in the following way:

moveFile(src, documentFilename, '');

src is the source for example:
/mnt/pentaho_dev/DEV/Technology/Temporal/MOL/AcctStmts/8762000418_201206_07052012_1121_00000000000000009129.pdf

documentFilename is the destination for example:
/mnt/ndm_dev/PBI/MOL/Output/JPMX.JPMPDF.MEX.JPMOLP.2012186.001570.ARD.out

It is working good in windows but in linux I am having the following error:

ERROR 30-05 11:40:56,050 - Modified Java Script Value 2 - org.pentaho.di.core.exception.KettleValueException:
Javascript error:
org.mozilla.javascript.EvaluatorException: The function call moveFile throw an error : org.apache.commons.vfs.FileSystemException: Could not rename "file:///mnt/pentaho_dev/DEV/Technology/Temporal/MOL/AcctStmts/8762000418_201206_07052012_1121_00000000000000009129.pdf" to "file:///mnt/ndm_dev/PBI/MOL/Output/JPMX.JPMPDF.MEX.JPMOLP.2012186.001570.ARD.out". (script#36) (script#36)

at org.pentaho.di.trans.steps.scriptvalues_mod.ScriptValuesMod.addValues(ScriptValuesMod.java:457)
at org.pentaho.di.trans.steps.scriptvalues_mod.ScriptValuesMod.processRow(ScriptValuesMod.java:688)
at org.pentaho.di.trans.step.RunThread.run(RunThread.java:40)
at java.lang.Thread.run(Thread.java:636)
Caused by: org.mozilla.javascript.EvaluatorException: org.mozilla.javascript.EvaluatorException: The function call moveFile throw an error : org.apache.commons.vfs.FileSystemException: Could not rename "file:///mnt/pentaho_dev/DEV/Technology/Temporal/MOL/AcctStmts/8762000418_201206_07052012_1121_00000000000000009129.pdf" to "file:///mnt/ndm_dev/PBI/MOL/Output/JPMX.JPMPDF.MEX.JPMOLP.2012186.001570.ARD.out". (script#36) (script#36)
at org.mozilla.javascript.DefaultErrorReporter.runtimeError(DefaultErrorReporter.java:109)
at org.mozilla.javascript.Context.reportRuntimeError(Context.java:938)
at org.mozilla.javascript.Context.reportRuntimeError(Context.java:994)
at org.pentaho.di.trans.steps.scriptvalues_mod.ScriptValuesAddedFunctions.moveFile(ScriptValuesAddedFunctions.java:2215)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.mozilla.javascript.MemberBox.invoke(MemberBox.java:161)
at org.mozilla.javascript.FunctionObject.call(FunctionObject.java:413)
at org.mozilla.javascript.optimizer.OptRuntime.callName(OptRuntime.java:97)
at org.mozilla.javascript.gen.c270._c0(script:36)
at org.mozilla.javascript.gen.c270.call(script)
at org.mozilla.javascript.ContextFactory.doTopCall(ContextFactory.java:398)
at org.mozilla.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3065)
at org.mozilla.javascript.gen.c270.call(script)
at org.mozilla.javascript.gen.c270.exec(script)
at org.pentaho.di.trans.steps.scriptvalues_mod.ScriptValuesMod.addValues(ScriptValuesMod.java:376)
... 3 more

INFO 30-05 11:40:56,050 - Modified Java Script Value 2 - Finished processing (I=0, O=0, R=1, W=0, U=0, E=1)

Can anyone help/guide me please?

Thanks!
↧

Sharing reports developed with Pentaho EE

May 30, 2013, 10:44 am
$
0
0
Hey all, Was wondering if it's possible to use Report Designer in the Pentaho Enterprise Edition to develop a report, and then be able to share that with organizations who may only have the open-source tools installed, assuming those organizations have access to the source data as well. Has this been done by anyone before, and did you encounter any issues in doing it? Thanks!
↧
Viewing all 16689 articles
Browse latest View live
Search