Quantcast
Channel: Pentaho Community Forums
Viewing all 16689 articles
Browse latest View live

Connect Report Designer with BI CE Server

$
0
0
Hi,

I have installed a BI server community edition and create a DataSource. This DataSource connect with a PostgreSQL database in another server (JDBC). Now, I have the Report Designer and I want to use the DataSource created in BI CE Server.

I can connect with PostgreSQL database from Report Designer creating a JDBC Datasource, but I want to connect with the DataSource created in BI Server.

How could i do that?

Best regards.

Warning: Data-Set does not contain a column with name...

$
0
0
Hello everyone, I have a weird problem that I can't seem to find any definitive answer for.

I have a transformation that uses the "Pentaho Reporting Output File" step to run a report. The PDI job started failing in production with the following error message during the "Pentaho Reporting Output File" step in PDI:

"Warning: Data-Set does not contain a column with name 'Pipeline'"

I do refer to 'Pipeline' in the report but only as the "value" property of labels - it is not the name of any of the query fields (I'm not aliasing any of the query fields to "Pipeline" either).

I see another error in the log file if it helps:

"Configured configuration-properties based override for global read-hander. Change your code to use proper module-initializers instead. This method of configuring the parser will go away in the next major version.

Has anyone seen this issue?

Ryan

Not able to retrieve tables from Vertica through pdi 5.0.1

$
0
0
Hi, I was trying to connect vertica 7.1.x database through pdi-5.0. I'm able to connect database successfully but not able to retrieve tables from the schema.

I have created few tables in the schema but not able to retrieve them from pdi.

Below is the detail error i'm getting: Could you pls suggest me on this. Thanks in advance!

java.lang.reflect.InvocationTargetException: Problem encountered getting information from the database: org.pentaho.di.core.exception.KettleDatabaseException:
Unable to retrieve database information because of an error


Error getting views from schema [null]
[Vertica][VerticaDSII] (20) An error occurred during query execution: ERROR 4856: Syntax error at or near ")" at character 258




at org.pentaho.di.ui.core.database.dialog.GetDatabaseInfoProgressDialog$1.run(GetDatabaseInfoProgressDialog.java:76)
at org.eclipse.jface.operation.ModalContext$ModalContextThread.run(ModalContext.java:113)
Caused by: org.pentaho.di.core.exception.KettleDatabaseException:
Unable to retrieve database information because of an error


Error getting views from schema [null]
[Vertica][VerticaDSII] (20) An error occurred during query execution: ERROR 4856: Syntax error at or near ")" at character 258




at org.pentaho.di.core.database.DatabaseMetaInformation.getData(DatabaseMetaInformation.java:401)
at org.pentaho.di.ui.core.database.dialog.GetDatabaseInfoProgressDialog$1.run(GetDatabaseInfoProgressDialog.java:72)
... 1 more
Caused by: org.pentaho.di.core.exception.KettleDatabaseException:
Error getting views from schema [null]
[Vertica][VerticaDSII] (20) An error occurred during query execution: ERROR 4856: Syntax error at or near ")" at character 258


at org.pentaho.di.core.database.Database.getViewMap(Database.java:3609)
at org.pentaho.di.core.database.Database.getViews(Database.java:3545)
at org.pentaho.di.core.database.Database.getViews(Database.java:3541)
at org.pentaho.di.core.database.DatabaseMetaInformation.getData(DatabaseMetaInformation.java:379)
... 2 more
Caused by: java.sql.SQLException: [Vertica][VerticaDSII] (20) An error occurred during query execution: ERROR 4856: Syntax error at or near ")" at character 258
at sun.jdbc.odbc.JdbcOdbc.createSQLException(JdbcOdbc.java:6964)
at sun.jdbc.odbc.JdbcOdbc.standardError(JdbcOdbc.java:7121)
at sun.jdbc.odbc.JdbcOdbc.SQLTables(JdbcOdbc.java:5525)
at sun.jdbc.odbc.JdbcOdbcDatabaseMetaData.getTables(JdbcOdbcDatabaseMetaData.java:2394)
at org.pentaho.di.core.database.Database.getViewMap(Database.java:3576)
... 5 more

Do GARBAGE COLLECTION manually in PDI - Kettle

$
0
0
Is this good way to do like this - since getting couple of message, - Java Heap Space and java.lang.memoryexception
did the changes to spoon.bat to increase memory size but still wanna do this manually since there WILL BE NO HARM to the currently handled processes.

//code-starts
import java.util.*;



public class zHandleGCManualwaysIteration
{
public static void main(String s[])
{
Runtime rs = Runtime.getRuntime();
rs.gc();
}
}
//code-ends

is this good to keep in - "User Defined Java Class" step - plz lemme know.

Adding weka instances after classification but before evaluation?

$
0
0
i’ve tried the mailing list (http://list.waikato.ac.nz/pipermail/...er/065332.html), i’ve tried stackoverflow (http://stackoverflow.com/questions/3...evaluation)… here’s a shoutout via this pentaho forum:

Suppose `X` is a raw, labeled (ie, with training labels) data set, and `Process(X)` returns a set of `Y` instances that have been encoded with attributes and converted into a weka-friendly file like Y.arff.

Also suppose `Process()` has some 'leakage': some instances `Leak = X-Y` can't be encoded consistently, and need to get a default classification `FOO`. The training labels are also known for the Leak set.

My question is how I can best introduce instances from Leak into the weka evaluation stream AFTER some classifier has been applied to the subset `Y`, folding the `Leak` instances in with their default classification label, before performing evaulation across the full set `X`?

In code:

Code:

DataSource LeakSrc = new DataSource("leak.arff");
Instances Leak = LeakSrc.getDataSet(); 
DataSource Ysrc = new DataSource("Y.arff");
Instances Y = Ysrc.getDataSet(); 

// i now find the note in https://weka.wikispaces.com/Use+WEKA+in+your+Java+code 
// The classifier (in our example tree) should not be trained when handed over to the crossValidateModel method.
// classfr.buildClassifer(Y)

// YunionLeak = ??
eval.crossValidateModel(classfr, YunionLeak);

Maybe this is a specific example of folding together results from multiple classifiers?

How to edit an existing bar chart in prpt file using java

$
0
0
I have created a prpt with a bar chart without any data source using PRD 5.4.0.1.
The chart is in a inline subreport and I want to fill data into this chart using java code. Category column is date and value column is duration.
I have tried the following but the chart is empty :
Code:

public
Code:

void generateBarChart(MasterReport report,Map<String,Long> durationMap){
   
CategorySetDataCollector dataCollector =newCategorySetDataCollector();
   
CategoricalChartExpression chartExpression =null;
   
Set<String> durationKeySet = durationMap.keySet();
   
Iterator<String> it = durationKeySet.iterator();

   
while(it.hasNext()){
       
String date = it.next();
        dataCollector
.setCategoryColumn(date);
        dataCollector
.setValueColumn(newString[]{ durationMap.get(date)
               
+""});
   
}
    report
.addExpression(dataCollector);
}

durationMap contains the date as key and duration as column obtained through query.

How to include WEKA filter into KettleTransformation?

$
0
0
Dear Community Members!
I’m Pentaho newbie without coding background, doing my first steps in data transformation and analysis.
Maybe somebody can instruct me how to use WEKA filters in PDI data stream transformation? (NominalToBinary filter, if

Thank you very much in advance,
Pew

timezone setting in PDI-CE-5.3

$
0
0
Hi,

I am facing issue with timezone settings while retrieving data from Source. my target DB exist on my local machine, when i check timezone for both Source and Target using query : getting different result and i was mentioned "-Duser.timezone=UTC" (set OPT in spoon.bat (pdi-ce-6.0)) even though i am not able to retrieve data because of time mismatch.

as per my observation there is change for spoon.bat in 5.3 and spoon.bat in 6.0 version. i can say 100% woked in 5.3 edition but not able to 6.0 version.

Please suggest me how to set Source database timezone in my PDI-CE-6.0 spoon.bat file ??

for Source(i.e. Amazon cloud):- mdc.png for Target(i.e. Local machine):- idc.png
Attached Images

Oracle and Date picker

$
0
0
Hi

I am trying to get the date picker to work and do nto seem to be able to below is the oracle SQL I am using

select J.ID, LI.source,J.ISSUENUM,J.SUMMARY,J.RESOLUTIONDATE, J.ASSIGNEE,S.pname,ja.actiontype,JA.UPDATEAUTHOR,to_char(ja.actionbody),concat(concat(p.pkey,'-'),us.ISSUENUM) as jiraid,us.summary as userstory
from jiraissue j, issuetype i, issuelink li, jiraaction ja, customfieldoption co,issuestatus s,project p, (select j.id,J.ISSUENUM, J.PROJECT, J.SUMMARY from jiraissue j,issuestatus s where J.ISSUETYPE=6 and J.ISSUESTATUS =6 AND J.ISSUESTATUS = S.ID) us
where J.PROJECT = 15810
and J.ISSUETYPE =I.ID
and J.ID=JA.ISSUEID(+)
and li.DESTINATION=J.ID
and CO.CUSTOMVALUE=J.SUMMARY
AND J.ISSUESTATUS = S.ID
and j.project =us.project
and li.source=us.id
and P.ID = J.PROJECT
and i.id = 7
and S.ID =6
and to_date(J.UPDATED) >= to_date(${date},'DD/MM/YYYY')
and li.linktype =10000
and CO.CUSTOMFIELD=12340
and CO.CUSTOMFIELDCONFIG=21020
and LI.source in(select distinct(cv.ISSUE)
from customfieldvalue cv, jiraissue j
where CV.ISSUE=j.id
and CV.CUSTOMFIELD =12340
and J.PROJECT = 15810)

here is the parameter I have set up as it is at the moment I have also tried to use just date and also change how the to_date works in the sql above. As I cannot see what SQL is produced with the paramter set as is I cannto work out what I have done wrong :(.
date.jpg

What am I doing wrong?

Many thanks
Peter
Attached Images

Pentaho 6 CE Browser Compatibility

$
0
0
I just installed Pentaho 6 and I am unable to view PRD reports in Chrome (version 46.0.2490.80m/Windows 7). The tab for the report pops up, but remains blank and the parameter selections never appear.
Chrome.jpg

In IE (version 11.0.9600.18059) it's even worse. None of the pages are rendered correctly. The home page is completely blank and the Browse Files page is unusable.
IE.jpgIE2.jpg

Firefox is working fine however. I am also getting the following error in pentaho.log, I'm not sure if it's related.
Code:

2015-11-06 07:14:22,492 ERROR [org.apache.aries.blueprint.container.BlueprintContainerImpl] Unable to start blueprint container for bundle pentaho-requirejs-osgi-managerorg.osgi.service.blueprint.container.ComponentDefinitionException: Unable to initialize bean configManager
        at org.apache.aries.blueprint.container.BeanRecipe.runBeanProcInit(BeanRecipe.java:714)
        at org.apache.aries.blueprint.container.BeanRecipe.internalCreate2(BeanRecipe.java:824)
        at org.apache.aries.blueprint.container.BeanRecipe.internalCreate(BeanRecipe.java:787)
        at org.apache.aries.blueprint.di.AbstractRecipe$1.call(AbstractRecipe.java:79)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at org.apache.aries.blueprint.di.AbstractRecipe.create(AbstractRecipe.java:88)
        at org.apache.aries.blueprint.container.BlueprintRepository.createInstances(BlueprintRepository.java:245)
        at org.apache.aries.blueprint.container.BlueprintRepository.createAll(BlueprintRepository.java:183)
        at org.apache.aries.blueprint.container.BlueprintContainerImpl.instantiateEagerComponents(BlueprintContainerImpl.java:682)
        at org.apache.aries.blueprint.container.BlueprintContainerImpl.doRun(BlueprintContainerImpl.java:377)
        at org.apache.aries.blueprint.container.BlueprintContainerImpl.run(BlueprintContainerImpl.java:269)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at org.apache.aries.blueprint.container.ExecutorServiceWrapper.run(ExecutorServiceWrapper.java:106)
        at org.apache.aries.blueprint.utils.threading.impl.DiscardableRunnable.run(DiscardableRunnable.java:48)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
Caused by: Unexpected character (s) at position 0.
        at org.json.simple.parser.Yylex.yylex(Yylex.java:610)
        at org.json.simple.parser.JSONParser.nextToken(JSONParser.java:269)
        at org.json.simple.parser.JSONParser.parse(JSONParser.java:118)
        at org.json.simple.parser.JSONParser.parse(JSONParser.java:92)
        at org.pentaho.js.require.RequireJsConfigManager.loadJsonObject(RequireJsConfigManager.java:135)
        at org.pentaho.js.require.RequireJsConfigManager.updateBundleContext(RequireJsConfigManager.java:82)
        at org.pentaho.js.require.RequireJsConfigManager.init(RequireJsConfigManager.java:218)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.aries.blueprint.utils.ReflectionUtils.invoke(ReflectionUtils.java:297)
        at org.apache.aries.blueprint.container.BeanRecipe.invoke(BeanRecipe.java:958)
        at org.apache.aries.blueprint.container.BeanRecipe.runBeanProcInit(BeanRecipe.java:712)
        ... 21 more

Attached Images

Other ways to reach PDI Marketplace?

Strange Error in PDI Job

$
0
0
We have a job that runs hourly and it has many SQL Script steps that call stored procedures.

Every once in a while (about every 3 days), the job fails with an "invalid object" which happens to be a global temp table: ##TEMPTARG.

I am still trying to determine if this is a SQL Server problem or a PDI problem (release 5.3)

Anyone see this before ? (see log below)

2015/11/06 03:07:05 - CONV_HRLY_CALLRPT_RUNALL - Starting entry [CONV_HRLY_CALLRPT_RUNALL]

2015/11/06 03:07:05 - CONV_HRLY_CALLRPT_RUNALL - Loading transformation from repository [CONV_HRLY_CALLRPT_RUNALL] in directory [/home/Hourly Report]

2015/11/06 03:07:05 - CONV_HRLY_CALLRPT_RUNALL - Dispatching started for transformation [CONV_HRLY_CALLRPT_RUNALL]

2015/11/06 03:07:30 - Execute SQL script.0 - ERROR (version 5.3.0.0-213, build 1 from 2015-02-02_12-17-08 by buildguy) : An error occurred, processing will be stopped:

2015/11/06 03:07:30 - Execute SQL script.0 - Couldn't execute SQL: [CA_DW_PROD].dbo.CONV_HRLY_RPT_RUNALL 0, 0

2015/11/06 03:07:30 - Execute SQL script.0 -

2015/11/06 03:07:30 - Execute SQL script.0 - Invalid object name '##TEMPTARG'.

2015/11/06 03:07:30 - Execute SQL script.0 - ERROR (version 5.3.0.0-213, build 1 from 2015-02-02_12-17-08 by buildguy) : Error initializing step [Execute SQL script]

2015/11/06 03:07:30 - CONV_HRLY_CALLRPT_RUNALL - ERROR (version 5.3.0.0-213, build 1 from 2015-02-02_12-17-08 by buildguy) : Step [Execute SQL script.0] failed to initialize!

2015/11/06 03:07:30 - Execute SQL script.0 - Finished reading query, closing connection.

2015/11/06 03:07:30 - CONV_HRLY_CALLRPT_RUNALL - ERROR (version 5.3.0.0-213, build 1 from 2015-02-02_12-17-08 by buildguy) : Unable to prepare for execution of the transformation

2015/11/06 03:07:30 - CONV_HRLY_CALLRPT_RUNALL - ERROR (version 5.3.0.0-213, build 1 from 2015-02-02_12-17-08 by buildguy) : org.pentaho.di.core.exception.KettleException:

2015/11/06 03:07:30 - CONV_HRLY_CALLRPT_RUNALL - We failed to initialize at least one step. Execution can not begin!

2015/11/06 03:07:30 - CONV_HRLY_CALLRPT_RUNALL -

2015/11/06 03:07:30 - CONV_HRLY_CALLRPT_RUNALL -

2015/11/06 03:07:30 - CONV_HRLY_CALLRPT_RUNALL - at org.pentaho.di.trans.Trans.prepareExecution(Trans.java:1149)

2015/11/06 03:07:30 - CONV_HRLY_CALLRPT_RUNALL - at org.pentaho.di.trans.Trans.execute(Trans.java:607)

2015/11/06 03:07:30 - CONV_HRLY_CALLRPT_RUNALL - at org.pentaho.di.job.entries.trans.JobEntryTrans.execute(JobEntryTrans.java:1062)

2015/11/06 03:07:30 - CONV_HRLY_CALLRPT_RUNALL - at org.pentaho.di.job.Job.execute(Job.java:716)

2015/11/06 03:07:30 - CONV_HRLY_CALLRPT_RUNALL - at org.pentaho.di.job.Job.execute(Job.java:859)

2015/11/06 03:07:30 - CONV_HRLY_CALLRPT_RUNALL - at org.pentaho.di.job.Job.execute(Job.java:859)

2015/11/06 03:07:30 - CONV_HRLY_CALLRPT_RUNALL - at org.pentaho.di.job.Job.execute(Job.java:598)

2015/11/06 03:07:30 - CONV_HRLY_CALLRPT_RUNALL - at org.pentaho.di.job.entries.job.JobEntryJobRunner.run(JobEntryJobRunner.java:69)

2015/11/06 03:07:30 - CONV_HRLY_CALLRPT_RUNALL - at java.lang.Thread.run(Unknown Source)

2015/11/06 03:07:30 - CONV_HRLY_CALLRPT_RUNALL - Finished job entry [CONV_HRLY_CALLRPT_RUNALL] (result=[false])

how to break out of the row processing main loop

$
0
0
Hello everyone. Apologies if this is the wrong forum, or a dumb/obvious question, but I'm not having much luck with google, so I thought I'd ask here.

I'm using BMC's "AtriumIntegrator" product, which as far as I can tell is just Spoon/Kettle duct taped onto their Remedy product. But anyhow ... I need to create a transformation that will suck some data out of some tables, and generate a set of CSV spreadsheets, then send them as attachments on an email message.

So I need a transformation that can do something like:

1) query
2) text file output (write csv file to directory on server)
3) ??? do something only once that handles the output file of step #2

step #3 could be a direct email action (though I don't see that option in the "palette"), or it could be a step that mime-encodes the output file from step #2 and inserts it into a database table (AROutput, which will trigger workflow on the remedy server that sends the email).

Either way, I can't seem to break out of the "data stream" paradigm (a main loop that is processing rows). I don't need to process rows anymore. I'm done doing that. Now I need to perform an action just once that handles the result of processing the rows.

Again, I'm sorry if this is a dumb / obvious question. If someone can just point me in the general direction of the answer I can take it from there I think.

Copy Tables Wizard - bug

$
0
0
Hi,

I'm attempting to use the Copy Tables Wizard to copy multiple tables from one database to another. I am using repositories and have set up the source and target SQL connections correctly.

However, I hit a condition in the gui whenever using the wizard. Once the source and target databases have been chosen, I'm asked to specify a name for the transforms that are generated. However, another "Progress Information" dialogue appears at this point, making it impossible to enter a name in the box below. Clicking Cancel on this just seems to cause things to hang (the box does not close). Here's a screenshot:

http://www.screencast.com/t/EqhQxFdxV4Ge

This seems to make the Copy Tables Wizard unusable.

It looks as if there was a bug filed on this in March 2014, and several people have had the same issue - but there isn't any update or workaround listed. Has anyone else experienced the same issue, and is there anything that can be done?

http://jira.pentaho.com/browse/PDI-11891

Tom

Pentaho CDE Heat Grid bubble chart

$
0
0
I have used ccc heat grid to create a bubble chart. The bubble chart is working fine but I want conditional formatting on the bubbles. I have six values in my database, namely: 1, 1.1, 2, 2.1, 3, 3.1

1 - red color without alarm
2-green color without alarm
3- yellow color without alarm

1.1- red color with alarm
2.1-green color with alarm
3.1-yellow color with alarm

I have used colorRole property and set three colors: red, green and yellow. So, all the bubbles are of same size and it is automatically assigning 1 and 1.1 to red; 2 and 2.1 to green and; 3 and 3.1 to yellow. I want the bubbles with alarms (1.1, 2.1 and 3.1) to be of bigger size or different shapes like cross or square.

I tried to fetch these values in pre-execution as this.scene.vars.values and use dot_fillStyle or dot_shape but it says cars not defined.

Please help me resolve this issue.

How do I install from Marketplace?

$
0
0
I've tried installing CDA, CDE, and Saiku Analytics using Marketplace, but it trashes my server and prevents me from even logging in? Clearly installing from Marketplace is not as simple as "one click". what am I missing?

How to link an image to PRD

$
0
0
Hello!
I have an images in the folder on Desktop. Also there is a table in SQL existing a column with the name of image in a folder.
Help pls, how can I display image on PRD entering ID of object from the SQL-table?

convert two tables into a cube - how?

$
0
0
Hello Community,

I'm currently running a Python script, that is doing the following for me:

Table 1 # Computer Assets and OS-Ver
Table 2 # Hot-Fix installed

Phase 1:
Get unique OS-Ver_Family from Assets
Foreach OS-Ver_Family
- Create table OS-Ver_Family: AssetID not null
- Get unique Hot-Fix_Name from Hot-Fix where Assets.OS-Ver-Family
-- Foreach Hot-Fix_Name
--- Add column Hot-Fix_Name to table OS-Ver_Family: default false

Phase 2:
Foreach OS-Ver_Family
- Get Assets, insert AssetID into OS-Ver_Family
- Get Hot-Fix_Name where AssetID
- Foreach Hot-Fix_Name
-- Update Hot-fix_Name = true in OS-Ver_Family

As a result, I've a table for each OS Version, telling me all possible hot-fixes installed and if the hot-fix itself is installed on a specific asset.

How can I do the same, using PDI?

Any help. highly appreciated.

Setup pig process parameter in kettle

$
0
0
Hi ,
how setup Pentaho pig module with -useHCatalog parameter ?

Updated user password cannot use immediately

$
0
0
Hi forum,

After I changed password in Pentaho Admin Console and login with this new password to Pentaho User Console, password does not match error is raised and when I use old password, login is successful.

But, after I changed password and restart the BI server, new pasword can be used.

Is that bug??

Or

Do I need some setting to be able to use changed password without restarting the BI server??
Viewing all 16689 articles
Browse latest View live