Quantcast
Channel: Pentaho Community Forums
Viewing all 16689 articles
Browse latest View live

CDB does not work


Ignore insert errors

$
0
0
Hello,

I am loading from a mongodb table to mysql table using kettle 4.4
one of the column at some row gives an error : Incorrect string value: '\xF0\x9F\x98\x8D' for column.
I checked some of the forums and modified the column to utf8mb4_general_ci , but still it gives the same error.

The table has 12 lakhs + records and I am not able to identify which row is giving the error.
In the table there is _id which is object id. I tried to load with order by on _id column and when it stopped with the error, then tried to load with > max(_id) from my previous load.
With this it gives duplicates and am not able to identify which row is giving the error.

1) Is there a way to identify which row is giving the error or to solve this error?

2) In the table output step, there is a option called insert ignore errors, i checked it and tried to run.
Now it does not give me any errors, but on kettle it shows no. of records written as 1192628 but the table has only 1192626 records.
So 2 records are missing.
Does ignore insert errors option ignores the lines with errors?
If so where are these errors logged ?
I tried to read some documents but none of them have this info.

It would be great if anyone of you could help me.

Thank you,
Deepthi

Mondrian failed to support subselects with arbitrary shapes

$
0
0
It looks like currently Mondrian failed to support some arbitrary shape "sub-select" queries. For example, as the following one, which is supported by MS Analysis Service.

SELECT NON EMPTY Hierarchize(
DrilldownMember(CrossJoin({[Store.Store_City].[All Cities],[Store.Store_City].[Store_City].Members},
{([Store.Store_Name].[All Store Names])}), {-{[Store.Store_City].[Hidalgo]}}, [Store.Store_Name]))
DIMENSION PROPERTIES PARENT_UNIQUE_NAME,HIERARCHY_UNIQUE_NAME ON COLUMNS FROM [Store]


So my question here:
* will Mondrian be going to support it in the near future?
* I'm not an expert in MDX, but could any one tell me what is the equivalent "non arbitrary shape" MDX (which's supported by Mondrian) of the above MDX query?

Thanks for help.

Spoon (Kettle, data integration) is REALLY buggy

$
0
0
I have received several Java Exception Tracebacks from Spoon in just 2 days usage. It is really buggy.

I received the following stack dump just doing a Preview of a table input from a table in a SQL Server database. The SQL query was extremely simple (select a_few_fields from table;).

Code:

java.lang.NullPointerException
    at org.pentaho.di.trans.steps.joinrows.JoinRows.dispose(JoinRows.java:477)
    at org.pentaho.di.trans.Trans.prepareExecution(Trans.java:906)
    at org.pentaho.di.ui.spoon.trans.TransGraph.debug(TransGraph.java:3444)
    at org.pentaho.di.ui.spoon.delegates.SpoonTransformationDelegate.executeTransformation(SpoonTransformationDelegate.java:920)
    at org.pentaho.di.ui.spoon.Spoon$31$1.run(Spoon.java:7619)
    at org.eclipse.swt.widgets.RunnableLock.run(Unknown Source)
    at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Unknown Source)
    at org.eclipse.swt.widgets.Display.runAsyncMessages(Unknown Source)
    at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)
    at org.pentaho.di.ui.spoon.Spoon.readAndDispatch(Spoon.java:1221)
    at org.pentaho.di.ui.spoon.Spoon.waitForDispose(Spoon.java:7044)
    at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:8304)
    at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:580)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.pentaho.commons.launcher.Launcher.main(Launcher.java:134)

Anyone have any ideas what the problem is?

Creating CWM/XMI from Mondrian.xml

$
0
0
Curious if there is a way to create the CWM/XMI files from a Mondrian.xml schema. If so would someone be able to walk me through how to do this? I assume it would be done in the MetadataEditor but not exactly sure.

Retain label after PCA filtering

$
0
0
I'm using Weka 3.6.9 on Windows 8.

-I load a labeled training set and pass it through the PCA filter.
--The principle components show up as the new attributes for the data set.
-The class of each instance is now missing.

How do I perform PCA but keep the label of each instance?

Getting error when trying to remove partition schema.

$
0
0
I was playing with partitioning in Kettle, but now I'm getting error when trying to remove schema
I checked everywhere to make sure it's not used anywhere. Any thoughts?

org.pentaho.di.core.exception.KettleDependencyException:
This partition schema is still in use by one or more transformations (1) :


The partition schema is used by the following transformations:
/trans1








at org.pentaho.di.repository.kdr.delegates.KettleDatabaseRepositoryPartitionSchemaDelegate.delPartitionSchema(KettleDatabaseRepositoryPartitionSchemaDelegate.java:216)
at org.pentaho.di.repository.kdr.KettleDatabaseRepository.deletePartitionSchema(KettleDatabaseRepository.java:1174)
at org.pentaho.di.ui.repository.repositoryexplorer.controllers.PartitionsController.removePartition(PartitionsController.java:211)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.pentaho.ui.xul.impl.AbstractXulDomContainer.invoke(AbstractXulDomContainer.java:329)
at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:139)
at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:123)
at org.pentaho.ui.xul.swt.tags.SwtButton.access$300(SwtButton.java:26)
at org.pentaho.ui.xul.swt.tags.SwtButton$2.mouseUp(SwtButton.java:87)
at org.eclipse.swt.widgets.TypedListener.handleEvent(Unknown Source)
at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)
at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)
at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source)
at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)
at org.eclipse.jface.window.Window.runEventLoop(Window.java:820)
at org.eclipse.jface.window.Window.open(Window.java:796)
at org.pentaho.ui.xul.swt.tags.SwtDialog.show(SwtDialog.java:378)
at org.pentaho.ui.xul.swt.tags.SwtDialog.show(SwtDialog.java:304)
at org.pentaho.di.ui.repository.repositoryexplorer.RepositoryExplorer.show(RepositoryExplorer.java:133)
at org.pentaho.di.ui.spoon.Spoon$20$1.run(Spoon.java:3550)
at org.eclipse.swt.widgets.RunnableLock.run(Unknown Source)
at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Unknown Source)
at org.eclipse.swt.widgets.Display.runAsyncMessages(Unknown Source)
at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)
at org.pentaho.di.ui.spoon.Spoon.readAndDispatch(Spoon.java:1219)
at org.pentaho.di.ui.spoon.Spoon.waitForDispose(Spoon.java:7049)
at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:8309)
at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:578)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.pentaho.commons.launcher.Launcher.main(Launcher.java:134)
Caused by: org.pentaho.di.core.exception.KettleDependencyException:
The partition schema is used by the following transformations:
/trans1

java.lang.NullPointerException on Kettle 4.4.0 LoggingRegistry

$
0
0
Hello,

We have been using Kettle 4.1.0 for more than a year to load some files into an ORACLE Database and recently we upgraded to Kettle 4.4.0.
After the upgrade, sometimes we have the following error and we need to start over again to finish the process:

Unexpected error occurred while launching entry [job_trans_principal_cvm.0]
at java.lang.Thread.run (null:-1)
at org.pentaho.di.job.Job$1.run (Job.java:703)
at org.pentaho.di.job.Job.access$000 (Job.java:103)
at org.pentaho.di.job.Job.execute (Job.java:617)
at org.pentaho.di.core.logging.Log4jBufferAppender.getBuffer (Log4jBufferAppender.java:167)
at org.pentaho.di.core.logging.Log4jBufferAppender.getBuffer (Log4jBufferAppender.java:171)
at org.pentaho.di.core.logging.Log4jBufferAppender.getBuffer (Log4jBufferAppender.java:158)
at org.pentaho.di.core.logging.Log4jBufferAppender.getLogBufferFromTo (Log4jBufferAppender.java:150)
at org.pentaho.di.core.logging.LoggingRegistry.getLogChannelChildren (LoggingRegistry.java:207)
at org.pentaho.di.core.logging.LoggingRegistry.getLogChannelChildren (LoggingRegistry.java:236)
at org.pentaho.di.core.logging.LoggingRegistry.getLogChannelChildren (LoggingRegistry.java:236)
at org.pentaho.di.core.logging.LoggingRegistry.getLogChannelChildren (LoggingRegistry.java:236)
at org.pentaho.di.core.logging.LoggingRegistry.getLogChannelChildren (LoggingRegistry.java:236)
at org.pentaho.di.core.logging.LoggingRegistry.getLogChannelChildren (LoggingRegistry.java:221)
at java.util.concurrent.ConcurrentHashMap.get (null:-1)

at org.pentaho.di.job.Job$1.run(Job.java:709)
at java.lang.Thread.run(Unknown Source)
Caused by: java.lang.NullPointerException
at java.util.concurrent.ConcurrentHashMap.get(Unknown Source)
at org.pentaho.di.core.logging.LoggingRegistry.getLogChannelChildren(LoggingRegistry.java:221)
at org.pentaho.di.core.logging.LoggingRegistry.getLogChannelChildren(LoggingRegistry.java:236)
at org.pentaho.di.core.logging.LoggingRegistry.getLogChannelChildren(LoggingRegistry.java:236)
at org.pentaho.di.core.logging.LoggingRegistry.getLogChannelChildren(LoggingRegistry.java:236)
at org.pentaho.di.core.logging.LoggingRegistry.getLogChannelChildren(LoggingRegistry.java:236)
at org.pentaho.di.core.logging.LoggingRegistry.getLogChannelChildren(LoggingRegistry.java:207)
at org.pentaho.di.core.logging.Log4jBufferAppender.getLogBufferFromTo(Log4jBufferAppender.java:150)
at org.pentaho.di.core.logging.Log4jBufferAppender.getBuffer(Log4jBufferAppender.java:158)
at org.pentaho.di.core.logging.Log4jBufferAppender.getBuffer(Log4jBufferAppender.java:171)
at org.pentaho.di.core.logging.Log4jBufferAppender.getBuffer(Log4jBufferAppender.java:167)
at org.pentaho.di.job.Job.execute(Job.java:617)
at org.pentaho.di.job.Job.access$000(Job.java:103)
at org.pentaho.di.job.Job$1.run(Job.java:703)
... 1 more

Can somebody help us with this issue?

Define Size of dot

$
0
0
friends,


someone has managed to change the size of the point on the graph CCC Dot Chart dynamically the third dimension?


I've tried (dot_ShapeRadius, dor_ShapeSize)


I've tried the component Protovis, but such property does not work.


My recordser CDA:
CDA.jpg


Component Protovis:
=====================================
function(vis,queryResult){


var data = queryResult.resultset.map
(
function(d) {
return {
x: d[0],
y: d[1],
z: d[2],
t: d[3]
};
}
);




/* Sizing and scales. */
var w = this.width,
h = this.height,
x = pv.Scale.linear(-0.1, 100).range(0, w),
y = pv.Scale.linear(-0.1, 100).range(0, h),
c = pv.Scale.log(1, 100).range("orange", "brown");




/* Y-axis and ticks. */
vis.add(pv.Rule)
.data(y.ticks())
.bottom(y)
.strokeStyle(function(d) { return d ? "#eee" : "#000" } )
.anchor("left").add(pv.Label)
.visible(function(d) { return d > 0 && d < 1 } )
.text(y.tickFormat);


/* X-axis and ticks. */
vis.add(pv.Rule)
.data(x.ticks())
.left(x)
.strokeStyle(function(d) { return d ? "#eee" : "#000" } )
.anchor("bottom").add(pv.Label)
.visible(function(d) { return d > 0 && d < 1} )
.text(x.tickFormat);


/* The dot plot! */
vis.add(pv.Panel)
.data(data)
.add(pv.Dot)
.left(function(d) { return x(d.x) })
.bottom(function(d) { return y(d.y) } )
.strokeStyle(function(d) { return c(d.z) } )
.fillStyle(function() { return this.strokeStyle().alpha(.2) } )
.shape("circle") // "circle", "square", "triangle", "cross", "diamond"
.size ( function (d) { { return c(d.z) } ) // ******* NOT WORK
.title(function(d)
{
return d.t + ' - ' + (d.z) + '%, Faturamento ' + d.x + ' Servico' + d.y
}
);
}

Component CCC DOT CHART:
=====================================
"id": "3eff7a18-7411-4bc0-90e7-8bc5a231f7bc",
"type": "ComponentscccDotChart",
"typeDesc": "CCC Dot Chart",
"meta_cdwSupport": "true",
"parent": "CHARTS",
"properties": [
{
{
"name": "cccExtensionPoints",
"value": "[[\"dot_shapeSize\",\"function(d) { return d.z; }\"]]",
"type": "ValuesArray"
},

]
}
Attached Images

PDI, Postgres and Transactions

$
0
0
Hi,

I've just started to work with Postgres

I have an Insert / Update step
for debugging I've set transaction size one record
I've defined error handling step

during the transformation one record is failed to insert due to unique constraint violation
this one record was handled and logged by error handling

next 4215 records was not processed with following error message
err_desc = org.pentaho.di.core.exception.KettleDatabaseException:
Error looking up row in database
ERROR: current transaction is aborted, commands ignored until end of transaction block

I'n new to Postgres, this exact setting used to work with MySQL
is it possible that I'm missing some parameters in connection setting ?

Pentaho error

$
0
0
Hi, i am still new with the pentaho BI and much appreciate if you guys could assist me on the following error while starting the tomcat pentaho.

Jul 29, 2013 9:45:49 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [/pentaho] created a ThreadLocal with key of type [java.lang.InheritableThreadLocal] (value [java.lang.InheritableThreadLocal@1de0b09]) and
a value of type [org.pentaho.platform.engine.security.session.TrustedSystemStartupSession] (value [org.pentaho.platform.engine.security.session.TrustedSystemStartupSess
ion@15a4a77]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Jul 29, 2013 9:45:50 AM org.apache.coyote.http11.Http11Protocol destroy
INFO: Stopping Coyote HTTP/1.1 on http-8280


Thanks

Filter Rows

$
0
0
Hi

I have doubt in filter rows step.. Actually my requirement is to check the condition and depends upon the condition my next step should execute.. Filter.PNG

PFA image . this is my requirement. It should check one condition and depends upon the condition it should follow the next step.
If i use filter rows step , both true and false step gets executed.
But i want only either true or false step depends upon the condition given.


What can i do for this?

Thanks in advance
Vicky
Attached Images

Parallel execution of transformations -Multiple Predecessor Dependency not working

$
0
0
Hi,

I am using Pentaho 4.2.0 on Linux environment.

I have to run five independent transformations(A,B,C,F,G) and one dependent transformation(I) on all other 5.

so i need to run these 5 transformations in parallel, after each transformation gave the links to transformation 'I'.

Now final Transformation 'I' must be executed after all 5 t/r executions are completed,But what happening is after each transformation executes the final transformation is being executed. So "I" is executing 5 times.


Below are the complete job flow and attachment shows the log file of job.


Can any one help me on this, i want "I" to wait until all the 5 transformations executed.

Thanks,
Siva
Attached Images
Attached Files

Display type of an item in Pentaho Report Designer

$
0
0
Hello all,

First of all I'm completly new with Pentaho report designer. Until now I worked with BIRT Eclipse and now I'm trying to find similarities to it.

My first question is if Pentaho report designer has a property for display type like BIRT eclipse does. I'll attach an image of this property in BIRT eclipse to be more exactly. I am trying to use this property to have an item displayed or not conditionated by a script.

eclipse display.jpg

My second question is related to BIRT Eclipse's grid. I didn't find any simillar item in Pentaho report designer. Is there something related to this item in Pentaho, or I'll have to rethink my layouts?

Thank you in advance for your answers.

Best regards,
Dragos.
Attached Images

Multiple user access problem in Community Edition

$
0
0
Hi,

I am using pentaho 4.2.0 community edition in linux environment.

I came to know that in CE, Only one user can edit&save job/transformation at a time,

If multiple users are working on the same repository, while saving job or transformation its getting locked and waiting for releasing lock until the other user logouts from repository.

Can any one help me on this to access multiple users at a time in CE.

Thanks,
Siva

Paging the output of a CDA query

$
0
0
Hi,
can I paging the output of a CDA query ?

If I have many records, can I paging the output ?

Thank you
Giovanni

Olap Selector Component "Error processing component"

$
0
0
Hello,
I'm trying to use the Olap Selector Component in a dashboard.
I'm using a stock pentaho (download&run), and I've installed CDE, CDF, CCC and Saiku by using the ctools-installer.sh
I've a cube called 'Sales', and it works great by using Saiku OLAP tool.


But when I try to run a dashboard with the olap selector (a plain one, with just the selector), it gives me "Error processing component (Clients)"
This is the configuration of the component:

olapselectorError.jpg

The pentaho.log also shows
Code:

ERROR [pt.webdetails.cdf.dd.olap.OlapUtils] Received catalog 'solution:Demo/cube.xml' doesn't appear to be valid
ERROR [pt.webdetails.cdf.dd.olap.OlapUtils] Failed to get valid connection

Any suggestion? Am I doing something wrong?

Thanks!
Cheers
Attached Images

Generate XMI file with metadata API

$
0
0
Morning all,
I am trying to generate an XMI file automatically by the API. At moment I can read an XMI file that already exists and save it in other file.
I can't modify it :(... I don't understand the hierarchy behind the domains, logical tables, logical column.
Someone can halp me? I would know what classes I must use to modify, add or delete a table (and columns) in a schema.

Thanks to all,

Christian

How to invoke IRR function in Modrian MDX?

$
0
0
I need to use IRR function in my business rule MDX, but seems this VBA function in mondrian only takes double array as input argument. Is it true that I can not invoke IRR function directly via Mondrian MDX syntax? If so, any instruction on using custom function or other way to invoke IRR function? Many thanks! Joe

Exclude some of the columns while exporting to excel in CDA

$
0
0
I am using CDE to create dashboard and that has list of records displayed using table component and used export to excel functionality.

I want to exclude some of the columns while exporting to the excel.

Lets say - I am showing X, Y and Z column on UI and while exporting I want to just show X and Y only in the excel.

Can any one please help me to solve it?

Regards
Vinayak
Viewing all 16689 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>