Quantcast
Channel: Pentaho Community Forums
Viewing all 16689 articles
Browse latest View live
↧

Dimension / Fact table maintenance best practice

June 26, 2015, 7:59 am
$
0
0
We are just starting with Pentaho DI and don't want to re-invent the wheel.

We are looking for advice on what would be the best way to use Spoon / Kettle facilities to perform the typical Dimension / Fact building activity? Is there a standard / best practice way to do it? Spoon Steps designated to perform it? Any tips on how to potentially do the lookups/inserts of all Dimension tables in parallel?

1. The process reads next detail (Fact) record.
2. Some attributes of this Fact record need to be moved into Dimension tables and replaced with the id of the corresponding record in the Dimension table.
3. In order to get this id, we search the Dimension table using one or more Detail table attributes.
3.1. If a corresponding record is not found, it is created using all the available search attribute(s).
3.2. The id of the found or newly created record is passed back and assigned to the column in the Fact table.

Thank you,
-- Alex
↧
Search

Simple CGG dial error

June 26, 2015, 8:18 am
$
0
0
Hi all,

When testing a simple CGG dial all I get is a error like this:
"Erro no processamento de XML: nenhum elemento encontrado (....) Numero da linha 1, coluna 1"

Any ideas?
Thanks in advance,
Antonio
↧
↧

new date() returned the wrong time in modified javascript step.

June 26, 2015, 8:29 am
$
0
0
the new date() in javascript step return the below time and date:

Fri June 26 2015 15:26:08 GMT

But I expect Fri June 26 05 11:26:08 Eastern daylight

what is wrong here?

please help
↧

CDF: Object type exportButton can't be mapped to a valid class

June 26, 2015, 8:57 am
$
0
0
Hi -

We're seeing this error in the javascript log:
cdf-bootstrap-script-includes.js?v=18d860da02b801309bfa785ee69d2c63:4555 CDF: Object type exportButton can't be mapped to a valid class

Additionally, some of our export Buttons no longer render.

This only occurs on our production server. We basically copy all of the files from biserver-ci over to production, while keeping the existing repository in place. I think there might be some state stored in the repository that is causing this issue, but deleting the repository entirely and starting fresh doesn't seem to work either.

We are using biserver 5.3.013 and CTools 15.04.16. Does anyone have any suggestions on how to debug this?


↧

how to load huge data, using sync after merge or filter step

June 26, 2015, 9:01 am
$
0
0
Hi All,

I am trying to load just 52 lakhs(5200000) of records from MySql oltp to MySql olap. I am getting issue at insert/update step because of this reason i have changed my .trn from insert/update step to synchronize after merge step and another approach filter rows step( it will write the rows if those are new then using table output step) if those are old then will update using update step.

But still my jobs is very slow and it is failing and getting error as stack over flow and java heap space error due to that i have implemented java script logic and it will loop the job with 5000 records. finally i am able to run successfully but it is too much slow.

i used below steps , can someone suggest me in better way to improve my jobs performance.

using PDI CE 5.3 with java 1.8 64 bit

connections.jpg

filter step.png

Sync merge.jpg
Attached Images
↧
↧

5.4 - GRAVE: The RuntimeException could not be mapped to a response (...)

June 26, 2015, 11:42 am
$
0
0
So, I get this error when trying to add a new Role for users. Any ideas?
I just unpacked 5.4 and the only change I've made was allowing URL authentication.

Full error message:
Code:
Jun 26, 2015 3:40:28 PM com.sun.jersey.spi.container.ContainerResponse mapMappableContainerException
GRAVE: The RuntimeException could not be mapped to a response, re-throwing to the HTTP container
org.pentaho.platform.api.engine.security.userroledao.AlreadyExistsException:
    at org.pentaho.platform.security.userroledao.jackrabbit.JcrUserRoleDao.createRole(JcrUserRoleDao.java:123)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
    at java.lang.reflect.Method.invoke(Unknown Source)
    at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:307)
    at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
    at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)
    at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:106)
    at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
    at org.springframework.security.intercept.method.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:66)
    at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
    at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
    at com.sun.proxy.$Proxy28.createRole(Unknown Source)
    at org.pentaho.platform.web.http.api.resources.UserRoleDaoResource.createRole(UserRoleDaoResource.java:480)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
    at java.lang.reflect.Method.invoke(Unknown Source)
    at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
    at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)
    at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
    at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)
    at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
    at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
    at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
    at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
    at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1511)
    at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1442)
    at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1391)
    at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1381)
    at com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
    at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:538)
    at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:716)
    at org.pentaho.platform.web.servlet.JAXRSServlet.service(JAXRSServlet.java:108)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
    at org.pentaho.platform.web.servlet.JAXRSServlet.service(JAXRSServlet.java:113)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
    at org.pentaho.platform.web.http.filters.PentahoWebContextFilter.doFilter(PentahoWebContextFilter.java:185)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
    at org.pentaho.platform.web.http.filters.PentahoRequestContextFilter.doFilter(PentahoRequestContextFilter.java:87)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
    at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:378)
    at org.springframework.security.intercept.web.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:109)
    at org.springframework.security.intercept.web.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:83)
    at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:390)
    at org.springframework.security.ui.ExceptionTranslationFilter.doFilterHttp(ExceptionTranslationFilter.java:101)
    at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53)
    at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:390)
    at org.springframework.security.providers.anonymous.AnonymousProcessingFilter.doFilterHttp(AnonymousProcessingFilter.java:105)
    at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53)
    at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:390)
    at org.pentaho.platform.web.http.security.RequestParameterAuthenticationFilter.doFilter(RequestParameterAuthenticationFilter.java:189)
    at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:390)
    at org.springframework.security.ui.basicauth.BasicProcessingFilter.doFilterHttp(BasicProcessingFilter.java:174)
    at org.pentaho.platform.web.http.security.PentahoBasicProcessingFilter.doFilterHttp(PentahoBasicProcessingFilter.java:115)
    at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53)
    at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:390)
    at org.springframework.security.context.HttpSessionContextIntegrationFilter.doFilterHttp(HttpSessionContextIntegrationFilter.java:235)
    at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53)
    at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:390)
    at org.pentaho.platform.web.http.filters.HttpSessionPentahoSessionIntegrationFilter.doFilter(HttpSessionPentahoSessionIntegrationFilter.java:263)
    at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:390)
    at org.springframework.security.wrapper.SecurityContextHolderAwareRequestFilter.doFilterHttp(SecurityContextHolderAwareRequestFilter.java:91)
    at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53)
    at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:390)
    at org.springframework.security.util.FilterChainProxy.doFilter(FilterChainProxy.java:175)
    at org.springframework.security.util.FilterToBeanProxy.doFilter(FilterToBeanProxy.java:99)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
    at org.pentaho.platform.web.http.filters.SystemStatusFilter.doFilter(SystemStatusFilter.java:55)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
    at org.pentaho.platform.web.http.filters.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:114)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
    at org.pentaho.platform.web.http.filters.WebappRootForwardingFilter.doFilter(WebappRootForwardingFilter.java:70)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
    at org.pentaho.platform.web.http.filters.PentahoPathDecodingFilter.doFilter(PentahoPathDecodingFilter.java:34)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
    at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
    at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
    at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:470)
    at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
    at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
    at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
    at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
    at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:861)
    at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:620)
    at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
    at java.lang.Thread.run(Unknown Source)
Also, can't save Sparkl Dashboard template, gives me this log error (nothing shows on CDE, misleading to save being successful):

Code:
Reference number: d5650332-12b6-4b54-8e4c-0ef71bdc5dd8

        at org.pentaho.platform.repository2.unified.exception.AccessDeniedExceptionConverter.convertException(AccessDeniedExceptionConverter.java:31)
        at org.pentaho.platform.repository2.unified.ExceptionLoggingDecorator.callLogThrow(ExceptionLoggingDecorator.java:506)
        at org.pentaho.platform.repository2.unified.ExceptionLoggingDecorator.createFile(ExceptionLoggingDecorator.java:92)
        at pt.webdetails.cpf.repository.pentaho.unified.UnifiedRepositoryAccess.saveFile(UnifiedRepositoryAccess.java:213)
        at pt.webdetails.cpf.repository.pentaho.unified.UnifiedRepositoryAccess.saveFile(UnifiedRepositoryAccess.java:163)
        at pt.webdetails.cdf.dd.cdf.CdfTemplates.save(CdfTemplates.java:68)
        at pt.webdetails.cdf.dd.api.SyncronizerApi.syncTemplates(SyncronizerApi.java:195)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
        at java.lang.reflect.Method.invoke(Unknown Source)
        at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
        at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$VoidOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:167)
        at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
        at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)
        at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
        at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
        at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
        at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
        at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1511)
        at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1442)
        at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1391)
        at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1381)
        at com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
        at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:538)
        at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:716)
        at org.pentaho.platform.web.servlet.JAXRSPluginServlet.service(JAXRSPluginServlet.java:112)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
        at org.pentaho.platform.web.servlet.JAXRSPluginServlet.service(JAXRSPluginServlet.java:117)
        at org.pentaho.platform.web.servlet.PluginDispatchServlet.service(PluginDispatchServlet.java:89)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at org.pentaho.platform.web.http.filters.PentahoWebContextFilter.doFilter(PentahoWebContextFilter.java:185)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at org.pentaho.platform.web.http.filters.PentahoRequestContextFilter.doFilter(PentahoRequestContextFilter.java:87)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:378)
        at org.springframework.security.intercept.web.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:109)
        at org.springframework.security.intercept.web.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:83)
        at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:390)
        at org.springframework.security.ui.ExceptionTranslationFilter.doFilterHttp(ExceptionTranslationFilter.java:101)
        at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53)
        at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:390)
        at org.springframework.security.providers.anonymous.AnonymousProcessingFilter.doFilterHttp(AnonymousProcessingFilter.java:105)
        at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53)
        at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:390)
        at org.pentaho.platform.web.http.security.RequestParameterAuthenticationFilter.doFilter(RequestParameterAuthenticationFilter.java:189)
        at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:390)
        at org.springframework.security.ui.basicauth.BasicProcessingFilter.doFilterHttp(BasicProcessingFilter.java:174)
        at org.pentaho.platform.web.http.security.PentahoBasicProcessingFilter.doFilterHttp(PentahoBasicProcessingFilter.java:115)
        at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53)
        at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:390)
        at org.springframework.security.context.HttpSessionContextIntegrationFilter.doFilterHttp(HttpSessionContextIntegrationFilter.java:235)
        at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53)
        at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:390)
        at org.pentaho.platform.web.http.filters.HttpSessionPentahoSessionIntegrationFilter.doFilter(HttpSessionPentahoSessionIntegrationFilter.java:263)
        at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:390)
        at org.springframework.security.wrapper.SecurityContextHolderAwareRequestFilter.doFilterHttp(SecurityContextHolderAwareRequestFilter.java:91)
        at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53)
        at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:390)
        at org.springframework.security.util.FilterChainProxy.doFilter(FilterChainProxy.java:175)
        at org.springframework.security.util.FilterToBeanProxy.doFilter(FilterToBeanProxy.java:99)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at org.pentaho.platform.web.http.filters.SystemStatusFilter.doFilter(SystemStatusFilter.java:55)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at org.pentaho.platform.web.http.filters.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:114)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at org.pentaho.platform.web.http.filters.WebappRootForwardingFilter.doFilter(WebappRootForwardingFilter.java:70)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at org.pentaho.platform.web.http.filters.PentahoPathDecodingFilter.doFilter(PentahoPathDecodingFilter.java:34)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
        at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
        at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:470)
        at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
        at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
        at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
        at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
        at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:861)
        at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:620)
        at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
        at java.lang.Thread.run(Unknown Source)
↧

What's the different between Date and Timestamp types when used in Text File Input?

June 27, 2015, 9:53 am
$
0
0
I understand the difference between Date and Timestamp in some databases (e.g. mysql handles timezones differently for each).

But when using a Text File Input, there's no DB involved, what exactly are the semantics of one versus the other?
↧

after port change - login does not paint /pentaho/Home

June 28, 2015, 5:12 am
$
0
0
I changed the port from 8080 in /biserver-ce/tomcat/conf/server.xml and now when I log in, I see "Just a few moments please.", "Pentaho User Console is Loading..."
then the Pentaho User Console screen does not show anything. I can view source of the page in chrome and see a page of source, but nothing shows. If I change the port back.. it works. Hard links to my dashboards work. Same issue with IE and Firefox.

what did I miss making the port change?
↧
Search

long delay before first row is processed

June 28, 2015, 8:24 am
$
0
0
I have a table with 1,000,000+ records.

I'm doing a Table Input step selecting all records, with no WHERE clause.

When running this query interactively, it starts returning results immediately, as expected.

However, when running in a Kettle transformation (in Spoon or Pan), there is a long delay of about a minute before the other Steps start seeing any rows.

This is repeatable, on dedicated development machines, so there's not an issue of server load or contention.

I upgraded to the latest 5.4, to make sure this wasn't something that had been fixed already.

What could be causing the delay?
↧
↧

dynamic number of columns in excel input

June 28, 2015, 12:16 pm
$
0
0
Hello.
I have a few excel files with similar structure, but the problem is dynamic number of columns in each file. But in every file is a field (1st row, different column) with the exact same name, let's call it "THE END" and my goal is load columns until this specific field (the rest of columns is not interesting for me).

I am not sure if this task is doable without metadata injection.
I have been trying to use row normaliser with filter rows step, tried to use different settings in excel input step but without success...

The only solution which comes to my mind is transpose columns to rows, then use filter rows step to filter "THE END" columns then transpose the table back.
But I am pretty sure this is not the right solution..

Here is an example:
File1:
google apple microsoft blizzard pentaho THE END
name john josh jerry jimmy jack AAA
surname peterson paterson puterson pyterson poterson CCC

File 2:
apple british airways heineken microsoft THE END
name adam jim peter dan FFF EEE
surname sandler jackson samko thompson SSS WWW

According to my description I would like to load 6 columns (until "THE END") in file 1 and in file 2 i would like to load 5 columns..

Thanks for tips!
↧

Unable to contact slave server to verify status of transformation

June 29, 2015, 1:49 am
$
0
0
Hello,

I'm executing a long running shellscript in a transformation running via Carte on a remote server.

Sporadically, the job calling the remote transformation terminates with the error message:

"Unable to contact slave server [my_slave_server] to verify status of transformation"

When I connect to the slave server via the web-interface (http://address:port/kettle/status)
I find my transformation still running merrily.

So it seems that the timeout the calling job uses while polling the transformation status at the slave-server is set too short.
Is there a possibility to reconfigure that timeout or to configure a retry count before the caller gives up?

PDI Version 5.3.0.0-123

Best regards,

Bernd
↧

Procesar un XML de un adjunto en un e-mail.

June 25, 2015, 10:47 pm
$
0
0
La situación está así:
  1. Tengo un e-mail con un adjunto: un archivo xml
  2. Necesito procesar ese archivo xml.


La #1 ya la tengo resuelta y ya capturo el e-mail que deseo. Sin embargo no he logrado extraer el adjunto. Probé con getFilesNames, Load content in memory y directamente con el 'Get Data from XML'

Alguna idea de como resolverlo?
↧

Failed to load all aggregations after 100 passes; there's probably a cycle

June 26, 2015, 8:18 pm
$
0
0
[COLOR=inherit !important]some times,when we launch a mdx query from saiku,the following error will occur,
"[COLOR=inherit !important]Failed to load all aggregations after 100 passes; there's probably a cycle",
at first,we set "[/COLOR][COLOR=inherit !important]mondrian.rolap.evaluate.MaxEvalDepth" to 10[/COLOR],this error occurs very frequently,
when we set it to 100,the frequency bring down,but sometimes still occur.we don't know what is the real purpose about this[/COLOR]
[COLOR=inherit !important]property?[/COLOR]
↧
↧

Failed to load all aggregations after 100 passes; there's probably a cycle

June 26, 2015, 8:19 pm
$
0
0
[COLOR=inherit !important]some times,when we launch a mdx query from saiku,the following error will occur,
"[COLOR=inherit !important]Failed to load all aggregations after 100 passes; there's probably a cycle",
at first,we set "[/COLOR][COLOR=inherit !important]mondrian.rolap.evaluate.MaxEvalDepth" to 10[/COLOR],this error occurs very frequently,
when we set it to 100,the frequency bring down,but sometimes still occur.we don't know what is the real purpose about this[/COLOR]
[COLOR=inherit !important]property?[/COLOR]
↧

newbie : when saving it seems as if not all my steps gets saved

June 28, 2015, 1:57 am
$
0
0
Hi All,

Sorry it might be that there are a simple answer to my question - I mean being a complete newbie there is a huge chance that I missed out on a couple of things.

I installed the PDI tool and tried to import some simple files(text file input) into a sql database(mysql). I discovered that when I save my work, exit and subsequent open my work(ktr-file) the file not being empty (30kb or so) - but no steps, connections or hops was shown. Subsequently I have been able to provoke the behavior by adding the "text file input" - entering the filename(at this point I am able to reopen fine). Then used the "get fields" within this step - saved but after this when I reopen nothing is show on the canvas or navigation pane (the steps seems lost).

I am running the 5.4.0.1-130 version on osx (10.10.4).

Any pointers greatly appreciated.

/MiB
↧
Search

newbie - usage of text file input makes my canvas go away on reopen

June 28, 2015, 4:11 am
$
0
0
Hi All,

Admitted - I am a newbie on this platform:).

I am trying to import a file(CSV tab delimited) and save it to a database. I am using the text file input (I have some blank lines which I want to get rid of and that step seems to do the trick). When adding the step and after I have used the "get fields" if I save at that point then upon reopen (also exit and reopen) my canvas is blank. I cannot find any indications that the step is wrong but this behaviour can't be right - what am I doing wrong?

Ideas ?

/MIB
version 5.4.0.1 - 130 on OSX 10.10
↧

Need to identify a block of rows and process

June 28, 2015, 5:16 am
$
0
0
I'm trying to process an xml data file. A snippet is below:

<master_information>
<product_xref>
<xref type="SKU" type_id="1">148JC8</xref>
<xref type="LOCID" type_id="2">USWASE</xref>
</product_xref>
</master_information>

When I parse with the StAX "XML Input Stream" step, I get the following:

xml_data_type_description xml_path xml_parent_path xml_data_name xml_data_value
1. START_ELEMENT /master_information/product_xref /product/master_information product_xref <null>
2. START_ELEMENT /master_information/product_xref/xref /product/master_information/product_xref xref <null>
3. ATTRIBUTE /master_information/product_xref/xref /product/master_information/product_xref type SKU
4. ATTRIBUTE /master_information/product_xref/xref /product/master_information/product_xref type_id 1
5. CHARACTERS /master_information/product_xref/xref /product/master_information/product_xref xref 148JC8
6. END_ELEMENT /master_information/product_xref/xref /product/master_information/product_xref xref <null>
7. START_ELEMENT /master_information/product_xref/xref /product/master_information/product_xref xref <null>
8. ATTRIBUTE /master_information/product_xref/xref /product/master_information/product_xref type LOCID
9. ATTRIBUTE /master_information/product_xref/xref /product/master_information/product_xref type_id 2
10. CHARACTERS /master_information/product_xref/xref /product/master_information/product_xref xref USWASE
11. END_ELEMENT /master_information/product_xref/xref /product/master_information/product_xref xref <null>
12. END_ELEMENT /master_information/product_xref /product/master_information product_xref <null>

(row numbers added for clarity)

So far so good. But here's where I start having problems. Each "xref" row in the xml corresponds to a START_ELEMENT / END_ELEMENT block in the parsed data. For e.g. rows 2 through 6 is the first row, 7 through 11 is the second row. (there can be more rows, but you get the idea)

Each xref row also corresponds to a row in my database table. So, I need to process the data to get following result set:

SKU 1 148JC8
LOCID 2 USWASE

How can I do this in pdi? I guess I could write a java class, but is there a more direct way that I'm missing?

The solution needs to be as flexible as possible, including being able to handle complex, nested START_ELEMENT / END_ELEMENT blocks.




Thanks in advance.
↧
↧

Passing parameters to JPivot table in CDE

June 28, 2015, 6:21 am
$
0
0
Hi,
I'm a pentaho newbie, and I'm trying to create a drilldown report (with expandable rows) ..
I used Pivot Component in dashboard, and I got the report
However, I need to make my report dynamic such that the resulting table is filterd based on certain parameters I pass..
Any idea on how I can make my JPivot table accept parameters?
↧

Schema Workbench connection to mysql error

June 28, 2015, 1:29 pm
$
0
0
Hi,

I am pretty new with pentaho and I am trying to make a new connection to MySQL from the Schema Workbench but I am getting the following error:
Error connecting to database [testtttt] : org.pentaho.di.core.exception.KettleDatabaseException:
Error occurred while trying to connect to the database

Error connecting to database: (using class org.gjt.mm.mysql.Driver)
java.lang.NullPointerException


org.pentaho.di.core.exception.KettleDatabaseException:
Error occurred while trying to connect to the database

Error connecting to database: (using class org.gjt.mm.mysql.Driver)
java.lang.NullPointerException


at org.pentaho.di.core.database.Database.normalConnect(Database.java:428)
at org.pentaho.di.core.database.Database.connect(Database.java:358)
at org.pentaho.di.core.database.Database.connect(Database.java:311)
at org.pentaho.di.core.database.Database.connect(Database.java:301)
at org.pentaho.di.core.database.DatabaseFactory.getConnectionTestReport(DatabaseFactory.java:80)
at org.pentaho.di.core.database.DatabaseMeta.testConnection(DatabaseMeta.java:2686)
at org.pentaho.ui.database.event.DataHandler.testDatabaseConnection(DataHandler.java:546)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.pentaho.ui.xul.impl.AbstractXulDomContainer.invoke(AbstractXulDomContainer.java:313)
at org.pentaho.ui.xul.swing.tags.SwingButton$OnClickRunnable.run(SwingButton.java:71)
at java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$200(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$1.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.WaitDispatchSupport$2.run(Unknown Source)
at java.awt.WaitDispatchSupport$4.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.awt.WaitDispatchSupport.enter(Unknown Source)
at java.awt.Dialog.show(Unknown Source)
at java.awt.Component.show(Unknown Source)
at java.awt.Component.setVisible(Unknown Source)
at java.awt.Window.setVisible(Unknown Source)
at java.awt.Dialog.setVisible(Unknown Source)
at org.pentaho.ui.xul.swing.tags.SwingDialog.show(SwingDialog.java:250)
at mondrian.gui.Workbench.connectionButtonActionPerformed(Workbench.java:1279)
at mondrian.gui.Workbench.access$900(Workbench.java:57)
at mondrian.gui.Workbench$24.actionPerformed(Workbench.java:749)
at javax.swing.AbstractButton.fireActionPerformed(Unknown Source)
at javax.swing.AbstractButton$Handler.actionPerformed(Unknown Source)
at javax.swing.DefaultButtonModel.fireActionPerformed(Unknown Source)
at javax.swing.DefaultButtonModel.setPressed(Unknown Source)
at javax.swing.AbstractButton.doClick(Unknown Source)
at javax.swing.plaf.basic.BasicMenuItemUI.doClick(Unknown Source)
at javax.swing.plaf.basic.BasicMenuItemUI$Handler.mouseReleased(Unknown Source)
at java.awt.Component.processMouseEvent(Unknown Source)
at javax.swing.JComponent.processMouseEvent(Unknown Source)
at java.awt.Component.processEvent(Unknown Source)
at java.awt.Container.processEvent(Unknown Source)
at java.awt.Component.dispatchEventImpl(Unknown Source)
at java.awt.Container.dispatchEventImpl(Unknown Source)
at java.awt.Component.dispatchEvent(Unknown Source)
at java.awt.LightweightDispatcher.retargetMouseEvent(Unknown Source)
at java.awt.LightweightDispatcher.processMouseEvent(Unknown Source)
at java.awt.LightweightDispatcher.dispatchEvent(Unknown Source)
at java.awt.Container.dispatchEventImpl(Unknown Source)
at java.awt.Window.dispatchEventImpl(Unknown Source)
at java.awt.Component.dispatchEvent(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$200(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$1.doIntersectionPrivilege(Unknown Source)
at java.security.ProtectionDomain$1.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue$4.run(Unknown Source)
at java.awt.EventQueue$4.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$1.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
Caused by: org.pentaho.di.core.exception.KettleDatabaseException:
Error connecting to database: (using class org.gjt.mm.mysql.Driver)
java.lang.NullPointerException

at org.pentaho.di.core.database.Database.connectUsingClass(Database.java:592)
at org.pentaho.di.core.database.Database.connectUsingClass(Database.java:4697)
at org.pentaho.di.core.database.Database.normalConnect(Database.java:414)
... 74 more
Caused by: java.sql.SQLException: java.lang.NullPointerException
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:910)
at com.mysql.jdbc.ServerPreparedStatement.executeInternal(ServerPreparedStatement.java:766)
at com.mysql.jdbc.PreparedStatement.execute(PreparedStatement.java:882)
at com.mysql.jdbc.Statement.createResultSetUsingServerFetch(Statement.java:525)
at com.mysql.jdbc.Statement.executeQuery(Statement.java:1158)
at com.mysql.jdbc.SQLError.convertShowWarningsToSQLWarnings(SQLError.java:710)
at com.mysql.jdbc.MysqlIO.scanForAndThrowDataTruncation(MysqlIO.java:3183)
at com.mysql.jdbc.ServerPreparedStatement.serverExecute(ServerPreparedStatement.java:1349)
at com.mysql.jdbc.ServerPreparedStatement.executeInternal(ServerPreparedStatement.java:740)
at com.mysql.jdbc.PreparedStatement.execute(PreparedStatement.java:882)
at com.mysql.jdbc.Statement.createResultSetUsingServerFetch(Statement.java:525)
at com.mysql.jdbc.Statement.executeQuery(Statement.java:1158)
at com.mysql.jdbc.Connection.loadServerVariables(Connection.java:4478)
at com.mysql.jdbc.Connection.initializePropsFromServer(Connection.java:4062)
at com.mysql.jdbc.Connection.createNewIO(Connection.java:2789)
at com.mysql.jdbc.Connection.<init>(Connection.java:1555)
at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:285)
at java.sql.DriverManager.getConnection(Unknown Source)
at java.sql.DriverManager.getConnection(Unknown Source)
at org.pentaho.di.core.database.Database.connectUsingClass(Database.java:574)
... 76 more

Hostname : localhost
Port : 3306
Database name : sakila


The thing is that I have already placed the mysql-connector-java-5.1.35-bin in the following paths:



  • C:\Pentaho\design-tools\schema-workbench\drivers
  • C:\Pentaho\design-tools\schema-workbench\lib


But nothing of this is working, thanks in advance for all your help,
Javier
↧

date parameter and data-cache

June 29, 2015, 4:41 am
$
0
0
hi,

I am creating a report with a PDI transformation as data set. I pass 3 parameters to the transformation. One string parameter (drop down) and two date parameters (date picker) that are being passed as epoch time to the transformation (using the Formula Editor foir the conversion). When I use only the single string value than on changing that value the report is being reloaded with new data depending on the selecion. The data for the different selections are cached. If I add the two date parameters than it stop loading the data depending on the new selection. It keeps showing the data from the first selection and not from the changed selection. I have to turn off the data-cahce for the report to make it work. This has as disadvantage that the overall handling gets slower. Is there a way to use the data-cache and make the report refresh when the parameters change?

I am using pentaho 5.1.0 CE

regards,
Patrick
↧
Viewing all 16689 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>