Hi guy, does it works with pentaho? I am go around to research this.
↧
Connecting Data to Azure
↧
Nested Loop in Job
Hi all. I'm a non-Developer trying to do a nested loop in a Job but can't get it to work correctly. Here's what I need to do:
So far I have a single Job that calls 2 transformations (1 to get the list of records for the result, 1 to retrieve rows for each record in the result). The job is structured to loop for each Transformation if the previous call didn't return all of the rows available. The 2nd transformation in my Job is also set to execute for every input row from the previous transformation. It's not working correctly whenever the 2nd Transformation needs to make multiple calls to retrieve all of the Records for a single Account. I think the problems are from trying to do a loop back to a Transformation that already has the "Execute every input row" option selected.
Is there a better way to do this? Any help would really be appreciated.
- Call a REST API to get a list of Account records and add the rows to the Result
- For each Account record in the Result, call a 2nd REST API and retrieve up to 500 rows
- If there are still more rows to retrieve from the 2nd API for the Account record, call the REST API again using the "NEXT PAGE URI" that came back from the previous request
- Continue retrieving rows from the 2nd API for the Account record (500 at a time) until there are no more to retrieve
- Repeat the process for the next Account record in the Result.
So far I have a single Job that calls 2 transformations (1 to get the list of records for the result, 1 to retrieve rows for each record in the result). The job is structured to loop for each Transformation if the previous call didn't return all of the rows available. The 2nd transformation in my Job is also set to execute for every input row from the previous transformation. It's not working correctly whenever the 2nd Transformation needs to make multiple calls to retrieve all of the Records for a single Account. I think the problems are from trying to do a loop back to a Transformation that already has the "Execute every input row" option selected.
Is there a better way to do this? Any help would really be appreciated.
↧
↧
Question about the Insert/Update Step Commit size
If I set the commit size to be greater than 1 does the step check what is in the commit buffer before going to the database to determine if it should do an insert or an update?
For example I have a table where I want to only have 1 instance of a customer + product combination , if the first entry in my data stream is customer id 1 and product 100 and that combination does not exist in the database I expect an insert to be performed. What happens if the 10th entry in my data stream is also customer id 1 and product 100 and I have commit size set to 100.
There are no database constraints forcing only 1 customer per product in the database, will the insert update step insert 2 rows for customer 1 , product 100 or just 1 row?
For example I have a table where I want to only have 1 instance of a customer + product combination , if the first entry in my data stream is customer id 1 and product 100 and that combination does not exist in the database I expect an insert to be performed. What happens if the 10th entry in my data stream is also customer id 1 and product 100 and I have commit size set to 100.
There are no database constraints forcing only 1 customer per product in the database, will the insert update step insert 2 rows for customer 1 , product 100 or just 1 row?
↧
Images in mail step
Hi all,
is it possible to display images in mail body? if yes where to store the images and what is the image relative path?
I tried with following code but no use.It seems to be path is not correct, image is located in kettle software folder.
Please help me on this.
<html><body><img src="logo.jpg" alt="image"></body></html>
Thank you,
Janu:):)
is it possible to display images in mail body? if yes where to store the images and what is the image relative path?
I tried with following code but no use.It seems to be path is not correct, image is located in kettle software folder.
Please help me on this.
<html><body><img src="logo.jpg" alt="image"></body></html>
Thank you,
Janu:):)
↧
Captcha for Login page
Hello,
I have a Pentaho Server 8.2 Community Edition installation. The installation consists of one Pentaho Server, with the Tomcat server facing directly to the internet. Is there a recommended way to add a captcha to the login page to prevent brute force attacks? Would you recommend any additional security configuration?
Thanks in advance.
Regards,
Agustín
I have a Pentaho Server 8.2 Community Edition installation. The installation consists of one Pentaho Server, with the Tomcat server facing directly to the internet. Is there a recommended way to add a captcha to the login page to prevent brute force attacks? Would you recommend any additional security configuration?
Thanks in advance.
Regards,
Agustín
↧
↧
starting spoon, several instances of the program are created
Hi
I'm buildinga new DI server based on Ubuntu 18.04 and Pentaho DI 8.2, and i noticed thatwhen a user starts Spoon (
), 5 instances of this program arecreated and running (see attachment).
The same occurswhen i schedule a task (
).
My worry isthat my existing tasks and jobs are not prepared to run in parallel. And wouldlike to get only 1 instance of each task running in order to avoid blockings.
Thank you
I'm buildinga new DI server based on Ubuntu 18.04 and Pentaho DI 8.2, and i noticed thatwhen a user starts Spoon (
Code:
./spoon.sh &The same occurswhen i schedule a task (
Code:
./kitchen.sh -file=/opt/pentaho/Repository/Martin.kjb-level=MinimalMy worry isthat my existing tasks and jobs are not prepared to run in parallel. And wouldlike to get only 1 instance of each task running in order to avoid blockings.
Thank you
↧
call db procedure parameters
I am successfully using the call DB procedure step to have Oracle execute procedures that we are using to load data into some tables. I can't find a way to map a field name to a particular parameter (named parameters). We have some procedures with over 30 parameters, but I only have to fill in the first 10 and the last 2. Right now, I have to fill in all parameter values with null fields so I get to the last ones. Is there a way to do a field to parameter mapping?
↧
Error connecting to GMail
Quote:
Originally Posted by Feragon42
![View Post]()
Hello Marabu, thanks for your answer.
Look at the error that Pentaho present to me, is different with imap and pop, you know why?
Thanks.
Attachment 17080Attachment 17081
Look at the error that Pentaho present to me, is different with imap and pop, you know why?
Thanks.
Attachment 17080Attachment 17081
↧
Pentaho can't do Login with only ONE user. All other users works fine
I am using Pentaho integrated with other app developed. I am using Multi-Tenancy 1234@test, for example, and I login in pentaho through the app, not directly by pentaho login screen. We use Nginx to Proxy Pentaho. The problem is: All the users login except one. We have around 140 accounts and only one can't do the login. When a try to login a only get a blank page.
I tried to remove the user from pentaho DB and re-included. I tried to change the user password. I checked if the credential passed were right, it were. I discovered that j_security_check is blocking the login. But I dont know why When try to login and press f12, I know it's redirect to pentahos login page saying that occurred a login error, but show only a blank page.(like a display none, im not sure).
Nothing shows in catalina.out. localhost_access_log:
[08/Jul/2019:07:48:44-0300]"GET /pentaho/CacheExpirationService HTTP/1.0"2001469
[08/Jul/2019:07:48:44-0300]"POST /pentaho/j_spring_security_check HTTP/1.0"302-
[08/Jul/2019:07:48:44-0300]"GET /pentaho/Login?login_error=1 HTTP/1.0"2007800
This is all I get from the logs. My user is in pentaho DB.
nginx file:
location /pentaho/{
proxy_pass http://IP_PENTAHO:8080/pentaho/;
}pentado doLogin()
function in PUCLogin.jsp:
function doLogin(){
// if we have a valid session and we attempt to login on top of it, the server
// will actually log us out and will not log in with the supplied credentials, you must
// login again. So instead, if they're already logged in, we bounce out of here to
// prevent confusion.
if(<%=loggedIn%>){
bounceToReturnLocation();
returnfalse;
}
jQuery.ajax({
type:"POST",
url:"j_spring_security_check",
dataType:"text",
data: $("#login").serialize(),
error:function (xhr, ajaxOptions, thrownError){
if(xhr.status ==404){
// if we get a 404 it means login was successful but intended resource does not exist
// just let it go - let the user get the 404
bounceToReturnLocation();
return;
}
//Fix for BISERVER-7525
//parsereerror caused by attempting to serve a complex document like a prd report in any presentation format like a .ppt
//does not necesarly mean that there was a failure in the login process, status is 200 so just let it serve the archive to the web browser.
if(xhr.status ==200&& thrownError =='parsererror'){
document.getElementById("j_password").value ="";
bounceToReturnLocation();
return;
}
// fail
$("#loginError").show();
$("#loginError button").focus();
},
success:function(data, textStatus, jqXHR){
if(data.indexOf("j_spring_security_check")!=-1){# HERE I GOT 1596, NOT -1
// fail
$("#loginError").show();
$("#loginError button").focus();
returnfalse;
}else{
document.getElementById("j_password").value ="";
bounceToReturnLocation();
}
}
});
returnfalse;
}
Like I said, this is the only user that cant login, and I'm not figuring out why. The DB i'm using in pentaho is Postgresql.
I hope you guys can help me out, thanks in advice. Best regards
I tried to remove the user from pentaho DB and re-included. I tried to change the user password. I checked if the credential passed were right, it were. I discovered that j_security_check is blocking the login. But I dont know why When try to login and press f12, I know it's redirect to pentahos login page saying that occurred a login error, but show only a blank page.(like a display none, im not sure).
Nothing shows in catalina.out. localhost_access_log:
[08/Jul/2019:07:48:44-0300]"GET /pentaho/CacheExpirationService HTTP/1.0"2001469
[08/Jul/2019:07:48:44-0300]"POST /pentaho/j_spring_security_check HTTP/1.0"302-
[08/Jul/2019:07:48:44-0300]"GET /pentaho/Login?login_error=1 HTTP/1.0"2007800
This is all I get from the logs. My user is in pentaho DB.
nginx file:
location /pentaho/{
proxy_pass http://IP_PENTAHO:8080/pentaho/;
}pentado doLogin()
function in PUCLogin.jsp:
function doLogin(){
// if we have a valid session and we attempt to login on top of it, the server
// will actually log us out and will not log in with the supplied credentials, you must
// login again. So instead, if they're already logged in, we bounce out of here to
// prevent confusion.
if(<%=loggedIn%>){
bounceToReturnLocation();
returnfalse;
}
jQuery.ajax({
type:"POST",
url:"j_spring_security_check",
dataType:"text",
data: $("#login").serialize(),
error:function (xhr, ajaxOptions, thrownError){
if(xhr.status ==404){
// if we get a 404 it means login was successful but intended resource does not exist
// just let it go - let the user get the 404
bounceToReturnLocation();
return;
}
//Fix for BISERVER-7525
//parsereerror caused by attempting to serve a complex document like a prd report in any presentation format like a .ppt
//does not necesarly mean that there was a failure in the login process, status is 200 so just let it serve the archive to the web browser.
if(xhr.status ==200&& thrownError =='parsererror'){
document.getElementById("j_password").value ="";
bounceToReturnLocation();
return;
}
// fail
$("#loginError").show();
$("#loginError button").focus();
},
success:function(data, textStatus, jqXHR){
if(data.indexOf("j_spring_security_check")!=-1){# HERE I GOT 1596, NOT -1
// fail
$("#loginError").show();
$("#loginError button").focus();
returnfalse;
}else{
document.getElementById("j_password").value ="";
bounceToReturnLocation();
}
}
});
returnfalse;
}
Like I said, this is the only user that cant login, and I'm not figuring out why. The DB i'm using in pentaho is Postgresql.
I hope you guys can help me out, thanks in advice. Best regards
↧
↧
Error message when running nested transformations from command line
Hi community,
I created a job that executes multiple jobs, each of which runs multiple transformations. When I run the job in PDI (i. e. the GUI), all works fine and it finishes within a couple of minutes successfully.
![Name: JobRunsSuccessfully.jpg
Views: 0
Size: 10.4 KB]()
However, I need to run this job as a script (for automation purposes). I'm fairly new to this, but I'm able to run a simple test job (which just sends an email) via command line, so I believe I understood the basics.
I'm running PDI 8.2 (Community Edition), and I use a file repository. The jobs and transformations all sit in the same folder, and I try to execute this command:
But then, I'm getting errors like "Unexpected error during job metadata load" (I'll paste the full output at the end). It tries to execute the various jobs, but the execution of the transformations within the jobs fails. Between every job I included a "send email" job, and those are executed properly.
What would I need to do so the transformations within the jobs run properly?
Thanks a lot for any help!
Here's some of the output (and no further text at the end)
C:\Program Files\Pentaho\data-integration\8.2>kitchen.bat /file:C:\Users\RFS\PentahoRepository\BI\00_00_00_Update_BI.kjb /level:Basic
DEBUG: Using PENTAHO_JAVA_HOME
DEBUG: _PENTAHO_JAVA_HOME=C:\Program Files\Java\jre1.8.0_211\
DEBUG: _PENTAHO_JAVA=C:\Program Files\Java\jre1.8.0_211\\bin\java.exe
C:\Program Files\Pentaho\data-integration\8.2>"C:\Program Files\Java\jre1.8.0_211\\bin\java.exe" "-Xms4g" "-Xmx28g" "-XX:MaxPermSize=512m" "-Dhttps.protocols=TLSv1,TLSv1.1,TLSv1.2" "-Djava.library.path=libswt\win64" "-DKETTLE_HOME=" "-DKETTLE_REPOSITORY=" "-DKETTLE_USER=" "-DKETTLE_PASSWORD=" "-DKETTLE_PLUGIN_PACKAGES=" "-DKETTLE_LOG_SIZE_LIMIT=" "-DKETTLE_JNDI_ROOT=" -jar launcher\launcher.jar -lib ..\libswt\win64 -main org.pentaho.di.kitchen.Kitchen -initialDir "C:\Program Files\Pentaho\data-integration\8.2"\ /file:C:\Users\RFS\PentahoRepository\BI\00_00_00_Update_BI.kjb /level:Basic
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0
14:06:50,030 INFO [KarafBoot] Checking to see if org.pentaho.clean.karaf.cache is enabled
14:06:54,269 INFO [KarafInstance]
*******************************************************************************
*** Karaf Instance Number: 2 at C:\Program Files\Pentaho\data-integration\8 ***
*** .2\.\system\karaf\caches\kitchen\data-1 ***
*** FastBin Provider Port:52902 ***
*** Karaf Port:8803 ***
*** OSGI Service Port:9052 ***
*******************************************************************************
Jul 13, 2019 2:06:55 PM org.apache.karaf.main.Main$KarafLockCallback lockAquired
INFO: Lock acquired. Setting startlevel to 100
2019/07/13 14:06:55 - Kitchen - Logging is at level : Basic
2019/07/13 14:06:55 - Kitchen - Start of run.
2019-07-13 14:06:58.487:INFO:oejs.Server:jetty-8.1.15.v20140411
2019-07-13 14:06:58.519:INFO:oejs.AbstractConnector:Started NIOSocketConnectorWrapper@0.0.0.0:9052
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/core
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/beans
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/parameterized-types
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/security
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/wsdl/
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/2005/08/addressing
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2004/08/addressing
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-management (195) [org.apache.cxf.management.InstrumentationManager]
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-wsdl (198) [org.apache.cxf.wsdl.WSDLManager]
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-xml (200) [org.apache.cxf.binding.xml.XMLBindingFactory, org.apache.cxf.binding.xml.wsdl11.XMLWSDLExtensionLoader]
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-soap (201) [org.apache.cxf.binding.soap.SoapBindingFactory, org.apache.cxf.binding.soap.SoapTransportFactory]
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/bindings/soap
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-policy (220) [org.apache.cxf.ws.policy.PolicyEngine, org.apache.cxf.policy.PolicyDataEngine, org.apache.cxf.ws.policy.AssertionBuilderRegistry, org.apache.cxf.ws.policy.PolicyInterceptorProviderRegistry, org.apache.cxf.ws.policy.PolicyBuilder, org.apache.cxf.ws.policy.PolicyAnnotationListener, org.apache.cxf.ws.policy.attachment.ServiceModelPolicyProvider, org.apache.cxf.ws.policy.attachment.external.DomainExpressionBuilderRegistry, org.apache.cxf.ws.policy.attachment.external.EndpointReferenceDomainExpressionBuilder, org.apache.cxf.ws.policy.attachment.external.URIDomainExpressionBuilder, org.apache.cxf.ws.policy.attachment.wsdl11.Wsdl11AttachmentPolicyProvider, org.apache.cxf.ws.policy.mtom.MTOMAssertionBuilder, org.apache.cxf.ws.policy.mtom.MTOMPolicyInterceptorProvider]
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-http (202) [org.apache.cxf.transport.http.HTTPTransportFactory, org.apache.cxf.transport.http.HTTPWSDLExtensionLoader, org.apache.cxf.transport.http.policy.HTTPClientAssertionBuilder, org.apache.cxf.transport.http.policy.HTTPServerAssertionBuilder, org.apache.cxf.transport.http.policy.NoOpPolicyInterceptorProvider]
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/transports/http/configuration
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/simple
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-frontend-jaxws (204) [org.apache.cxf.jaxws.context.WebServiceContextResourceResolver]
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxws
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxrs
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxrs-client
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/binding/coloc
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-local (216) [org.apache.cxf.transport.local.LocalTransportFactory]
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-object (217) [org.apache.cxf.binding.object.ObjectBindingFactory]
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/binding/object
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/policy
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/ns/ws-policy
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/2006/07/ws-policy
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2004/09/policy
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/wss/2004/...secext-1.0.xsd
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/wss/2004/...tility-1.0.xsd
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/2000/09/xmldsig#
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/ws-sx/ws-...ypolicy/200702
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-addr (237) [org.apache.cxf.ws.addressing.policy.AddressingAssertionBuilder, org.apache.cxf.ws.addressing.policy.UsingAddressingAssertionBuilder, org.apache.cxf.ws.addressing.policy.AddressingPolicyInterceptorProvider, org.apache.cxf.ws.addressing.impl.AddressingWSDLExtensionLoader, org.apache.cxf.ws.addressing.WSAddressingFeature$WSAddressingFeatureApplier, org.apache.cxf.ws.addressing.MAPAggregator$MAPAggregatorLoader]
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/ws/addressing
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-security (239) [org.apache.cxf.ws.security.policy.WSSecurityPolicyLoader, org.apache.cxf.ws.security.cache.CacheCleanupListener]
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-rm (241) [org.apache.cxf.ws.rm.RMManager, org.apache.cxf.ws.rm.policy.RMPolicyInterceptorProvider, org.apache.cxf.ws.rm.policy.RM10AssertionBuilder, org.apache.cxf.ws.rm.policy.RM12AssertionBuilder, org.apache.cxf.ws.rm.policy.WSRMP12PolicyLoader, org.apache.cxf.ws.rm.policy.MC11PolicyLoader, org.apache.cxf.ws.rm.policy.RSPPolicyLoader]
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/ws/rm/manager
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2005/02/rm/policy
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-javascript (242) [org.apache.cxf.javascript.JavascriptServerListener]
Jul 13, 2019 2:06:59 PM org.pentaho.caching.impl.PentahoCacheManagerFactory$RegistrationHandler$1 onSuccess
INFO: New Caching Service registered
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/C:/Program%20Files/Pentaho/data-integration/8.2/launcher/../lib/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/C:/Program Files/Pentaho/data-integration/8.2/plugins/pentaho-big-data-plugin/lib/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2019/07/13 14:07:01 - 00_00_00_Update_BI - Start of job execution
2019/07/13 14:07:01 - 00_00_00_Update_BI - Starting entry [Mail: Update BI started]
Jul 13, 2019 2:07:02 PM org.apache.cxf.endpoint.ServerImpl initDestination
INFO: Setting the server's publish address to be /lineage
2019/07/13 14:07:02 - 00_00_00_Update_BI - Starting entry [Deletions]
2019/07/13 14:07:02 - Deletions - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : Error running job entry 'job' :
2019/07/13 14:07:02 - Deletions - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : org.pentaho.di.core.exception.KettleException:
2019/07/13 14:07:02 - Deletions - Unexpected error during job metadata load
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.Job.run (Job.java:384)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.Job.execute (Job.java:497)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.Job.execute (Job.java:821)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.Job.execute (Job.java:821)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.Job.execute (Job.java:680)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.entries.job.JobEntryJob.execute (JobEntryJob.java:667)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta (JobEntryJob.java:1345)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta (JobEntryJob.java:1381)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMetaFromRepository (JobEntryJob.java:1353)
2019/07/13 14:07:02 - Deletions -
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta(JobEntryJob.java:1421)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta(JobEntryJob.java:1345)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.entries.job.JobEntryJob.execute(JobEntryJob.java:667)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.Job.execute(Job.java:680)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.Job.execute(Job.java:821)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.Job.execute(Job.java:821)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.Job.execute(Job.java:497)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.Job.run(Job.java:384)
2019/07/13 14:07:02 - Deletions - Caused by: java.lang.NullPointerException
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMetaFromRepository(JobEntryJob.java:1353)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta(JobEntryJob.java:1381)
2019/07/13 14:07:02 - Deletions - ... 7 more
2019/07/13 14:07:02 - 00_00_00_Update_BI - Starting entry [Deletions -> Dimensions]
Jul 13, 2019 2:07:02 PM org.apache.cxf.endpoint.ServerImpl initDestination
INFO: Setting the server's publish address to be /i18n
2019/07/13 14:07:02 - 00_00_00_Update_BI - Starting entry [Update Dimensions]
2019/07/13 14:07:02 - Update Dimensions - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : Error running job entry 'job' :
2019/07/13 14:07:02 - Update Dimensions - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : org.pentaho.di.core.exception.KettleException:
2019/07/13 14:07:02 - Update Dimensions - Unexpected error during job metadata load
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.run (Job.java:384)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.execute (Job.java:497)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.execute (Job.java:821)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.execute (Job.java:821)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.execute (Job.java:821)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.execute (Job.java:821)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.execute (Job.java:680)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.entries.job.JobEntryJob.execute (JobEntryJob.java:667)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta (JobEntryJob.java:1345)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta (JobEntryJob.java:1381)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMetaFromRepository (JobEntryJob.java:1353)
2019/07/13 14:07:02 - Update Dimensions -
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta(JobEntryJob.java:1421)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta(JobEntryJob.java:1345)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.entries.job.JobEntryJob.execute(JobEntryJob.java:667)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.execute(Job.java:680)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.execute(Job.java:821)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.execute(Job.java:821)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.execute(Job.java:821)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.execute(Job.java:821)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.execute(Job.java:497)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.run(Job.java:384)
2019/07/13 14:07:02 - Update Dimensions - Caused by: java.lang.NullPointerException
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMetaFromRepository(JobEntryJob.java:1353)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta(JobEntryJob.java:1381)
2019/07/13 14:07:02 - Update Dimensions - ... 9 more
2019/07/13 14:07:03 - Kitchen - Processing ended after 8 seconds.
I created a job that executes multiple jobs, each of which runs multiple transformations. When I run the job in PDI (i. e. the GUI), all works fine and it finishes within a couple of minutes successfully.
However, I need to run this job as a script (for automation purposes). I'm fairly new to this, but I'm able to run a simple test job (which just sends an email) via command line, so I believe I understood the basics.
I'm running PDI 8.2 (Community Edition), and I use a file repository. The jobs and transformations all sit in the same folder, and I try to execute this command:
Code:
kitchen.bat /file:C:\Users\RFS\PentahoRepository\BI\00_00_00_Update_BI.kjb /level:BasicWhat would I need to do so the transformations within the jobs run properly?
Thanks a lot for any help!
Here's some of the output (and no further text at the end)
C:\Program Files\Pentaho\data-integration\8.2>kitchen.bat /file:C:\Users\RFS\PentahoRepository\BI\00_00_00_Update_BI.kjb /level:Basic
DEBUG: Using PENTAHO_JAVA_HOME
DEBUG: _PENTAHO_JAVA_HOME=C:\Program Files\Java\jre1.8.0_211\
DEBUG: _PENTAHO_JAVA=C:\Program Files\Java\jre1.8.0_211\\bin\java.exe
C:\Program Files\Pentaho\data-integration\8.2>"C:\Program Files\Java\jre1.8.0_211\\bin\java.exe" "-Xms4g" "-Xmx28g" "-XX:MaxPermSize=512m" "-Dhttps.protocols=TLSv1,TLSv1.1,TLSv1.2" "-Djava.library.path=libswt\win64" "-DKETTLE_HOME=" "-DKETTLE_REPOSITORY=" "-DKETTLE_USER=" "-DKETTLE_PASSWORD=" "-DKETTLE_PLUGIN_PACKAGES=" "-DKETTLE_LOG_SIZE_LIMIT=" "-DKETTLE_JNDI_ROOT=" -jar launcher\launcher.jar -lib ..\libswt\win64 -main org.pentaho.di.kitchen.Kitchen -initialDir "C:\Program Files\Pentaho\data-integration\8.2"\ /file:C:\Users\RFS\PentahoRepository\BI\00_00_00_Update_BI.kjb /level:Basic
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0
14:06:50,030 INFO [KarafBoot] Checking to see if org.pentaho.clean.karaf.cache is enabled
14:06:54,269 INFO [KarafInstance]
*******************************************************************************
*** Karaf Instance Number: 2 at C:\Program Files\Pentaho\data-integration\8 ***
*** .2\.\system\karaf\caches\kitchen\data-1 ***
*** FastBin Provider Port:52902 ***
*** Karaf Port:8803 ***
*** OSGI Service Port:9052 ***
*******************************************************************************
Jul 13, 2019 2:06:55 PM org.apache.karaf.main.Main$KarafLockCallback lockAquired
INFO: Lock acquired. Setting startlevel to 100
2019/07/13 14:06:55 - Kitchen - Logging is at level : Basic
2019/07/13 14:06:55 - Kitchen - Start of run.
2019-07-13 14:06:58.487:INFO:oejs.Server:jetty-8.1.15.v20140411
2019-07-13 14:06:58.519:INFO:oejs.AbstractConnector:Started NIOSocketConnectorWrapper@0.0.0.0:9052
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/core
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/beans
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/parameterized-types
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/security
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/wsdl/
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/2005/08/addressing
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2004/08/addressing
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-management (195) [org.apache.cxf.management.InstrumentationManager]
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-wsdl (198) [org.apache.cxf.wsdl.WSDLManager]
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-xml (200) [org.apache.cxf.binding.xml.XMLBindingFactory, org.apache.cxf.binding.xml.wsdl11.XMLWSDLExtensionLoader]
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-soap (201) [org.apache.cxf.binding.soap.SoapBindingFactory, org.apache.cxf.binding.soap.SoapTransportFactory]
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/bindings/soap
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-policy (220) [org.apache.cxf.ws.policy.PolicyEngine, org.apache.cxf.policy.PolicyDataEngine, org.apache.cxf.ws.policy.AssertionBuilderRegistry, org.apache.cxf.ws.policy.PolicyInterceptorProviderRegistry, org.apache.cxf.ws.policy.PolicyBuilder, org.apache.cxf.ws.policy.PolicyAnnotationListener, org.apache.cxf.ws.policy.attachment.ServiceModelPolicyProvider, org.apache.cxf.ws.policy.attachment.external.DomainExpressionBuilderRegistry, org.apache.cxf.ws.policy.attachment.external.EndpointReferenceDomainExpressionBuilder, org.apache.cxf.ws.policy.attachment.external.URIDomainExpressionBuilder, org.apache.cxf.ws.policy.attachment.wsdl11.Wsdl11AttachmentPolicyProvider, org.apache.cxf.ws.policy.mtom.MTOMAssertionBuilder, org.apache.cxf.ws.policy.mtom.MTOMPolicyInterceptorProvider]
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-http (202) [org.apache.cxf.transport.http.HTTPTransportFactory, org.apache.cxf.transport.http.HTTPWSDLExtensionLoader, org.apache.cxf.transport.http.policy.HTTPClientAssertionBuilder, org.apache.cxf.transport.http.policy.HTTPServerAssertionBuilder, org.apache.cxf.transport.http.policy.NoOpPolicyInterceptorProvider]
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/transports/http/configuration
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/simple
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-frontend-jaxws (204) [org.apache.cxf.jaxws.context.WebServiceContextResourceResolver]
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxws
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxrs
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxrs-client
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/binding/coloc
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-local (216) [org.apache.cxf.transport.local.LocalTransportFactory]
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-object (217) [org.apache.cxf.binding.object.ObjectBindingFactory]
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/binding/object
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/policy
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/ns/ws-policy
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/2006/07/ws-policy
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2004/09/policy
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/wss/2004/...secext-1.0.xsd
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/wss/2004/...tility-1.0.xsd
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/2000/09/xmldsig#
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/ws-sx/ws-...ypolicy/200702
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-addr (237) [org.apache.cxf.ws.addressing.policy.AddressingAssertionBuilder, org.apache.cxf.ws.addressing.policy.UsingAddressingAssertionBuilder, org.apache.cxf.ws.addressing.policy.AddressingPolicyInterceptorProvider, org.apache.cxf.ws.addressing.impl.AddressingWSDLExtensionLoader, org.apache.cxf.ws.addressing.WSAddressingFeature$WSAddressingFeatureApplier, org.apache.cxf.ws.addressing.MAPAggregator$MAPAggregatorLoader]
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/ws/addressing
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-security (239) [org.apache.cxf.ws.security.policy.WSSecurityPolicyLoader, org.apache.cxf.ws.security.cache.CacheCleanupListener]
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-rm (241) [org.apache.cxf.ws.rm.RMManager, org.apache.cxf.ws.rm.policy.RMPolicyInterceptorProvider, org.apache.cxf.ws.rm.policy.RM10AssertionBuilder, org.apache.cxf.ws.rm.policy.RM12AssertionBuilder, org.apache.cxf.ws.rm.policy.WSRMP12PolicyLoader, org.apache.cxf.ws.rm.policy.MC11PolicyLoader, org.apache.cxf.ws.rm.policy.RSPPolicyLoader]
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/ws/rm/manager
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2005/02/rm/policy
Jul 13, 2019 2:06:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-javascript (242) [org.apache.cxf.javascript.JavascriptServerListener]
Jul 13, 2019 2:06:59 PM org.pentaho.caching.impl.PentahoCacheManagerFactory$RegistrationHandler$1 onSuccess
INFO: New Caching Service registered
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/C:/Program%20Files/Pentaho/data-integration/8.2/launcher/../lib/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/C:/Program Files/Pentaho/data-integration/8.2/plugins/pentaho-big-data-plugin/lib/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2019/07/13 14:07:01 - 00_00_00_Update_BI - Start of job execution
2019/07/13 14:07:01 - 00_00_00_Update_BI - Starting entry [Mail: Update BI started]
Jul 13, 2019 2:07:02 PM org.apache.cxf.endpoint.ServerImpl initDestination
INFO: Setting the server's publish address to be /lineage
2019/07/13 14:07:02 - 00_00_00_Update_BI - Starting entry [Deletions]
2019/07/13 14:07:02 - Deletions - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : Error running job entry 'job' :
2019/07/13 14:07:02 - Deletions - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : org.pentaho.di.core.exception.KettleException:
2019/07/13 14:07:02 - Deletions - Unexpected error during job metadata load
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.Job.run (Job.java:384)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.Job.execute (Job.java:497)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.Job.execute (Job.java:821)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.Job.execute (Job.java:821)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.Job.execute (Job.java:680)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.entries.job.JobEntryJob.execute (JobEntryJob.java:667)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta (JobEntryJob.java:1345)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta (JobEntryJob.java:1381)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMetaFromRepository (JobEntryJob.java:1353)
2019/07/13 14:07:02 - Deletions -
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta(JobEntryJob.java:1421)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta(JobEntryJob.java:1345)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.entries.job.JobEntryJob.execute(JobEntryJob.java:667)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.Job.execute(Job.java:680)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.Job.execute(Job.java:821)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.Job.execute(Job.java:821)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.Job.execute(Job.java:497)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.Job.run(Job.java:384)
2019/07/13 14:07:02 - Deletions - Caused by: java.lang.NullPointerException
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMetaFromRepository(JobEntryJob.java:1353)
2019/07/13 14:07:02 - Deletions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta(JobEntryJob.java:1381)
2019/07/13 14:07:02 - Deletions - ... 7 more
2019/07/13 14:07:02 - 00_00_00_Update_BI - Starting entry [Deletions -> Dimensions]
Jul 13, 2019 2:07:02 PM org.apache.cxf.endpoint.ServerImpl initDestination
INFO: Setting the server's publish address to be /i18n
2019/07/13 14:07:02 - 00_00_00_Update_BI - Starting entry [Update Dimensions]
2019/07/13 14:07:02 - Update Dimensions - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : Error running job entry 'job' :
2019/07/13 14:07:02 - Update Dimensions - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : org.pentaho.di.core.exception.KettleException:
2019/07/13 14:07:02 - Update Dimensions - Unexpected error during job metadata load
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.run (Job.java:384)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.execute (Job.java:497)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.execute (Job.java:821)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.execute (Job.java:821)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.execute (Job.java:821)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.execute (Job.java:821)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.execute (Job.java:680)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.entries.job.JobEntryJob.execute (JobEntryJob.java:667)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta (JobEntryJob.java:1345)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta (JobEntryJob.java:1381)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMetaFromRepository (JobEntryJob.java:1353)
2019/07/13 14:07:02 - Update Dimensions -
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta(JobEntryJob.java:1421)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta(JobEntryJob.java:1345)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.entries.job.JobEntryJob.execute(JobEntryJob.java:667)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.execute(Job.java:680)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.execute(Job.java:821)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.execute(Job.java:821)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.execute(Job.java:821)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.execute(Job.java:821)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.execute(Job.java:497)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.Job.run(Job.java:384)
2019/07/13 14:07:02 - Update Dimensions - Caused by: java.lang.NullPointerException
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMetaFromRepository(JobEntryJob.java:1353)
2019/07/13 14:07:02 - Update Dimensions - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta(JobEntryJob.java:1381)
2019/07/13 14:07:02 - Update Dimensions - ... 9 more
2019/07/13 14:07:03 - Kitchen - Processing ended after 8 seconds.
↧
Pentaho 8.3 is available!
Sorry for the delay! The release was late last week but I was travelling. In all fairness, I could have done this friday night, but then again, it was friday night so...
↧
Transformation Executor - grouping does not work for strings
I have steps:
Table In => Transformation executor
When I try to use 'Parameter name' on tab Parameters taken from string field (same field is used in Row grouping tab, 'field to group rows on') then parameter is not passed to next transformation.
All works with integers or numbers.
This is normal?
Regards
Table In => Transformation executor
When I try to use 'Parameter name' on tab Parameters taken from string field (same field is used in Row grouping tab, 'field to group rows on') then parameter is not passed to next transformation.
All works with integers or numbers.
This is normal?
Regards
↧
HTTP Status 401 - http://localhost:8190/localhost/kettle/registerPackage Unauthorized
Hi,
I am testing PDI 8.3 and started my carte server on the localhost. When starting a job from Spoon and sending it to the carte server, I get the error message
HTTP Status 401 - http://localhost:8190/localhost/kett...ad=jb_loop.kjb - Unauthorized
user names, passwords are all set to "cluster" in spoon and the carte config file.
Any ideas what might be causing this?
Max
I am testing PDI 8.3 and started my carte server on the localhost. When starting a job from Spoon and sending it to the carte server, I get the error message
HTTP Status 401 - http://localhost:8190/localhost/kett...ad=jb_loop.kjb - Unauthorized
user names, passwords are all set to "cluster" in spoon and the carte config file.
Any ideas what might be causing this?
Max
↧
↧
Convert table input result to verbose output to use in mail body
Hi,
Is there an easy way to take the data from a Table Input step and convert it somehow to get the verbose output like when running SQLs in the console?
I want to take that output and then put it directly into the e-mail body instead of attaching a text file.
I know that I can use JS to build it column by column but is there anything more flexible/simple?
Max
Is there an easy way to take the data from a Table Input step and convert it somehow to get the verbose output like when running SQLs in the console?
Code:
Order Ref ASIN Location Case Due Date ID
XXjxgkYRS XXX1DQ48M5 0130403050 1234500000812889 2019-07-19 14
XX2ThCPpC XXXCU2Y2Y0 0133102050 1234500000810658 2019-07-19 14
XXLQFqTNC XXXCU2Y2Y0 0133403040 1234500000810659 2019-07-19 14
XXY5kg0xC XXX0AOJ9W6 0253606060 1234500000831639 2019-07-19 14
XXSYGFdFC XXXNQF5OWA 0282105050 1234500000839660 2019-07-19 14I know that I can use JS to build it column by column but is there anything more flexible/simple?
Max
↧
REST client result as zip - how to save correct file?
Hi,
I am quite new in using PDI and I stucked to save correct/not corrupted zip file from API. I read forum and googled about but any of provided solutions didn't work for me :(
I checked following methods: Text File output, org.apache.commons.vfs.FileObject(I cannot make it work: : Imported class "org.apache.commons.vfs.FileObject" could not be loaded/Imported class "org.apache.commons.vfs.FileObject" could not be loaded).
Can I use any of standard steps to get results from API and save the correct file?
Thanks Marcin
I am quite new in using PDI and I stucked to save correct/not corrupted zip file from API. I read forum and googled about but any of provided solutions didn't work for me :(
I checked following methods: Text File output, org.apache.commons.vfs.FileObject(I cannot make it work: : Imported class "org.apache.commons.vfs.FileObject" could not be loaded/Imported class "org.apache.commons.vfs.FileObject" could not be loaded).
Can I use any of standard steps to get results from API and save the correct file?
Thanks Marcin
↧
Restart Carte server every 24 hours on Windows VM server
Hi,
Has somebody here a .bat file or other idea on how to restart the Carte server on a Windows VM every 24 hours? I have noticed that after running it for 6-7 days, it starts to get "GC overhead limit exceeded" errors and crashes. If I then restart the server, all is back to normal for the next few days.
Thanks for any help!
Max
Has somebody here a .bat file or other idea on how to restart the Carte server on a Windows VM every 24 hours? I have noticed that after running it for 6-7 days, it starts to get "GC overhead limit exceeded" errors and crashes. If I then restart the server, all is back to normal for the next few days.
Thanks for any help!
Max
↧
Writing kettle logs (log4j) in Mongo DB
Hi,
is there any way to write PDI (kettle) logs of any job/transformation in mongo db directly rather than writing it in to log file.
Thanks,
Sushil
is there any way to write PDI (kettle) logs of any job/transformation in mongo db directly rather than writing it in to log file.
Thanks,
Sushil
↧
↧
Re:events in pentaho fusion-plugin
one doubt regarding HANDLING EVENTS :
HOW TO HANDLE THE EVENTS IN-PENTAHO-FUSION CHARTS PLUGIN
FOR EXAMPLE: CLICK EVENTS .
IS THERE ANY WAY TO HANDLE THE EVENTS.
As we know there are no direct event handling in pentaho fusion plugin so for that,
we need to enhance the component and add the event using js .
So please guys if you have any experience regarding this please let us know
HOW TO HANDLE THE EVENTS IN-PENTAHO-FUSION CHARTS PLUGIN
FOR EXAMPLE: CLICK EVENTS .
IS THERE ANY WAY TO HANDLE THE EVENTS.
As we know there are no direct event handling in pentaho fusion plugin so for that,
we need to enhance the component and add the event using js .
So please guys if you have any experience regarding this please let us know
↧
Triggering heartbeat signal for at every 10 seconds: bug?
I have this error that I cannot solve.
I switched from Penthao Kettle 6.1 to 8.2 and 8.3 but on both the last 2 versions I have this error.
Randomly, in a transformation called by many jobs, in the first step where a select DB operation is performed (I tried both the step database join and table input) the job goes into freeze and in the log (raised to detailed) "Triggering heartbeat signal for <Job name> at every 10 seconds" is written.
I found this error reported by others on the web but no one has solved it.
Thinking of a thread synchronization problem (even if my transformation has only one record read from the SQL query) I tried to change the Transformation engine type from normal to Serial Single Threaded (Experimental!) And Single Threaded (Designed for Hadoop) but nothing.
I also tried to eliminate the transformation by directly inserting the steps in another transformation used by one of these jobs but the same error always in the same step.
I have set up a DB connection both with and without, nothing.
Has anyone had the same error message and tell me how to do it?
I really don't know what to catch anymore.
Configuration:
Pentaho Data Integration Community Edition 8.3
Jdk1.8.0_172
Microsoft SQL Server Standard Edition (64-bit) 13.0.4001 SP1
JDBC driver mssql-jdbc-7.2.1.jre8.jar
I switched from Penthao Kettle 6.1 to 8.2 and 8.3 but on both the last 2 versions I have this error.
Randomly, in a transformation called by many jobs, in the first step where a select DB operation is performed (I tried both the step database join and table input) the job goes into freeze and in the log (raised to detailed) "Triggering heartbeat signal for <Job name> at every 10 seconds" is written.
I found this error reported by others on the web but no one has solved it.
Thinking of a thread synchronization problem (even if my transformation has only one record read from the SQL query) I tried to change the Transformation engine type from normal to Serial Single Threaded (Experimental!) And Single Threaded (Designed for Hadoop) but nothing.
I also tried to eliminate the transformation by directly inserting the steps in another transformation used by one of these jobs but the same error always in the same step.
I have set up a DB connection both with and without, nothing.
Has anyone had the same error message and tell me how to do it?
I really don't know what to catch anymore.
Configuration:
Pentaho Data Integration Community Edition 8.3
Jdk1.8.0_172
Microsoft SQL Server Standard Edition (64-bit) 13.0.4001 SP1
JDBC driver mssql-jdbc-7.2.1.jre8.jar
↧
Not able to connect MS Sql server from pentaho data integration
Hi All,
We are not able to connect MS Sql server database from Pentaho data integration tool, but that is connecting from aqua data studio query analyser.
MS Sql server version : Microsoft SQL Server 2017 (RTM-GDR) (KB4505224) - 14.0.2027.2 (X64)
Jun 15 2019 00:26:19
Copyright (C) 2017 Microsoft Corporation
Developer Edition (64-bit) on Windows Server 2016 Standard 10.0 <X64> (Build 14393: ) (Hypervisor)
kettle version : pdi-ce-6.1
We are getting below error while connecting from kettle.
Error connecting to database [USMEDIC-CUSTOMER] : org.pentaho.di.core.exception.KettleDatabaseException:
Error occurred while trying to connect to the database
Error connecting to database: (using class net.sourceforge.jtds.jdbc.Driver)
Login failed for user 'RemoteSQL'.
org.pentaho.di.core.exception.KettleDatabaseException:
Error occurred while trying to connect to the database
Error connecting to database: (using class net.sourceforge.jtds.jdbc.Driver)
Login failed for user 'RemoteSQL'.
Please help me on this.
Thanks in advance,
Janu:confused::confused::confused:
We are not able to connect MS Sql server database from Pentaho data integration tool, but that is connecting from aqua data studio query analyser.
MS Sql server version : Microsoft SQL Server 2017 (RTM-GDR) (KB4505224) - 14.0.2027.2 (X64)
Jun 15 2019 00:26:19
Copyright (C) 2017 Microsoft Corporation
Developer Edition (64-bit) on Windows Server 2016 Standard 10.0 <X64> (Build 14393: ) (Hypervisor)
kettle version : pdi-ce-6.1
We are getting below error while connecting from kettle.
Error connecting to database [USMEDIC-CUSTOMER] : org.pentaho.di.core.exception.KettleDatabaseException:
Error occurred while trying to connect to the database
Error connecting to database: (using class net.sourceforge.jtds.jdbc.Driver)
Login failed for user 'RemoteSQL'.
org.pentaho.di.core.exception.KettleDatabaseException:
Error occurred while trying to connect to the database
Error connecting to database: (using class net.sourceforge.jtds.jdbc.Driver)
Login failed for user 'RemoteSQL'.
Please help me on this.
Thanks in advance,
Janu:confused::confused::confused:
↧