I recently upgraded from 8.0 to 8.1, and now the Carte status page stopped rendering the images. I have restarted carte service and even restarted the server, but it did not resolve this issue. Any idea how to resolve this issue?
![]()
![]()
↧
Carte - Job and Trans Image not rendering
↧
Log error if data is not in wrong format in excel file
Hi All,
I am using excel input step to read excel data. I want to log error if data in a particular column in excel file is of wrong format.
For example, log error with line number, if string data in numerical field.
I am using pentaho 7.1 ce.
Please help.
Thanks
Ajinkya
I am using excel input step to read excel data. I want to log error if data in a particular column in excel file is of wrong format.
For example, log error with line number, if string data in numerical field.
I am using pentaho 7.1 ce.
Please help.
Thanks
Ajinkya
↧
↧
Kettle startup times in versions 7.0, 8.0 --- and 8.1 ?
There is a good article about Pentaho startup time, and how to speed it up at:
https://blog.twineworks.com/improvin...n-78d0803c559b
The 'remove plugins' method works for Pentaho Data Integration (Kettle) versions 7.0 and 8.0, but no longer apply to version 8.1.
Has anybody done work with startup time in Kettle version 8.1?
https://blog.twineworks.com/improvin...n-78d0803c559b
The 'remove plugins' method works for Pentaho Data Integration (Kettle) versions 7.0 and 8.0, but no longer apply to version 8.1.
Has anybody done work with startup time in Kettle version 8.1?
↧
Split data from irregular CSV
Hi everybody.
I have the CSV file below and I need to split this. I tried to use Replace in String, replacing \;{1,} by | (using Regex) after that Split Rows by |, but in the rows 4 and 8, the Date was in Number Field.
![]()
In this case I need to organize like this, with null where I don't have number.
![]()
Can anyone help me?
I have the CSV file below and I need to split this. I tried to use Replace in String, replacing \;{1,} by | (using Regex) after that Split Rows by |, but in the rows 4 and 8, the Date was in Number Field.
In this case I need to organize like this, with null where I don't have number.
Can anyone help me?
↧
Saiku timeout after 30 seconds running
Hi there.
I am trying to find out why Saiku raises a timeout 30 seconds after an analysis begin if not finished. When the timeout occurs usually I press the "play" button and then the analysis result is brought. I checked the database log and realized that when the timeout happens the database session keeps alive and running and when the "play" button is pressed again Saiku/Mondrian connects to the same session and retrieve the result set.
I checked the mondrian.properties file and the timeout property is already set to 300 (seconds), which is 5 minutes, and that doesn't make sense to me.
Already checked everywhere in Google and in the Saiku Google Group but couldn't find anything about it.
Could someone give me some help?
Thanks!
I am trying to find out why Saiku raises a timeout 30 seconds after an analysis begin if not finished. When the timeout occurs usually I press the "play" button and then the analysis result is brought. I checked the database log and realized that when the timeout happens the database session keeps alive and running and when the "play" button is pressed again Saiku/Mondrian connects to the same session and retrieve the result set.
I checked the mondrian.properties file and the timeout property is already set to 300 (seconds), which is 5 minutes, and that doesn't make sense to me.
Already checked everywhere in Google and in the Saiku Google Group but couldn't find anything about it.
Could someone give me some help?
Thanks!
↧
↧
Salesforce Standard Integer Fields
Kettle 7.1.0.0-1
Java 1.8.0_181
Windows 10.0.17134 Build 17134 64bit
Salesforce Enterprise Edition Summer '18 release
Salesforce profile: system administrator
Hi,
For a migration project I want to populate standard Account field NumberOfEmployees in Salesforce.
Reproducing using only data grid with a single row name='test',numbersofemployees=2 and Salesforce insert steps in Kettle, kettle returns consistent api error INVALID_TYPE_ON_FIELD_IN_RECORD. Datatypes Integer, Number and String for numberofemployees all result in this error.
When populating to a custom field with type Integer (in Salesforce + Kettle) there is no issue.
I kept the api version in the 'Salesforce Webservice URL' field of the Salesforce Insert step at v37, which seems non-relevant.
According to the documentation this field is of primitive type int. Looking at the api the XML type is xsd:int, while custom fields of type Integer have xsd:double.
Thank you in advance,
With kind regards,
Peter
Java 1.8.0_181
Windows 10.0.17134 Build 17134 64bit
Salesforce Enterprise Edition Summer '18 release
Salesforce profile: system administrator
Hi,
For a migration project I want to populate standard Account field NumberOfEmployees in Salesforce.
Reproducing using only data grid with a single row name='test',numbersofemployees=2 and Salesforce insert steps in Kettle, kettle returns consistent api error INVALID_TYPE_ON_FIELD_IN_RECORD. Datatypes Integer, Number and String for numberofemployees all result in this error.
When populating to a custom field with type Integer (in Salesforce + Kettle) there is no issue.
I kept the api version in the 'Salesforce Webservice URL' field of the Salesforce Insert step at v37, which seems non-relevant.
According to the documentation this field is of primitive type int. Looking at the api the XML type is xsd:int, while custom fields of type Integer have xsd:double.
Thank you in advance,
With kind regards,
Peter
↧
Call RT REST web service to retrieve ticket list
Hi,
I have a ticket system based on RT and that also provides retrieving all the data via REST call (https://rt-wiki.bestpractical.com/wiki/REST#Abstract).
I have used the REST client and HTTP client steps to get the data and always get
RT/4.0.5 401 Credentials required
back. Credentials are provided in the steps but I am pretty sure it does not work because of
Authentication
The REST Interface does not support HTTP-Authentication. So you must get a valid Session-Token and submit the cookie each request. You usually get a Session-Cookie by submitting the default login form. Use variables "user" for login and "pass" for password values. wget doesn't escape any characters in the --post-data option so make sure you properly escape any special characters in the password.
See the wget invocation line below:
wget --keep-session-cookies \
--save-cookies cookies.txt \
--post-data 'user=UUUU&pass=PPPP' \
http://my.rt.server
You need the -keep-session-cookies option to make wget save session cookies.
https://rt-wiki.bestpractical.com/wi...Authentication
So the questions is: how do I get that WGET done in PDI so it creates the cookie first before running that step? Or should I rather try to invoke a CURL request instead?
Bose
I have a ticket system based on RT and that also provides retrieving all the data via REST call (https://rt-wiki.bestpractical.com/wiki/REST#Abstract).
I have used the REST client and HTTP client steps to get the data and always get
RT/4.0.5 401 Credentials required
back. Credentials are provided in the steps but I am pretty sure it does not work because of
Quote:
Authentication
The REST Interface does not support HTTP-Authentication. So you must get a valid Session-Token and submit the cookie each request. You usually get a Session-Cookie by submitting the default login form. Use variables "user" for login and "pass" for password values. wget doesn't escape any characters in the --post-data option so make sure you properly escape any special characters in the password.
See the wget invocation line below:
wget --keep-session-cookies \
--save-cookies cookies.txt \
--post-data 'user=UUUU&pass=PPPP' \
http://my.rt.server
You need the -keep-session-cookies option to make wget save session cookies.
So the questions is: how do I get that WGET done in PDI so it creates the cookie first before running that step? Or should I rather try to invoke a CURL request instead?
Bose
↧
Role is not refresh until we restart pentaho
Hi
We are using Pentaho 8.0 Comunity Edition CDE which is configure with SSO (Key Cloak)
I am facing issue which is when i assigned new role to any user it did not reflect in PUC until i restart my server.
If i restart my pentaho server then new role appear for the user.
My question, Is there any API or any method which will refresh roles
Thanks
Naimish
We are using Pentaho 8.0 Comunity Edition CDE which is configure with SSO (Key Cloak)
I am facing issue which is when i assigned new role to any user it did not reflect in PUC until i restart my server.
If i restart my pentaho server then new role appear for the user.
My question, Is there any API or any method which will refresh roles
Thanks
Naimish
↧
Do we have some step to convert AD date into yyyy-MM-dd?
I have dates as numbers (for instance 42390). I see this post can be solution: https://forums.pentaho.com/threads/1...dable-formats/
But do we have some step to use to convert it instead of Java code?
Regards
But do we have some step to use to convert it instead of Java code?
Regards
↧
↧
Can you recommend some trick to create MySQL table to insert data from input?
Hello there,
Sometimes it takes time to manually create MySQL table to insert data from some input (if lot of fields).
Maybe there is some trick to receive ready 'table create' code?
Regards,
Sometimes it takes time to manually create MySQL table to insert data from some input (if lot of fields).
Maybe there is some trick to receive ready 'table create' code?
Regards,
↧
trying to avoid duplicate code in UDJC
I have one Java method that I use in many UDJC steps among multiple transformations.
The method involves accessing parent/root jobs and setting/updating various variables.
I've created jars and reused basic java functions before.
However, this method involves traversing Jobs, using Kettle method calls.
Is there a way to create a single global/static method that uses Kettle methods instead of cut/pasting the method everywhere?
The method involves accessing parent/root jobs and setting/updating various variables.
I've created jars and reused basic java functions before.
However, this method involves traversing Jobs, using Kettle method calls.
Is there a way to create a single global/static method that uses Kettle methods instead of cut/pasting the method everywhere?
↧
Any chance for working step "ElasticSearch Bulk Insert"?
Elastic has Logstash to load data into Elasticsearch. Problem is that this piece of software is really bad quality; actually it does not work with JDBC MySQL.
What Pentaho is doing in seconds, Logstash needs hours.
But "ElasticSearch Bulk Insert" step is not working with last edition of Elasticsearch. Will it be done in next release? Any news about that?
Regards,
What Pentaho is doing in seconds, Logstash needs hours.
But "ElasticSearch Bulk Insert" step is not working with last edition of Elasticsearch. Will it be done in next release? Any news about that?
Regards,
↧
Pass parameter via url to mdx query in saiku query.
Hi,
Can someone pls provide me link for passing parameters to saiku query to ,have a row level filter.
I have tried may approaches still no luck.
I have saiku version of 3.17
and Pentaho community version 7.1 community version
Regards..
Can someone pls provide me link for passing parameters to saiku query to ,have a row level filter.
I have tried may approaches still no luck.
I have saiku version of 3.17
and Pentaho community version 7.1 community version
Regards..
↧
↧
Unable To Read The Data From Hive
Hi ,
Am trying to read the data from hive db using PDI 8.1 by applying join from tables residing in hive itself.
Getting below error.
Error:Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask.
Can you please help me to resolve this issue.
Thanks in Advance ,
Lavanya A.
Am trying to read the data from hive db using PDI 8.1 by applying join from tables residing in hive itself.
Getting below error.
Error:Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask.
Can you please help me to resolve this issue.
Thanks in Advance ,
Lavanya A.
↧
Select value metadata change gives wrong result.
i have input date like dd/mm/yy e.g 02/02/48 while im converting this to dd/mm/yyyy format using select value step it is giving 02/02/1948 which is wrong.
how I can make it like 02/02/2048.
how I can make it like 02/02/2048.
↧
IMPORTANT - Pass Date range filter in Saiku Query
Hi,
How to pass date range filter to Saiku dashboard from saiku UI, without swithing to mdx mode ( as I have to keep UI for further dashboards modification.
How can I update my measure values based on date range passed?
How to pass date range filter to Saiku dashboard from saiku UI, without swithing to mdx mode ( as I have to keep UI for further dashboards modification.
How can I update my measure values based on date range passed?
↧
Multiple Kitchen log entries (console)
Hi,
I'm trying to better configure my console log4j output adding a tag to that. I altered the file /opt/data-integration/plugins/kettle5-log4j-plugin/log4j.xml file as follow:
When I run my simple job
I get the following results in my console output:
As you can see, after enabling appender-ref console to value=on, my log entries start doubling. How can I keep just the entry with the TEST LOGGING I configured?
Thank you
I'm trying to better configure my console log4j output adding a tag to that. I altered the file /opt/data-integration/plugins/kettle5-log4j-plugin/log4j.xml file as follow:
Code:
<!DOCTYPElog4j:configuration SYSTEM "log4j.dtd"><log4j:configuration xmlns:log4j='http://jakarta.apache.org/log4j/'>
<appender name="console" class="org.apache.log4j.ConsoleAppender">
<param name="Target" value="System.out"/>
<layout class="org.apache.log4j.PatternLayout">
<param name="ConversionPattern" value="%d{yyyy-MM-dd HH:mm:ss} TEST LOGGING - %m%n" />
</layout>
</appender>
<logger name="org.pentaho.di">
<level value="on"/>
<appender-ref ref="console" />
</logger>
<root>
<priority value ="off"></priority>
<appender-ref ref="console"></appender-ref>
</root>
</log4j:configuration>Code:
./kitchen.sh -file ~/Desktop/job.kjbCode:
...
2018/09/18 11:42:43 - job - Start of job execution
2018-09-18 11:42:43 TEST LOGGING - job - Start of job execution
2018/09/18 11:42:43 - Carte - Installing timer to purge stale objects after 1440 minutes.
2018-09-18 11:42:43 TEST LOGGING - Carte - Installing timer to purge stale objects after 1440 minutes.
2018/09/18 11:42:43 - job - Starting entry [Transformation]
2018-09-18 11:42:43 TEST LOGGING - job - Starting entry [Transformation]
2018/09/18 11:42:43 - Transformation - Loading transformation from XML file [file:///home/caio/Desktop/blah.ktr]
2018-09-18 11:42:43 TEST LOGGING - Transformation - Loading transformation from XML file [file:///home/caio/Desktop/blah.ktr]
2018/09/18 11:42:43 - Transformation - Using run configuration [Pentaho local]
2018-09-18 11:42:43 TEST LOGGING - Transformation - Using run configuration [Pentaho local]
2018/09/18 11:42:43 - Transformation - Using legacy execution engine
2018-09-18 11:42:43 TEST LOGGING - Transformation - Using legacy execution engine
2018/09/18 11:42:43 - blah - Dispatching started for transformation [blah]
2018-09-18 11:42:43 TEST LOGGING - blah - Dispatching started for transformation [blah]
2018/09/18 11:42:44 - Table input.0 - Finished reading query, closing connection.
2018-09-18 11:42:44 TEST LOGGING - Table input - Finished reading query, closing connection.
2018/09/18 11:42:44 - Table input.0 - Finished processing (I=1, O=0, R=0, W=1, U=0, E=0)
2018-09-18 11:42:44 TEST LOGGING - Table input - Finished processing (I=1, O=0, R=0, W=1, U=0, E=0)
2018/09/18 11:42:44 - job - Starting entry [Success]
2018-09-18 11:42:44 TEST LOGGING - job - Starting entry [Success]
2018/09/18 11:42:44 - job - Finished job entry [Success] (result=[true])
2018-09-18 11:42:44 TEST LOGGING - job - Finished job entry [Success] (result=[true])
2018/09/18 11:42:44 - job - Finished job entry [Transformation] (result=[true])
2018-09-18 11:42:44 TEST LOGGING - job - Finished job entry [Transformation] (result=[true])
2018/09/18 11:42:44 - job - Job execution finished
2018-09-18 11:42:44 TEST LOGGING - job - Job execution finished
2018/09/18 11:42:44 - Kitchen - Finished!
2018-09-18 11:42:44 TEST LOGGING - Kitchen - Finished!
2018/09/18 11:42:44 - Kitchen - Start=2018/09/18 11:42:18.901, Stop=2018/09/18 11:42:44.039
2018-09-18 11:42:44 TEST LOGGING - Kitchen - Start=2018/09/18 11:42:18.901, Stop=2018/09/18 11:42:44.039
2018/09/18 11:42:44 - Kitchen - Processing ended after 25 seconds.
2018-09-18 11:42:44 TEST LOGGING - Kitchen - Processing ended after 25 seconds.
...Thank you
↧
↧
Regex to retrieve part of string
Hi all,
I want to retrieve 25 from following string.
For example: Sunday, 25 March, 01:00
The format of above string is fixed.
Can I get it by using regex?
Please can anybody help me in creating regex for this?
I am trying to use "replace string" step for this.
Please let me know if any other easy way for implementation
Thanks
I want to retrieve 25 from following string.
For example: Sunday, 25 March, 01:00
The format of above string is fixed.
Can I get it by using regex?
Please can anybody help me in creating regex for this?
I am trying to use "replace string" step for this.
Please let me know if any other easy way for implementation
Thanks
↧
Where to find Saiku Analytics Repository?
Hi all,
I lost all things.
First thing I want to known: is there a possibility to find all my analysis views that I was running on the platform.
can I find them and restore them please?
I thought to find them somewhere here but then nothing ...
/opt/pentaho/pentaho-server/pentaho-solutions/system/saiku/saiku-repository/
Help me please!!!!
Regards,
Lotenbol
I lost all things.
First thing I want to known: is there a possibility to find all my analysis views that I was running on the platform.
can I find them and restore them please?
I thought to find them somewhere here but then nothing ...
/opt/pentaho/pentaho-server/pentaho-solutions/system/saiku/saiku-repository/
Help me please!!!!
Regards,
Lotenbol
↧
In what order are variables initialized?
Let's start with a job that has these parameters:
A = "A_Value AND ${B_Value}"
B = "B_Value"
In java, this would be something like:
String a = "A_Value AND " + b;
String b = "B_Value"
This is not legal. In kettle, it seems to work. But is it guaranteed to always work? And why?
A = "A_Value AND ${B_Value}"
B = "B_Value"
In java, this would be something like:
String a = "A_Value AND " + b;
String b = "B_Value"
This is not legal. In kettle, it seems to work. But is it guaranteed to always work? And why?
↧