I want to alter the labels displayed on my chart. I can change all of them using an extension point. However I want to set the the labels based on the original label value. How do I access that original value?
↧
Edit x-Axis Labels in a Line Chart
↧
Only 8 values IN Clause in generated SQL
Hello !
Going from mondrian 3.3 to 3.5 brought a strange phenomenon.
First, some query take 5X the time to execute. Looking at the mondian SQL log, I noticed that some query are unsing the IN clause with only 8 members at a time, repeting the SELECT to include all the 800+ value:
Ex.:
SELECT ...
AND DeptCode IN (1,2,3,4,5,6,7,8)
...
SELECT ...
AND DeptCode IN (9,10,11,12,13,14,15,16)
...
My mondrian.rolap.maxConstraints parameter is set at 1000. I tried increasing it to 10000 with no changes.
Is this parameter still used in 3.5 ? Why do I only get 8 values per IN clause ?
Database: SQLServer 2008
Thanks !
Going from mondrian 3.3 to 3.5 brought a strange phenomenon.
First, some query take 5X the time to execute. Looking at the mondian SQL log, I noticed that some query are unsing the IN clause with only 8 members at a time, repeting the SELECT to include all the 800+ value:
Ex.:
SELECT ...
AND DeptCode IN (1,2,3,4,5,6,7,8)
...
SELECT ...
AND DeptCode IN (9,10,11,12,13,14,15,16)
...
My mondrian.rolap.maxConstraints parameter is set at 1000. I tried increasing it to 10000 with no changes.
Is this parameter still used in 3.5 ? Why do I only get 8 values per IN clause ?
Database: SQLServer 2008
Thanks !
↧
↧
Performance of SQL query.. How to avoid calling sigle query multiple times ?
Hi Forum, find the image below
CDA performance.jpg
I have to populate data on 2 panels using Single SQL query. When two panels loads with some data the SQL query calls twice. So it might effect the database server performance by calling same query twice for 2 charts. How to avoid calling the same SQL query multiple times so that I can increase the performance of database,query result set ???
Many thanks in Advance.
:) Sadakar :)
CDA performance.jpg
I have to populate data on 2 panels using Single SQL query. When two panels loads with some data the SQL query calls twice. So it might effect the database server performance by calling same query twice for 2 charts. How to avoid calling the same SQL query multiple times so that I can increase the performance of database,query result set ???
Many thanks in Advance.
:) Sadakar :)
↧
BI Server Memory leak
We are on BI-Server 4.8 EE.
On a nightly basis we are having our Pentaho BI server run out of memory and require a forced restart. The server currently has 18GB of heap allocated and it maxes it out.
SEVERE: The web application [/pentaho] appears to have started a thread named [Timer-3] but has failed to stop it. This is very likely to create a memory leak.
Aug 14, 2013 2:06:19 PM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
SEVERE: The web application [/pentaho] created a ThreadLocal with key of type [java.lang.InheritableThreadLocal] (value [java.lang.InheritableThreadLocal@73f5e59b]) and a value of type [org.pentaho.platform.engine.security.session.TrustedSystemStartupSession] (value [org.pentaho.platform.engine.security.session.TrustedSystemStartupSession@7e066f29]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
We receive many messages like that with different thread names. The server is currently going down every night. We are unable to track down the root cause or configuration that is causing the problem. Any help is appreciated.
On a nightly basis we are having our Pentaho BI server run out of memory and require a forced restart. The server currently has 18GB of heap allocated and it maxes it out.
SEVERE: The web application [/pentaho] appears to have started a thread named [Timer-3] but has failed to stop it. This is very likely to create a memory leak.
Aug 14, 2013 2:06:19 PM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
SEVERE: The web application [/pentaho] created a ThreadLocal with key of type [java.lang.InheritableThreadLocal] (value [java.lang.InheritableThreadLocal@73f5e59b]) and a value of type [org.pentaho.platform.engine.security.session.TrustedSystemStartupSession] (value [org.pentaho.platform.engine.security.session.TrustedSystemStartupSession@7e066f29]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
We receive many messages like that with different thread names. The server is currently going down every night. We are unable to track down the root cause or configuration that is causing the problem. Any help is appreciated.
↧
Dynamic SQL for Table Input Step.
Hi All,
I have a situation where i need to have parameterize the Table Input Step.
I have a meta data which contains say
table_name column_name
TX CX1
TX CX2
TY CY1
.
Now based on the rows above, i need to have ONE transformation table input step which would dynamically select the column from the table based on the meta data shown.
Did some reading and found that
Table Input Step would be
SELECT {FIELD_NAME}
FROM {TABLE_NAME}
;
Where FIELD_NAME and TABLE_NAME are basically environment variable.
So , that prompts the question,
1) How could i have environment variables defined dynamically based on some values of rows (it changes for the next row) ?
2) Or if there is any other way to resolve this use case ?
Thanks in advance for your time.
--
Brajendra Bhujabal
I have a situation where i need to have parameterize the Table Input Step.
I have a meta data which contains say
table_name column_name
TX CX1
TX CX2
TY CY1
.
Now based on the rows above, i need to have ONE transformation table input step which would dynamically select the column from the table based on the meta data shown.
Did some reading and found that
Table Input Step would be
SELECT {FIELD_NAME}
FROM {TABLE_NAME}
;
Where FIELD_NAME and TABLE_NAME are basically environment variable.
So , that prompts the question,
1) How could i have environment variables defined dynamically based on some values of rows (it changes for the next row) ?
2) Or if there is any other way to resolve this use case ?
Thanks in advance for your time.
--
Brajendra Bhujabal
↧
↧
Is it possible to design a tree chart using pentaho report designer
I have a use case where I need to create a tree chart with each node expanding to its child nodes upon click. the chart is used to indicate structure of a software component. Some nodes of the tree expand to child nodes while some fetch data from a data source. Can somebody on the community give me some helpful hints how to go about the task.
Thanks in advance
Thanks in advance
↧
Encode/Decode64 PDF File
I have a need to mainly encode64 a PDF document and equally decode an incoming encoded string back to a PDF document.
I have seen several examples where this can be easily done using Java mail API however I cannot figure out how to feed a step with the PDF filename. I have never coded with Java so some of the concepts and getting it to work within ETL is new for me.
I would really appreciate some insight and assistance!
Thanks
Ray
I have seen several examples where this can be easily done using Java mail API however I cannot figure out how to feed a step with the PDF filename. I have never coded with Java so some of the concepts and getting it to work within ETL is new for me.
I would really appreciate some insight and assistance!
Thanks
Ray
↧
Penatho Analyzer reports when DB has multiple fact tables
Hi all,
We are evaluating Pentaho for our business needs and we currently use a DB which does not confrom to star schema as documentation says Pentaho needs for designing Analyzer reports. We have measures coming from multiple tables which we would like to present in say a bar chart . Is there a work around for such a usecase?
TIA
We are evaluating Pentaho for our business needs and we currently use a DB which does not confrom to star schema as documentation says Pentaho needs for designing Analyzer reports. We have measures coming from multiple tables which we would like to present in say a bar chart . Is there a work around for such a usecase?
TIA
↧
Error running remote carte job with repository
I'm using CE 4.4.0 and a MySql repository (each on separate servers). I can execute a single Transform remotely, but if I try to execute a Job that calls the Transform (referenced via the Repository), the remote job submission fails with:
org.pentaho.di.core.exception.KettleException:
Unable to connect to the repository with name 'falcon-repo'
at org.pentaho.di.job.JobExecutionConfiguration.<init>(JobExecutionConfiguration.java:509)
at org.pentaho.di.job.JobConfiguration.<init>(JobConfiguration.java:68)
at org.pentaho.di.job.JobConfiguration.fromXML(JobConfiguration.java:76)
at org.pentaho.di.www.AddJobServlet.doGet(AddJobServlet.java:99)
I have the repositories.xml file copied to the slave server (if you don't you get a different error). I can ping the MySql server from the slave server. The error message doesn't give me any information that could help troubleshoot.
What else can I verify?
org.pentaho.di.core.exception.KettleException:
Unable to connect to the repository with name 'falcon-repo'
at org.pentaho.di.job.JobExecutionConfiguration.<init>(JobExecutionConfiguration.java:509)
at org.pentaho.di.job.JobConfiguration.<init>(JobConfiguration.java:68)
at org.pentaho.di.job.JobConfiguration.fromXML(JobConfiguration.java:76)
at org.pentaho.di.www.AddJobServlet.doGet(AddJobServlet.java:99)
I have the repositories.xml file copied to the slave server (if you don't you get a different error). I can ping the MySql server from the slave server. The error message doesn't give me any information that could help troubleshoot.
What else can I verify?
↧
↧
Where is pentaho.log in Pentaho CE?
Hello!
I´m very very very new in pentaho and I´m trying to turn on security logging. I have followed the instructions on http://wiki.pentaho.com/display/Serv...curity+Logging but I can't find pentaho.log file
Where is it? Pentaho help says is in /pentaho/server/biserver-ee/logs. I suppose I have to replace biserver-ee with biserver-ce but I don't have any "/logs" directory.
Could somebody help me?
Thank you,
I´m very very very new in pentaho and I´m trying to turn on security logging. I have followed the instructions on http://wiki.pentaho.com/display/Serv...curity+Logging but I can't find pentaho.log file
Where is it? Pentaho help says is in /pentaho/server/biserver-ee/logs. I suppose I have to replace biserver-ee with biserver-ce but I don't have any "/logs" directory.
Could somebody help me?
Thank you,
↧
MongoDB replica set Locking and slowness
So I hear that the next version of Pentaho (5.0) is going to have better capability of big data reporting and analytics. More nosql support. Anyway I don't think it's going to matter unless I'm missing something with replica set using mongodb.
Terrible solution when trying to query across millions of rows. No way to do a read only. Mongodb always performs a lock on queries which is totally bad when just trying to do reads for simple reports against a large collection. Trying to implement indexes to help is a challenge since indexes need a lock to implement. You have to take the reader node out of the replica set and create indexes and then put it back into replica set.
Stuck on this issue.
Terrible solution when trying to query across millions of rows. No way to do a read only. Mongodb always performs a lock on queries which is totally bad when just trying to do reads for simple reports against a large collection. Trying to implement indexes to help is a challenge since indexes need a lock to implement. You have to take the reader node out of the replica set and create indexes and then put it back into replica set.
Stuck on this issue.
↧
Using user supplied database login details to connect to the database.
Our company currently using a third party developed application that require login. The username and password are the database username and password. The application will connect to the database by using user supplied username, password and database name. It means our employees who use that application has a username and password in database, and we login to the application by using our database username and password. On the application login screen, user must enter the following details:
- Username
- Password
- Database name
The above application was developed and implemented by third party company before I was hired. So, I also don't know why they design like this.
I am developing a local intranet website that generate reports through BI server's ViewAction Content Generator ( http://infocenter.pentaho.com/help/i...iewaction.html ) . The website will only be accessible by using local network. I want only the users of the above mentioned application will be able to run the reports. On login screen, authorized employees enter their username (of course, database username), password, and database name. Once submitted, the website should pass these details to the BI server's ViewAction Content Generator, then the BI server will use these details to connect to the database to generate report.
Question: After our employees enter the login details (including database name), can BI server's ViewAction Content Generator get these details? Can BI server connect to the database by using these details? If yes, how to achieve that?
- Username
- Password
- Database name
The above application was developed and implemented by third party company before I was hired. So, I also don't know why they design like this.
I am developing a local intranet website that generate reports through BI server's ViewAction Content Generator ( http://infocenter.pentaho.com/help/i...iewaction.html ) . The website will only be accessible by using local network. I want only the users of the above mentioned application will be able to run the reports. On login screen, authorized employees enter their username (of course, database username), password, and database name. Once submitted, the website should pass these details to the BI server's ViewAction Content Generator, then the BI server will use these details to connect to the database to generate report.
Question: After our employees enter the login details (including database name), can BI server's ViewAction Content Generator get these details? Can BI server connect to the database by using these details? If yes, how to achieve that?
↧
global variable/Parameter conflict on same page.
Hi ALL ,
In my application , I am calling the pentaho dashboard via iframe. In one page I have multiple iframe and each contain dynamic report on base of user selection.Now here problem is sometime some iframe doesn't render the chart and sometime it does, externally it's work fine.
After some analysis , I found that , iframes are initiate the chart very same time , and I have same type of BI dashboard (means all parameter are same ,just query is differ) , so as per me parameter or global parameter/variables are conflicting between the different iframe.(I am passing the some parameter from the URL also) which prevent the some chart to render.
Can you help me on this.
Regards , Pranav
In my application , I am calling the pentaho dashboard via iframe. In one page I have multiple iframe and each contain dynamic report on base of user selection.Now here problem is sometime some iframe doesn't render the chart and sometime it does, externally it's work fine.
After some analysis , I found that , iframes are initiate the chart very same time , and I have same type of BI dashboard (means all parameter are same ,just query is differ) , so as per me parameter or global parameter/variables are conflicting between the different iframe.(I am passing the some parameter from the URL also) which prevent the some chart to render.
Can you help me on this.
Regards , Pranav
↧
↧
sending Soap message using java class
Hi All,
I am facing a problem in using SOAP step and Webservice lookup for sending soap request.I have very less experience of pentaho DI. i wanna know can i send soap messages by writing a custom java code?
The webservice i am using has schema definitions mean xsds n dtds are separate and wsdl is refrencing these. whenever i try to load the URL it says that could not retreive wsdl operator for operation name....
after many tries i decided to do it through java code... what do you suggest ? if any one can help me
I am facing a problem in using SOAP step and Webservice lookup for sending soap request.I have very less experience of pentaho DI. i wanna know can i send soap messages by writing a custom java code?
The webservice i am using has schema definitions mean xsds n dtds are separate and wsdl is refrencing these. whenever i try to load the URL it says that could not retreive wsdl operator for operation name....
after many tries i decided to do it through java code... what do you suggest ? if any one can help me
↧
Pentaho PDI and CDH4 and hive
I have problems to connect to Hive database via PDI. I do it with this manual: http://wiki.pentaho.com/display/BAD/...ta+within+Hive. By testing connection i get this error:
Error connecting to database [hive] : org.pentaho.di.core.exception.KettleDatabaseException: Error occured while trying to connect to the database Error connecting to database: (using class org.apache.hadoop.hive.jdbc.HiveDriver) class com.facebook.fb303.FacebookService$Client has interface org.apache.thrift.TServiceClient as super class org.pentaho.di.core.exception.KettleDatabaseException: Error occured while trying to connect to the database Error connecting to database: (using class org.apache.hadoop.hive.jdbc.HiveDriver) class com.facebook.fb303.FacebookService$Client has interface org.apache.thrift.TServiceClient as super class
If i click Ok and try in again i get other error:
Error connecting to database [hive] : org.pentaho.di.core.exception.KettleDatabaseException: Error occured while trying to connect to the database Error connecting to database: (using class org.apache.hadoop.hive.jdbc.HiveDriver) org/apache/hadoop/hive/service/HiveClient org.pentaho.di.core.exception.KettleDatabaseException: Error occured while trying to connect to the database Error connecting to database: (using class org.apache.hadoop.hive.jdbc.HiveDriver) org/apache/hadoop/hive/service/HiveClient
Why i have this error? What .jar should i change/delete/update?
CDH4.6 latest. All Hadoop-stack latest. PDI 4.4.0
Error connecting to database [hive] : org.pentaho.di.core.exception.KettleDatabaseException: Error occured while trying to connect to the database Error connecting to database: (using class org.apache.hadoop.hive.jdbc.HiveDriver) class com.facebook.fb303.FacebookService$Client has interface org.apache.thrift.TServiceClient as super class org.pentaho.di.core.exception.KettleDatabaseException: Error occured while trying to connect to the database Error connecting to database: (using class org.apache.hadoop.hive.jdbc.HiveDriver) class com.facebook.fb303.FacebookService$Client has interface org.apache.thrift.TServiceClient as super class
If i click Ok and try in again i get other error:
Error connecting to database [hive] : org.pentaho.di.core.exception.KettleDatabaseException: Error occured while trying to connect to the database Error connecting to database: (using class org.apache.hadoop.hive.jdbc.HiveDriver) org/apache/hadoop/hive/service/HiveClient org.pentaho.di.core.exception.KettleDatabaseException: Error occured while trying to connect to the database Error connecting to database: (using class org.apache.hadoop.hive.jdbc.HiveDriver) org/apache/hadoop/hive/service/HiveClient
Why i have this error? What .jar should i change/delete/update?
CDH4.6 latest. All Hadoop-stack latest. PDI 4.4.0
↧
Small extension point difficulties
Hello,
I have had some trouble with the CCC component, but I have been able to resolve it so far.
But there are two things that I can't solve.
The y Axis title, and the x axis label.
I've got an example of what I did so far (using ccc2).
For the y Axis title, I tried the following extension points:
with this I wanted to place a title for the yAxis.
For the x axis label I tried:
to show the format '%m-%d %H' instead of '%H:%M %p' for each value of the xAxisLabel.
Thank you for your help.
I have had some trouble with the CCC component, but I have been able to resolve it so far.
But there are two things that I can't solve.
The y Axis title, and the x axis label.
I've got an example of what I did so far (using ccc2).
For the y Axis title, I tried the following extension points:
- yAxisTitle: 'UV Level',
- yAxisTitle_text: 'UV Level',
- yAxisTitleLabel_text: 'UV Level',
with this I wanted to place a title for the yAxis.
For the x axis label I tried:
- baseAxisScale_dateTickFormat: '%m-%d %H',
- xAxisScale_dateTickFormat: '%m-%d %H',
to show the format '%m-%d %H' instead of '%H:%M %p' for each value of the xAxisLabel.
Thank you for your help.
↧
Database Value Lookup problem with boolean
I was having some troubles with the Database Value Lookup step today.
In a transformation I used the Dimension Lookup / Update step to insert in my SCD ACCOUNT_STATUS table. To define the last inserted. that's how I defined my table :
Spoon inserts 'Y' or 'N' in TOP because I used an Oracle database, This part works very well !!!
In an other transformation I would get the last row inserted for an account in the ACCOUNT_STATUS table, for that I use the Database Value Lookup step with these lookup values :
I get ACCOUNT_ID from my database and I set TOP with a Add constant values step (Name : TOP, Type : String, Value : Y), when I load this transformation, it doesn't find the last row inserted, if I remove the TOP comparison it finds all rows inserted for this account.
I don't understand how Spoon works with Boolean, I've tried with Boolean, Integer, ... but always it doesn't work.
Thanks in advance for any help,
Yvan
In a transformation I used the Dimension Lookup / Update step to insert in my SCD ACCOUNT_STATUS table. To define the last inserted. that's how I defined my table :
| Name | Null | Type |
| ACCOUNT_STATUS_ID | NOT NULL | NUMBER |
| ACCOUNT_ID | NOT NULL | NUMBER |
| STATUS_ID | NOT NULL | NUMBER |
| START_DATE | DATE | |
| END_DATE | DATE | |
| TOP | VARCHAR2(1 CHAR) | |
| VERSION | NUMBER |
Spoon inserts 'Y' or 'N' in TOP because I used an Oracle database, This part works very well !!!
In an other transformation I would get the last row inserted for an account in the ACCOUNT_STATUS table, for that I use the Database Value Lookup step with these lookup values :
| Table field | Comparator | Field1 |
| ACCOUNT_ID | = | ACCOUNT_ID |
| TOP | = | TOP |
I get ACCOUNT_ID from my database and I set TOP with a Add constant values step (Name : TOP, Type : String, Value : Y), when I load this transformation, it doesn't find the last row inserted, if I remove the TOP comparison it finds all rows inserted for this account.
I don't understand how Spoon works with Boolean, I've tried with Boolean, Integer, ... but always it doesn't work.
Thanks in advance for any help,
Yvan
↧
↧
Reporting variables back to a Java wrapper
I have a Kettle process and would like to set a variable within the process using something like Set Field Value or Set Variables.
I then plan on executing this Kettle transformation from within a Java wrapper. I can make the call fine, but cannot get the field or variable values out. In Java I can set variable names by calling setVariable on an instance of TransMeta. These variables can then be used by the Kettle transformation, but if I try getVariable on any variable set inside the Kettle transformation, I just get a response of null.
Is there any way to get a variable out of the Kettle transformation into the Java wrapper?
I then plan on executing this Kettle transformation from within a Java wrapper. I can make the call fine, but cannot get the field or variable values out. In Java I can set variable names by calling setVariable on an instance of TransMeta. These variables can then be used by the Kettle transformation, but if I try getVariable on any variable set inside the Kettle transformation, I just get a response of null.
Is there any way to get a variable out of the Kettle transformation into the Java wrapper?
↧
Netezza 6.0.8 ODBC to JDBC bridge to Pentaho Kettle 4.3.0
Workflow:
1.) Installed ODBC Netezza driver on Windows Server 2008 for Netezza version 6.0.8
2.) Configured the 64 bit (not 32 bit) ODBC driver in Control Panel > Administrative Tools > ODBC Data Sources > System tab (NETEZZA showed up after installing the driver)
3.) Tested 64 bit ODBC data source from within Control Panel by clicking "Configure" > "Test" > said "Successful".
4.) Then I launched Spoon (I have the 64 bit Java 1.6 JVM configured in Kettle)
5.) Opened Database Connections > configured the 3 parameters (ODBC data source name, login, and password) > it fails
JDBC works great with the 5 parameters, but my department is changing our security standards and I need to start using ODBC now. I see that Pentaho Kettle has a bunch of library folders lib, libext, etc... do I need to do something in there?
1.) Installed ODBC Netezza driver on Windows Server 2008 for Netezza version 6.0.8
2.) Configured the 64 bit (not 32 bit) ODBC driver in Control Panel > Administrative Tools > ODBC Data Sources > System tab (NETEZZA showed up after installing the driver)
3.) Tested 64 bit ODBC data source from within Control Panel by clicking "Configure" > "Test" > said "Successful".
4.) Then I launched Spoon (I have the 64 bit Java 1.6 JVM configured in Kettle)
5.) Opened Database Connections > configured the 3 parameters (ODBC data source name, login, and password) > it fails
JDBC works great with the 5 parameters, but my department is changing our security standards and I need to start using ODBC now. I see that Pentaho Kettle has a bunch of library folders lib, libext, etc... do I need to do something in there?
↧
tooltip in CCC Bullet
You can implement tooltip in CCC Bullet within the table component in the Range? in the same way that already exists in Measure.
extensionPoints:
"bulletRange_tooltip": function(d) { return d; } **** this does not work!
Thanks
extensionPoints:
"bulletRange_tooltip": function(d) { return d; } **** this does not work!
Thanks
↧