Quantcast
Channel: Pentaho Community Forums
Viewing all 16689 articles
Browse latest View live

CDE Table - Expand on Click

$
0
0
Hey Pentaho forums,

I've been using CDE for about a year, and now I'm trying to step up the interactivity in one of my dashboards.

At present, I've got a table with three columns. Those columns are populated via a SQL data source which returns three columns. Simple so far. What I'd like to do is use the Expand on Click function to display additional values for a given row that aren't displayed in one of the three columns on the main table. I'm assuming I can accomplish this with some combination of Expand Parameters and Expand container object, but I'm a little lost with where to start.

For example, how would populate a table of three columns where each row has an additional value in the expanded section? I've attached an image showing what I have so far, if that helps.

Screenshot 2016-09-22 16.00.08.jpg
Attached Images

How to give symbol to the orthoAxis?

$
0
0
Hello Everyone,

I want to give a label with symbol to the orthoAxis i.e (On orthoAxis lable : Temp(°C))
How can i do that?

I tried to use extension point, but it didn't help.

when i use javascript it shows degree symbol in preview but when i open it in new window it just display (Temp(?C).

How can i fix that?

I am also using kettle as a data source. Is there any way to fix it in a kettle or any other way?

Thanks

Dependency Conflict while running an external jar using UDJC step

$
0
0
I have a spring project which is deployed in libext folder in Pentaho Data Integration and called from "User Defined Java Class" step. I get a java.lang.NoSuchMethodError: org.springframework.jdbc.core.namedparam.NamedParameterJdbcTemplate.batchUpdate The project has a dependency on org.springframework.spring-jdbc (version 4.1.7) which has batchUpdate method in NamedParameterJdbcTemplate. How can this dependency conflict be resolved..Thanks in advance

problem in pentaho downloading

$
0
0
when I download pentaho data intigration , the download was stopped
any one have a solution ?

Pentaho cde excel export after change table header dont take new header

$
0
0
I have a Pentaho 6 cde table component with these column headers:
Code:

|toto/a |toto/b |titi/a |titi/b |
After modifying column headers with jquery in post execution, I have these new headers displayed:
Code:

|toto |titi |
|a |b |a |b |

But when I use the export button or the table.queryState.exportData function the exported file still with |toto/a | toto/b | titi/a | titi/b| header.

Any idea for having the displayed columns in the export file?

Pentaho Bruteforce Login

$
0
0
Hi Team,

How can we prevent and monitor logon attempts and provide attempt threshold in pentaho login console to avoid Brute Force Logon attempts.

Vertica Bulk Loader Is not working when running on Carte

$
0
0
Hi,
I am using vertica bulk loader to load the data from source. When running without cluster it is working fine but when trying to run on cluster I am getting
below error:
It was not possible to load the specified transformation
Caused by: org.pentaho.di.core.exception.KettleMissingPluginsException:
Missing plugins found while loading a transformation
Step : VerticaBulkLoader

I am using Penthao Enterprise edition 5.4.0.1-130
In my kettle.properties file I have set this path in KETTLE_PLUGIN_PACKAGES variable as suggested in http://forums.pentaho.com/showthread...issing-Plugins

KETTLE_PLUGIN_PACKAGES=/opt/Pentaho/design-tools/data-integration/plugins

below is code snippet from my spoon.sh fileOPT="$OPT $PENTAHO_DI_JAVA_OPTIONS -Djava.library.path=$LIBPATH -DKETTLE_HOME=$KETTLE_HOME -DKETTLE_REPOSITORY=$KETTLE_REPOSITORY -DKETTLE_USER=$KETTLE_USER -DKETTLE_PASSWORD=$KETTLE_PASSWORD -DKETTLE_PLUGIN_PACKAGES=$KETTLE_PLUGIN_PACKAGES -DKETTLE_LOG_SIZE_LIMIT=$KETTLE_LOG_SIZE_LIMIT -DKETTLE_JNDI_ROOT=$KETTLE_JNDI_ROOT -Dpentaho.installed.licenses.file=$PENTAHO_INSTALLED_LICENSE_PATH"

Thanks in advance.

REST Client and MailUp

$
0
0
Anyone can help me with linking Mailup to Kettle with REST API?

Here is documentation about Mailup Rest API:

http://help.mailup.com/display/mailupapi/REST+API

I get the credentials registering the application

credentials.jpg

there are credential in the demo clients

$MAILUP_CLIENT_ID = "5a800771-0fb1-4763-977b-736a945f73cd";
$MAILUP_CLIENT_SECRET = "bfe2ec3c-acab-4149-9297-a5901e5b244e";


Now, with PHP demo client all it's ok. I do the login with platform username and password, I get a token as authorization and then I can make calls.

With kettle??

These are my settings:

1.jpg

2.jpg

3.png


Other all blank.

But I get this result:

Code:

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN""http://www.w3.org/TR/html4/strict.dtd">
<HTML><HEAD><TITLE>Bad Request</TITLE>
<META HTTP-EQUIV="Content-Type" Content="text/html; charset=us-ascii"></HEAD>
<BODY><h2>Bad Request - Invalid Header</h2>
<hr><p>HTTP Error 400. The request has an invalid header name.</p>
</BODY></HTML>


It's a problem of authorization? I read about user defined java class, but I'm not so able with Java! Maybe I can get a piece directly from the demo client java?
http://help.mailup.com/display/mailu...s+and+Wrappers


Thank you
Attached Images

S3 File Output Giving Error

$
0
0
Hello All,
While trying to browse the S3 bucket in S3 File Output step , its giving the below error. Does this error mean my AWS keys are wrong ?

My transformation executes a Table Input step and then hops to the S3 File Output step .
i.e Read from table and load into S3 bucket .

Also when I run this transformation , it finishes successfully with log message of some rows written but the file is not present in S3 bucket .

com.amazonaws.AmazonClientException: Unable to execute HTTP request: Connection refused: connect
at com.amazonaws.http.HttpClient.execute(HttpClient.java:207)
at com.amazonaws.services.s3.AmazonS3Client.getS3AccountOwner(AmazonS3Client.java:400)
at org.pentaho.amazon.s3.S3VfsFileChooserDialog$3.widgetSelected(S3VfsFileChooserDialog.java:238)
at org.eclipse.swt.widgets.TypedListener.handleEvent(Unknown Source)
at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)
at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)
at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source)
at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)
at org.pentaho.vfs.ui.VfsFileChooserDialog.open(VfsFileChooserDialog.java:476)
at org.pentaho.di.ui.vfs.VfsFileChooserHelper.browse(VfsFileChooserHelper.java:117)
at org.pentaho.di.ui.vfs.VfsFileChooserHelper.browse(VfsFileChooserHelper.java:97)
at org.pentaho.amazon.s3.S3FileOutputDialog$27.widgetSelected(S3FileOutputDialog.java:1164)
at org.eclipse.swt.widgets.TypedListener.handleEvent(Unknown Source)
at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)
at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)
at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source)
at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)
at org.pentaho.amazon.s3.S3FileOutputDialog.open(S3FileOutputDialog.java:1216)
at org.pentaho.di.ui.spoon.delegates.SpoonStepsDelegate.editStep(SpoonStepsDelegate.java:125)
at org.pentaho.di.ui.spoon.Spoon.editStep(Spoon.java:8783)
at org.pentaho.di.ui.spoon.trans.TransGraph.editStep(TransGraph.java:3072)
at org.pentaho.di.ui.spoon.trans.TransGraph.mouseDoubleClick(TransGraph.java:755)
at org.eclipse.swt.widgets.TypedListener.handleEvent(Unknown Source)
at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)
at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)
at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source)
at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)
at org.pentaho.di.ui.spoon.Spoon.readAndDispatch(Spoon.java:1347)
at org.pentaho.di.ui.spoon.Spoon.waitForDispose(Spoon.java:7989)
at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:9269)
at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:662)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.pentaho.commons.launcher.Launcher.main(Launcher.java:92)
Caused by: java.net.ConnectException: Connection refused: connect
at java.net.DualStackPlainSocketImpl.waitForConnect(Native Method)
at java.net.DualStackPlainSocketImpl.socketConnect(DualStackPlainSocketImpl.java:85)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:345)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:172)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:589)
at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:656)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.commons.httpclient.protocol.ReflectionSocketFactory.createSocket(ReflectionSocketFactory.java:140)
at org.apache.commons.httpclient.protocol.SSLProtocolSocketFactory.createSocket(SSLProtocolSocketFactory.java:130)
at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707)
at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionManager.java:1361)
at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387)
at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)
at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)
at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)
at com.amazonaws.http.HttpClient.execute(HttpClient.java:173)
... 35 more

Improve data value display

Pentaho INSERT/UPDATES and spaces

$
0
0
Could be possible that the step INSERT/UPDATES inserts an extra space? Just because i'm trying to fill a Fact table and Pentaho is saying that the key does not correspond to any of the keys in the DIM table (BUT it does exists!).
But in the error message pentaho writes: " The key ((C,G) ) is not in the table "dt_table" " Pentaho adds an extra space? How could it be possible?

JSON Input ignore missing path issue - 6.1

$
0
0
Hi,

Just trying to test my jobs after upgrading to 6.1 - I exported MySQL DB repo from 6.0 and imported into 6.1.

For JSON input, I have 'Ignore missing path' checked.

[{
"self": "https:\/\/reputation.atlassian.net\/rest\/api\/2\/component\/14100",
"id": "14100",
"name": "Ratings & Reviews"
}, {
"self": "https:\/\/reputation.atlassian.net\/rest\/api\/2\/component\/13207",
"id": "13207",
"name": "Request Reviews & Alerts"
"description": "Review component"
}]

My defn :-

json_input.JPG

in 6.0 it work fine but in 6.1 it fails with uneven json error. The description is optional.

Is this a known issue? Googling did not help and I have read that the JSON step has been improved for 6.1 but seems to have broken other functionality too!

Any ideas?

Thanks
Attached Images

non-tech users -- best way to get their data into a database? web-based forms? Excel?

$
0
0
I have an issue I've been racking my brain over.

We have a large BI tool, but management wants phone quality scores uploaded into the tool as well.

Currently, these are managed by Excel spreadsheets. All the scores for say 20 items are added by hand. A QA analyst listens to a phone call, marks the scores in Excel for a customer service employee, and that's that.

Now I'd like to avoid developing a custom application - but has anyone else had a similar problem?

I mean the quick + dirty way of getting this data from Excel to database is simply Pentaho PDI, but there are two problems - one, the Excel sheet needs to be formatted properly, and the data needs to be validated, and there needs to be a stable, central location to save this spreadsheet every time with the same, or correct, name. Lots of problems, and non-validated data won't get instant feedback. Even if the Excel sheet had validation in place (more risk) -- some validation is impossible from Excel alone. Say, a list of current employees, that is being constantly updated month to month.

Ideally, there would be some application that directly interacts with our database and validates. Our BI tool, BOARD BI (didn't choose) - has data entry features, but many limitations.

I'm wondering if anyone else here has solved a similar problem. Was there a simple program/ software/ tool, that, out of the box, allowed non-technical users to essentially submit forms or data that interfaced directly with a database? I feel like developing this application and maintaining it myself would be too much a burden, for a surprisingly common problem.

I may try MS Access (because our backend is MS SQL Server) - but I'm unsure if this directly reads/ writes to a SQL Server database easily. It also requires local software downloads to everyone using it, vs. a web-based solution. Mmmm.

There's also the possibility of using something like SurveyMonkey, and querying the API, but SurveyMonkey wasn't designed for a single user to input 60 scorecards a month -- it's very laborious. If only there was some kind of SurveyMonkey designed for easy data entry ... just wondering if anyone here has experience in this area, will continue to research myself -

Moving from PDI Pentaho Enterprise Edition to Penthao Community Edition

$
0
0
We are planning to move our PDI from Pentaho Enterprise Edition to Pentaho Community Edition
We are on Windows/Pentaho EE 6.1 and ideally want to move to Pentaho CE 6.1

Did anyone moved from EE to CE in your companies.

Major difference is I cannot use Pentaho Repository, Scheduler, version control in CE etc.

What are the other challenges ?

Are you successful in moving from EE to CE ?

Did you ran into any issues or decided to go back to EE and why ?

How do you manage version control....use Git Hub or any better recommendation ?

We can schedule job in Windows Task Scheduler or Unix corn job...any better alternatives?

How do you work around with the code from DEV, QA and PROD

Any other inputs other than above for a smooth move from EE to CE is appreciated

Thanks much in advance for your time and help in this regard !!

Executing the same metadata injection sceleton at the same time

$
0
0
Hey together,

I have some problems with metadata injection and runtime variables.

My steps:
  1. I run a query, which give me some IDs, for example the result will have 3 rows, with 3 different IDs.
  2. The next query return some metadata information for each ID (diffenrent target tables ...)
  3. The metadata injection sceleton get the SQL and target table and start the run.


But sometimes the query with ID3 is faster than the ID1, and then Pentaho set the wrong workflow as "Finished", or worse case: the wrong workflow is marked as canceled/error.
I tried many ways, but I can't find the right one, to handle the IDs stable within the workflow. :(

I hope someone of you have an idea or hint for me, thank you.

ScreenShot00001.jpg


Regards,
Florian
Attached Images
Attached Files

Response Time in HTTP Client

$
0
0
Hello,

Is there a way to put a time delay within HTTP client step to take into account the response time of some websites that load pretty slow?

What happens is that the html result I get lacks the data that I need because the webste is still loading by the time the html is being scraped.

Any thoughts?


Thank you.

how to set a variable and eixt transformation?

$
0
0
hi


I have two question:

1. I hava a excel file , I would like to get a cell value and to set it to a variable in a transformation , how can I to this ?

2. How to exit(terminate) current transformation when I got a specific value ?


any ideas? thanks.

How to zip a folder on a daily basis?

$
0
0
Hello everyone,
I have a folder named '2016' in that there are other folders name followed by month number and in particular month i have other folders name followed by day no.
Now i want to zip a folder with current date i.e (E:\2016\9\26) and so on.
How can i do that?

Thanks

Kettle Logging

$
0
0
Hello,

I use the kettle logging properties and set the next properties:
KETTLE_JOB_LOG_TABLE = etl_log_job
KETTLE_TRANS_LOG_TABLE = etl_log_transformation
KETTLE_STEP_LOG_TABLE = etl_log_transformation_step
KETTLE_TRANS_PERFORMANCE_LOG_TABLE = etl_log_transformation_step_performance.

Now I want to be able to interpret the data in the tables, but I can not figure out the interrelationship.

Ultimately, I'm looking for an opportunity to discover the lead time for each step in a transformation.

Someone a solution??

Database Value Lookup

$
0
0
Within a few transformations, I use database lookups value.

The transformations are designed very generically, so that the transformation can be used at multiple tables. I will use simple views for lookup and insert.
So I have a lookup view and an updated view on the same table.

Within the Database Value Lookup so I use the view and have caching and "Load all data from table" checked.

At the time I am 10 million records loading, the lookup takes very long.
It also takes a lot of memory and at the end we running out of memory.

What could I do to improve the Lookup?

Is there a possibility to do a push-down direction of the database?
Allowing the lookup in the database is done and not running out of memory?
Viewing all 16689 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>