Quantcast
Channel: Pentaho Community Forums
Viewing all 16689 articles
Browse latest View live
↧

Real time chart plotting in angular directive.

November 10, 2016, 11:12 am
$
0
0
Hello All,

I was able to plot chart in angular using derivatives. But I have some issue. I would like to get your support on below.
1. Chart is plotted in a box rather it is not flowing/continuing, I want to show latest 10 sec or some frame, old data can be scrolled and view . How achieve this .
2. I want to plot graph come from right hand side to left, Is it possible.
3. Is zoom possible [http://bl.ocks.org/diethardsteiner/9...e6c67469b3f00]

http://jsfiddle.net/abelutt16/xzq85q8d/2/

Thanks for your consideration and support.
↧
Search

How to Get EMail Attachments

November 10, 2016, 11:15 am
$
0
0
we are able to get emails and attachments.

Could you please share the details how to connect to email server to read emails with attachment. I am trying to connect to email server but getting error message,

---------------------------
Error
---------------------------
Can not connected to Source Host


Error while connecting to host [Source Host Name] with username [] on port [-1].


Connect failed




---------------------------
OK
---------------------------
↧
↧

Executing R Script - Marketplace plugin not working as expected.

November 10, 2016, 4:44 pm
$
0
0
I was hoping someone could help me. I've looked throughout the forum the best I could, but I haven't find an answer.

I created an R Script name "Test.R" that loads data from MySQL, does some calculations and then passes that table back to MySQL. I've tested this script in R and run through a .bat on the cmd prompt and both work.

As part of a larger data processing sequence I want to use Kettle to call "Test.R" and run it through R. However, the plugin that is available from the marketplace is not letting me do this, it shows the script was run, but nothing happens. I was able to get the example from http://dekarlab.de/wp/?p=5 to work properly.

Could someone help me? Either I am using this plugin wrong, or its not possible. If thats the case, how can i simply call my .bat file to run from kettle?

Thanks in advance!
↧

spoon run options

November 10, 2016, 5:29 pm
$
0
0
When you run a job / transformation from spoon, the run options dialogue appears. I want to change the default behavior to use detailed for log level instead of basic. Where is the setting for that? I always have to change it every time I run something.
↧

Identifying bottlenecks in PDI

November 10, 2016, 10:00 pm
$
0
0
Hello everyone,
I am having a transformation with almost 2,00,000 rows as an input source.
Under the Step Metrics tab, there is an Input/Output property which helps to identify the slowest and fastest step.
Can someone tell me whether this property shows SLEEP TIME or No. of Input/Output buffer rows?
And if i get Input/Output as 530/610, what does it exactly mean?

Note: I have already looked the official page of pentaho http://wiki.pentaho.com/display/EAI/.14+Logging, but was unable to understand.

Thank You in advance!!!
↧
↧

DBLookup for multiple languages(Japan and telugu)

November 10, 2016, 10:41 pm
$
0
0
Hi,

As I am trying to use CSV file input and getting the content(english,telugu and Japanese) in utf-8 format.And making connection with mysql in AWS and getting the result when i used engish content for table column its matching and getting the content correctly but when i used the other content its not giving result if the record exist for the japan and telugu.

Please kindly help me on how to get the results from DB.As i got stuck couldn't able to move further.Please help me.

Also if i am trying to get the Japanese and telugu content its showing in special characters.Please check the screenshot.block.jpg

Thanks,
Sudhakar
Attached Images
↧

Java NullPointerException when creating a second repository

November 11, 2016, 4:49 am
$
0
0
Hello,

Using PDI 3.2.5 (I know it's out of date).

I want to create a second repository. I clicked on the New button at the connection window and created a new database connection which should contain my repository. Testing the database connection worked (test button said it was o.k.).

But know when I try to login with admin/admin the following error is thrown:

java.lang.NullPointerException
at org.pentaho.di.core.database.Database.initializeVariablesFrom(Database.java:4590)
at org.pentaho.di.repository.Repository.connect(Repository.java:626)
at org.pentaho.di.repository.Repository.connect(Repository.java:608)
at org.pentaho.di.ui.repository.dialog.RepositoriesDialog.ok(RepositoriesDialog.java:505)
at org.pentaho.di.ui.repository.dialog.RepositoriesDialog.access$900(RepositoriesDialog.java:73)
at org.pentaho.di.ui.repository.dialog.RepositoriesDialog$11.widgetDefaultSelected(RepositoriesDialog.java:378)
at org.eclipse.swt.widgets.TypedListener.handleEvent(Unknown Source)
at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)
at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)
at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source)
at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)
at org.pentaho.di.ui.repository.dialog.RepositoriesDialog.open(RepositoriesDialog.java:427)
at org.pentaho.di.ui.spoon.Spoon.openRepositoryDialog(Spoon.java:5361)
at org.pentaho.di.ui.spoon.Spoon.selectRep(Spoon.java:5418)
at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:5548)
at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:412)

I can normally login into my already existing repository.

Can somebody help?

Best regards.
↧

Table Component with dyanamic number of columns in result set

November 11, 2016, 6:20 am
$
0
0
Hi,

I have a query which PIVOTs some data and as a result will return a varying number of columns dependent upon the parameter selection.

The table component works fine on the first run, but it will not update to include any additional columns if the resultset includes ore columns on the second run than the first.

Is there a way to reload the whole component so that it will pick up the new columns?

Thanks!
↧
Search

Report Designer query data from HTTP Post rather than database

November 11, 2016, 7:22 am
$
0
0
Is it possible for PRD to query it's data using a HTTP POST request rather than querying the data via a jdbc / jndi database source ?

The data would be returned in either XML or JSON format.

Another alternative would be a jdbc driver that makes a POST request rather than connecting to the database directly, but having googled this there does not appear to be any jdbc driver that is able to do this ?
↧
↧

allow non-PDI users to trigger ETL process?

November 11, 2016, 10:14 am
$
0
0
Perhaps this is beyond the scope of PDI, but I was wondering.

The goal is to have users place an Excel file in a shared folder, and have PDI regularly upload that.
Now of course I can set up PDI to check the folder every hour, or every 30 minutes, etc and attempt to upload to our BI database.

But I'm also thinking of a way to have an instant-upload, or user-triggered upload ideally. Though I'm not sure the best way to do this.


Currently, my thought process is to have a Windows Powershell script on our ETL server monitor an "upload" folder for new files, and when found, trigger the PDI Job via a bat file.

The near-instant response is useful because each Excel row gets returned with an upload status (data is validated against a database). Still, if a user had a specific method to trigger an upload. Hmm. Not sure, just wondering how common this is.

I'm still wondering if this is the best method though, or if there is some other mechanism that can be used. Just farming for ideas I suppose.
↧

metadata-injection null value failure

November 11, 2016, 10:26 am
$
0
0
I am attempting to create a metdata driven etl job that reads from an oracle database and writes to a postgres database with table and attribute names the same on each database.

I have elected to use the database's metadata tables (oracle=all_tab_cols, postgres=information_schema.columns).

When "porting" oracle date and timestamp data types I need to run those attributes thru a "select value" step to format the date properly so the postgres bulkLoader works.
I have a working copy with an "output table" as the target and the data lands ("select values" step not necessary), some of my tables are large and I was hoping to use the bulkLoader.

My issue is that when an oracle table does not have a date/timestamp attribute, my metadata-injection step fails with null values feeding the "select values" metadata attributes.

attached are the screenshots of my ktr's. (let me know if attaching the actual ktr's would be better).

Also, please advise if this methodolgy does not make sense or there's a more elegant solution!

metadata.jpgmetadata_tmplt.PNG
Attached Images
↧

BIserver-ce is very very slow, takes lot of time to load.

November 11, 2016, 10:40 am
$
0
0
Hi guys :o,
I am new using pentaho BI, and i have a problem.
I have installed biserver-ce 6.1, but when configure connection with some data base it takes time to load is very very slow, the same thing happens when i want to configure a saiku report.

Does someone know why this happens?:confused:

I hope can you help me please.
Thanks.
↧

Oracle Table Input Step - Very Slow

November 11, 2016, 1:53 pm
$
0
0
Hi,

I have a very simple transformation (select * from some_table) and this table has some fields with one of them being a clob.
If I ran the same query in SQL Developer it takes less than a second to fetch 30k rows.
But in the transformation it runs at 1k / sec. I already put a parameter "defaultRowPrefetch" to several numbers, increased the number of rows in memory but the ready still doesn't improve.
I'm using PDI 6.1 and ojdbc7.jar.

What can I do to improve this?

Thanks in advance.

Petterson
↧
↧

Can 2 PDI jobs run at the same time via kitchen.bat?

November 11, 2016, 2:03 pm
$
0
0
I have scheduled jobs that run sequentially at midnight or 3 am or some odd hours.


I'm just wondering -- if I have an 'on-demand' ETL job that runs as needed (say a new Excel file is added to an upload folder) -- on the rare possibility this occurs at midnight where 15 minutes worth of jobs are running, what happens?

Can two PDI jobs run at the same time, or will this cause an error? I suppose I can test this myself, but just wondering if someone knows off hand.
↧

Auto Documentation in PDI CE 6.1

November 12, 2016, 4:25 am
$
0
0
Hi All,

I have around 500 jobs calling many transformations. Now, I want to document the entire flow of my ETL. For a particular transformation, I need to capture source table name, step names that are used in between and destination table name.
I looked at 'Automatic Documentation Output' step and it is not giving the expected result. It just provides transformation name and its snapshot etc. I also looked at http://wiki.pentaho.com/display/EAI/...ttle)+Projects but could not get it running successfully.
Can someone please help me understand how can I document entire ETL flow? Or can someone suggest any other approach of auto documenting the flow ?

TIA,
Sanket
↧
Search

Issue in running sub transformation on DI server

November 12, 2016, 6:30 pm
$
0
0
Hi All,

I am having issues while running job on DI server. It's unable to find sub transformation at specified file path.

1) After connecting to DI repository, when I run job from 'Action-Schedule-Run now' it runs successfully (I am not sure if it runs locally of on server).
2) But when I directly click on run and select server option (instead of local), it gives me below error.

Caused by: java.io.FileNotFoundException: /public/features/shared/trans/tr_shared_get_meds_elearning_etl_runtime.ktr (No such file or directory).


Please help.
↧

Where can I find the differences between commercial and community editions of PDI?

November 13, 2016, 7:31 am
$
0
0
Hi all,

I just downloaded the new PDI version 7.0, but I haven't found a way to make graphs from the steeps in a transformation, (one of the new features in 7.0).

Is this feature only available in the commercial/paid version?

And more in general:

Where Can I find some documentation between the differences between the commercial and the community edition of Pentaho 7.0?
Specially for PDI.


Thanks in advance.


J.
↧
↧

Pentaho Community Meetup 2016 recap

November 13, 2016, 11:51 am
$
0
0
Dear friends,
I just came back from PCM16, the 9th annual edition of our European Pentaho Community Meetup.  We had close to 200 subscriptions for this event of which about 150 showed up making this the biggest so far.  Even though veterans of the conference like myself really appreciate the warmth in previous locations like Barcelona and Cascais, I have to admit we did get a great venue in Antwerp this year with 2 large rooms, great catering, top notch audiovisual support in a nice part in the city center. (Free high speed Antwerp city WiFi, Yeah!)
Content-wise everything was more than OK with back-to-back presentation on a large variety of subjects and I’m happy to say lots of Kettle related stuff as well.
For an in depth recap of the content you can see here for the technical track and here for the other sessions.
Personally I was touched by the incredibly positive response from the audience after my presentation on the state of the PDI unit testing project.  However, the big bomb was dropped when Hiromu Hota from Hitachi Reseach America started to present a new “WebSpoon” project.  You could almost hear everyone think: “Oh no, not another attempt at making a new Kettle web interface”.  However, 2 minutes into the presentation everyone in the audience started to realize that it was the real, original Spoon with all the functionality it has, ported 1:1 to a web browser on your laptop, thin device, phone or tablet. Applause spontaneously erupted, twitter exploded and people couldn’t stop talking about about it until I left the PCM crowd a day later.  Now I’m obviously very happy we managed to keep the WebSpoon project a secret for the past few months and it’s impossible to thank Hota-san enough for traveling all the way to present at our event this weekend.
My heartfelt thanks also go out to Bart Maertens and the whole know.bi crew for making PCM16 a wonderful experience and an unforgettable event!
See you all at PCM17!
Matt


More...
↧

Facebook and Pentaho data integration

November 13, 2016, 9:05 pm
$
0
0
Hi,


I have created a transformation to read data from facebook. In my case I just used access token and HTTP client to get the feeds.
But I can only read posts of mine and not by others.

I used below reference video.

https://www.youtube.com/watch?v=tRjBLJRwqsc

Anybody tried it before to read feeds by others for any kind of analysis using PDI ?? Please provide any useful info.


Thanks in advance.



Regards
KP.
↧

Date Picker parameter

November 14, 2016, 12:52 am
↧
Viewing all 16689 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>