Quantcast
Channel: Pentaho Community Forums
Viewing all 16689 articles
Browse latest View live
↧

Transformation Executor for Code Reuse

October 6, 2016, 10:08 am
$
0
0
Hello, I am new Pentaho so please bear with me...

I want to create a reusable transformation. It is simply to create a standard header row that is required on all our text files. My team can then pull this and integrate into their various file generation ETLs. I got this part working with parameters. (generate_file_header.ktr)

Now, the issue that I am facing is how do I use this transformation called from another transformation? I create another simple transformation that is just a Transformation Executor. (run_transform_sample.ktr) However, I get nothing out of it when I run or preview it. What I am doing wrong, missing, or misunderstanding?
Attached Files
↧
Search

How to separate data when I hit a new value?

October 6, 2016, 12:54 pm
$
0
0
Hi! I've done some looking around online and in the docs and I'm still not sure where to start. I don't need a comprehensive solution, just a point in the right direction.

Broadly speaking, I have "transcript" data on lots of classes (think columns for class title, date, student name, student number, so forth). I do some manipulation of this data in PDI and then will pass to Report Designer for formatting.

The end goal is to create sign-in sheets for each classroom. So I will have to sort by the class instance unique ID, and then basically I want a page break each time a new class starts. - so all the students in a given class are listed until it hits a new class, then insert page break and start listing students with the new class, so forth. See my (pitiful :() drawing below.

I'm not sure if I pass the whole data set to RD and do something with dynamic page breaks there, or chunk up the data in PDI and send it through a RD output step one by one. Ideally this is one long PDF or something, rather than lots of little ones. They will be printed out.

Thank you!
Attached Images
↧
↧

How to populate rows of data that are grouped in XLS (first row has fields for group)

October 6, 2016, 5:54 pm
$
0
0
All -

I am reading in an XLS which had grouping of data. I would like to take a few fields that are populate in the first row to other rows in the group. I think it maybe clearer if I show an example:

ApplicationName,ApplicationID,Server,OS

App1,1,server1,windows
,,server2,windows
,,server3,linux
,,server4,linux
App2,2,server5,linux
,,server6,windows
App3,3,server6,windows

I would like to populate the null values (ApplicationName,ApplicationID) with values from the first row in the group. So the desired result is:

App1,1,server1,windows
App1,1,server2,windows
App1,1,server3,linux
App1,1,server4,linux
App2,2,server5,linux
App2,2server6,windows
App3,3,server6,windows

Let me know how I can get this done. Thank you in advance.

Karlis
↧

Automatically deleting objects from solution repository?

October 7, 2016, 1:25 am
$
0
0
Hi All,

When scheduling DI jobs in the BI platform (5.4 CE) a single html report is written to the users home directory inside the solution repository for every job execution. These reports flood the tablespace for the jcr repository and we need to introduce some housekeeping to get rid of old reports. We have not found a way to prevent these reports from being written in the first place (actually we don't need them, the information is contained in the biserver log). But how to delete these objects automatically? We have found the "Call endpoint" step in Spoon that gives access to the content repository but as far as I can see the exposed operations are limited to reading, traversing the hierarchy or downloading objects. What am I missing? What is the proper way to delete objects from the jcr repository programmatically?


Thanks,
Markus
↧

Bypass the authentication via iFrame

October 7, 2016, 2:07 am
$
0
0
Hi,

I have embedded report using iFrame into my web application. on page load it asks for userid and password even though they are supplied as parameters.

localhost:8080/pentaho/api/repos/:reportName.prpt/report?id=13435&userid=admin&password=password&output-target=table/html;page-mode=stream&dashboard-mode=true

Is there any other way to bypass the authentication.
using pentaho version 6

Thanks,
Padma Priya N.
↧
↧

Pentaho freezes when adding more than 8 prompts to an interactive report

October 7, 2016, 4:33 am
$
0
0
I am trying to design reports with the interactive reporting module.

All works fine, unless I add a 9th prompt. Then, pentaho freezes completely.
All I can do it close the window.

When I go back to Pentaho, I am still logged in. I can go to the interactive reporting area
again and create a new report. However anytime I want to add a prompt,
it freezes again.

The only way of this that I found was restarting the server. It is not sufficient
to clear the caches and re-login.

Is there any other way out? It is hard to communicate to our customers that they
have to
a) use a maximum of 8 prompts and
b) if they forget the rule they have to contact their admin for restarting the server service...

Workarounds, Fixes?

Thank you!
↧

Group Data from Transformation and Save as a Document with an Array field in Mongo DB

October 7, 2016, 6:26 am
$
0
0
Hello,

I am having hard time to wrap my head around it...

So there is a transformation which returns data with a field which has repeating values. I need to group by that field and save the grouped items inside an Array field of the document in Mongo DB.

Included is transformation and screenshots of what is input and expected output. Could you please help?

Thanks in advance!
Attached Files
↧

Cannot drag into canvas

October 7, 2016, 10:00 am
$
0
0
Hi all,


I am using report designer in two different computers. In one of the all the items in the Data pane are appear like photo no.1 where I could not drag elements to the "details".
In other computer they appear normal (the yellow folders and stars below - photo 2). I thinks it is something in the computer configurations. Any one could help?
Attached Images
↧
Search

Embedding a Pentaho Report in Play Framework

October 7, 2016, 11:37 am
$
0
0
Dear All,

I have created small applicatino in Play Framework, Operating system is java.

I also have created sample report using Pentaho.

Now I want to preview Pentaho Report from Play Application.

How can we do it ?

Thanks and Regards,

Nirav
↧
↧

How do you delete/unpublish a Mondrian cube?

October 7, 2016, 1:33 pm
$
0
0
Hello all

Using Mondrian workbench I successfully published a cube and used it with Saiku (add-on to Pentaho CE 6 BI server). We no longer need the cube - and I don't see any way to delete it. Since content is in the JackRabbit repository there are no physical xml files to delete.

Can anyone help?

Many thanks
- rlm
↧

change value of parameter to use in SQL request

October 8, 2016, 9:26 am
$
0
0
Hi Forum!

I'm using CDE dashboard and have a SQL request using, in the where clause, the value of a parameter from a Select component.
But the values the parameter can have don't match the values in the DB.
The possible values of the parameter in the Select component are "dev", "non-dev"
But the possible values in the database are "system", "runtime", "application", "developmentPlatform", ...
So I'd like to "post-process" the selected value of the parameter to change it.

For instance, if the selected value is "non-dev", then, in the SQL request, "non-dev" should be replaced by (system, runtime, application).

Any idea?
↧

Weka tool

October 8, 2016, 10:22 am
$
0
0
Dear Mark,
I am really amazing of your weka tool. It is awesome. I have some doubts in the tool. It regrading preprocess step. Without preproceesing I got 85% accuracy after data.weka.filters.unsupervised.attributes.addid, my accuracy went by nearly cent. How it is possible?. What action actually takes place? Is it a correct process I follwed? I need it. Please respond on it. Thank you.
↧

JSON Input - Sorry, no rows for preview

October 8, 2016, 5:44 pm
$
0
0
I am trying to import a JSON file using Pentaho but I keep getting a "sorry, no rows to preview" error. I have valid JSON, what gives??

JSON snippet:
Code:
{"last_updated":1475973127,"ttl":10,"data":{"stations":[{"station_id":"72","name":"W 52 St & 11 Ave","short_name":"6926.01","lat":40.76727216,"lon":-73.99392888,"region_id":71,"rental_methods":["KEY","CREDITCARD"],"capacity":39,"eightd_has_key_dispenser":false},{"station_id":"79","name":"Franklin St & W Broadway","short_name":"5430.08","lat":40.71911552,"lon":-74.00666661,"region_id":71,"rental_methods":["KEY","CREDITCARD"],"capacity":33,"eightd_has_key_dispenser":false},{"station_id":"82","name":"St James Pl & Pearl St","short_name":"5167.06","lat":40.71117416,"lon":-74.00016545,"region_id":71,"rental_methods":["KEY","CREDITCARD"],"capacity":27,"eightd_has_key_dispenser":false},{"station_id":"83","name":"Atlantic Ave & Fort Greene Pl","short_name":"4354.07","lat":40.68382604,"lon":-73.97632328,"region_id":71,"rental_methods":["KEY","CREDITCARD"],"capacity":62,"eightd_has_key_dispenser":false},{"station_id":"116","name":"W 17 St & 8 Ave","short_name":"6148.02","lat":40.74177603,"lon":-74.00149746,"region_id":71,"rental_methods":["KEY","CREDITCARD"],"capacity":39,"eightd_has_key_dispenser":false},{"station_id":"119","name":"Park Ave & St Edwards St","short_name":"4700.06","lat":40.69608941,"lon":-73.97803415,"region_id":71,"rental_methods":["KEY","CREDITCARD"],"capacity":19,"eightd_has_key_dispenser":false},{"station_id":"120","name":"Lexington Ave & Classon Ave","short_name":"4452.03","lat":40.68676793,"lon":-73.95928168,"region_id":71,"rental_methods":["KEY","CREDITCARD"],"capacity":19,"eightd_has_key_dispenser":false},{"station_id":"127","name":"Barrow St & Hudson St","short_name":"5805.05","lat":40.73172428,"lon":-74.00674436,"region_id":71,"rental_methods":["KEY","CREDITCARD"],"capacity":31,"eightd_has_key_dispenser":false},{"station_id":"128","name":"MacDougal St & Prince St","short_name":"5687.04","lat":40.72710258,"lon":-74.00297088,"region_id":71,"rental_methods":["KEY","CREDITCARD"],"capacity":30,"eightd_has_key_dispenser":false},{"station_id":"137","name":"E 56 St & Madison Ave","short_name":"6771.02","lat":40.761628,"lon":-73.972924,"region_id":71,"rental_methods":["KEY","CREDITCARD"],"capacity":46,"eightd_has_key_dispenser":false},{"station_id":"143","name":"Clinton St & Joralemon St","short_name":"4605.04","lat":40.69239502,"lon":-73.99337909,"region_id":71,"rental_methods":["KEY","CREDITCARD"],"capacity":24,"eightd_has_key_dispenser":false},{"station_id":"144","name":"Nassau St & Navy St","short_name":"4812.02","lat":40.69839895,"lon":-73.98068914,"region_id":71,"rental_methods":["KEY","CREDITCARD"],"capacity":19,"eightd_has_key_dispenser":false},{"station_id":"146","name":"Hudson St & Reade St","short_name":"5359.10","lat":40.71625008,"lon":-74.0091059,"region_id":71,"rental_methods":["KEY","CREDITCARD"],"capacity":39,"eightd_has_key_dispenser":false},{"station_id":"147","name":"Greenwich St & Warren St","short_name":"5329.01","lat":40.71542197,"lon":-74.01121978,"region_id":71,"rental_methods":["KEY","CREDITCARD"],"capacity":33,"eightd_has_key_dispenser":false},{"station_id":"150","name":"E 2 St & Avenue C","short_name":"5476.03","lat":40.7208736,"lon":-73.98085795,"region_id":71,"rental_methods":["KEY","CREDITCARD"],"capacity":31,"eightd_has_key_dispenser":false},{"station_id":"151","name":"Cleveland Pl & Spring St","short_name":"5492.05","lat":40.722103786686034,"lon":-73.99724900722504,"region_id":71,"rental_methods":["KEY","CREDITCARD"],"capacity":33,"eightd_has_key_dispenser":false},{"station_id":"152","name":"Warren St & Church St","short_name":"5288.09","lat":40.71473993,"lon":-74.00910627,"region_id":71,"rental_methods":["KEY","CREDITCARD"],"capacity":29,"eightd_has_key_dispenser":false},{"station_id":"153","name":"E 40 St & 5 Ave","short_name":"6474.11","lat":40.752062307,"lon":-73.9816324043,"region_id":71,"rental_methods":["KEY","CREDITCARD"],"capacity":55,"eightd_has_key_dispenser":false},{"station_id":"157","name":"Henry St & Atlantic Ave","short_name":"4531.05","lat":40.69089272,"lon":-73.99612349,"region_id":71,"rental_methods":["KEY","CREDITCARD"],"capacity":23,"eightd_has_key_dispenser":false}]}}
↧
↧

why the r_log table is empty ?

October 9, 2016, 2:22 am
$
0
0
hi:



why the r_log table is empty ? is it normal or do i miss something ?


thanks!
↧

Enterprise Spoon for Deploy to Production

October 9, 2016, 2:32 pm
$
0
0
Hi,

The Pentaho architecture is somewhat confusing. We have set up an ETL server for our production ETL. This is the Enterprise edition. The way the team are working however is to run Spoon from their desktops for Dev and Testing then deploy to Production. However we can't afford to buy Enterprise for every developers desktop and it's not feasible for them to all log onto the Linux Enterprise Pentaho server and run spoon from there.

So they are developing in Community and deploying to production, this doesn't allow them to develop using Enterprise features (like checkpoints).

Do you offer Developers the ability to run Enterprise for these purposes on their Desktop?

Thanks,
Anthony
↧
Search

How to upgrade POI libraries in Kettle

October 9, 2016, 7:33 pm
$
0
0
We are using Kettle 5.0.1 which included the POI 3.9 libraries. Is that possible to upgrade the POI to 3.15 by just replacing the jar files? Any issues?
↧

Mongo DB update ModifiedOn field of a document by id

October 10, 2016, 9:06 am
$
0
0
Hi,

I have a collection of documents. Each of the document has a field called ModifiedOn which is last time it was modified.

I use System Info step to get all the necessary information. The problem is that I don'k know how to update ONLY ONE document based on Id. Not all documents in the collection.

Thank you
↧
↧

Export complete table dataset to Excel with pagination server side

October 11, 2016, 1:56 am
$
0
0
Hello community!

I've been looking for a solution to export a whole datasource to excel when using a Table component using pagination server side. I didn't find any solution online so i thought i could share my solution:

Using the Export Button Button Component I added a parameter to the component, "exportAll = true". Then in post execution:

Post execution:
Code:
function hijackQueryComp(comp) {
        /* Save old function */
        var oldBuildQueryDefinition = comp.buildQueryDefinition;
            /* Overwrite BuildQueryDefinition without serverside pagination*/
        comp.buildQueryDefinition = function(overrides) {
            var qd = oldBuildQueryDefinition.call(comp, overrides);
            /* This condition evaluates if the query request was performed by the export button or by some other component*/
            if (overrides && overrides.exportAll === 'true') {
                delete qd.pageSize;
                delete qd.pageStart;
            }
           
            return qd;
        };
    }


    var comp = Dashboards.getComponentByName('render_' + this.componentName);
    hijackQueryComp(comp['query']);
    hijackQueryComp(comp['queryState']);

What this piece of code does is hijack the buildQueryDefinition function and erase pageSize and pageStart definitions to trick the server into sending all the data without pagination.

Hope you enjoyed this solution.

Best regards
↧

Explicit Filter

October 11, 2016, 3:47 am
$
0
0
I'm currently looking to implement an explicit filter - where if one value is selected from a dimension then another value is selected. Can this be achieved in Analysis Services?
↧

SQL Script and Insert/Update Steps

October 11, 2016, 6:20 am
$
0
0
I have been trying to use the SQL Script step and the insert update step for a long time and still cannot figure out why these steps are stopping my transformations from running. I can query from the same table using the table input steps no problem. But when I try to run a script or insert/update anything these steps do not work, in fact they keep the transformation from starting. When I remove those steps they suddenly start working.

When I run these queries in SQL developer they work no problem. I have triple checked the connections and user names, permissions, etc. Everything seems to be ok but Pentaho does not want to run any scripts or update/inserts. I had a DBA verify my user permissions and still does not work. I made a separate transformation that generates rows and runs a script, nothing!

In the log I see the following:

2016/10/11 09:13:41 - Spoon - Transformation opened.
2016/10/11 09:13:41 - Spoon - Launching transformation [TEST]...
2016/10/11 09:13:41 - Spoon - Started the transformation execution.
2016/10/11 09:13:41 - TEST - Dispatching started for transformation [TEST]

After that nothing, no errors, no green check marks, even the stop button is grayed out and I can run the transformation again. But again with no results or errors.

Here is the detailed log:
2016/10/11 09:19:55 - TEST - Transformation is pre-loaded.
2016/10/11 09:19:55 - TEST - nr of steps to run : 2 , nr of hops : 1
2016/10/11 09:19:55 - Spoon - Transformation opened.
2016/10/11 09:19:55 - Spoon - Launching transformation [TEST]...
2016/10/11 09:19:55 - Spoon - Started the transformation execution.
2016/10/11 09:19:55 - TEST - Dispatching started for transformation [TEST]
2016/10/11 09:19:55 - TEST - Nr of arguments detected:0
2016/10/11 09:19:55 - TEST - This is not a replay transformation
2016/10/11 09:19:55 - TEST - I found 2 different steps to launch.
2016/10/11 09:19:55 - TEST - Allocating rowsets...
2016/10/11 09:19:55 - TEST - Allocating rowsets for step 0 --> Generate Rows
2016/10/11 09:19:55 - TEST - prevcopies = 1, nextcopies=1
2016/10/11 09:19:55 - TEST - Transformation allocated new rowset [Generate Rows.0 - Execute SQL script.0]
2016/10/11 09:19:55 - TEST - Allocated 1 rowsets for step 0 --> Generate Rows
2016/10/11 09:19:55 - TEST - Allocating rowsets for step 1 --> Execute SQL script
2016/10/11 09:19:55 - TEST - Allocated 1 rowsets for step 1 --> Execute SQL script
2016/10/11 09:19:55 - TEST - Allocating Steps & StepData...
2016/10/11 09:19:55 - TEST - Transformation is about to allocate step [Generate Rows] of type [RowGenerator]
2016/10/11 09:19:55 - TEST - Step has nrcopies=1
2016/10/11 09:19:55 - Generate Rows.0 - distribution activated
2016/10/11 09:19:55 - Generate Rows.0 - Starting allocation of buffers & new threads...
2016/10/11 09:19:55 - Generate Rows.0 - Step info: nrinput=0 nroutput=1
2016/10/11 09:19:55 - Generate Rows.0 - output rel. is 1:1
2016/10/11 09:19:55 - Generate Rows.0 - Found output rowset [Generate Rows.0 - Execute SQL script.0]
2016/10/11 09:19:55 - Generate Rows.0 - Finished dispatching
2016/10/11 09:19:55 - TEST - Transformation has allocated a new step: [Generate Rows].0
2016/10/11 09:19:55 - TEST - Transformation is about to allocate step [Execute SQL script] of type [ExecSQL]
2016/10/11 09:19:55 - TEST - Step has nrcopies=1
2016/10/11 09:19:55 - Execute SQL script.0 - distribution activated
2016/10/11 09:19:55 - Execute SQL script.0 - Starting allocation of buffers & new threads...
2016/10/11 09:19:55 - Execute SQL script.0 - Step info: nrinput=1 nroutput=0
2016/10/11 09:19:55 - Execute SQL script.0 - Got previous step from [Execute SQL script] #0 --> Generate Rows
2016/10/11 09:19:55 - Execute SQL script.0 - input rel is 1:1
2016/10/11 09:19:55 - Execute SQL script.0 - Found input rowset [Generate Rows.0 - Execute SQL script.0]
2016/10/11 09:19:55 - Execute SQL script.0 - Finished dispatching
2016/10/11 09:19:55 - TEST - Transformation has allocated a new step: [Execute SQL script].0
2016/10/11 09:19:55 - TEST - This transformation can be replayed with replay date: 2016/10/11 09:19:55
2016/10/11 09:19:55 - TEST - Initialising 2 steps...
2016/10/11 09:19:55 - Generate Rows.0 - Released server socket on port 0
2016/10/11 09:19:55 - Execute SQL script.0 - Released server socket on port 0
2016/10/11 09:19:55 - MSE - New database connection defined
2016/10/11 09:19:55 - Execute SQL script.0 - Connected to database...
2016/10/11 09:19:55 - MSE - launch DDL statement:
2016/10/11 09:19:55 - MSE - UPDATE [Redacted] SET INDATE = SYSDATE WHERE INDATE IS NULL


Can someone please help me here? This has been driving me crazy for weeks! Thanks for your help!
↧
Viewing all 16689 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>