Quantcast
Channel: Pentaho Community Forums
Viewing all 16689 articles
Browse latest View live

A new Pentaho Library on the community site


Eliminate non-numeric fields in a string.

$
0
0
Hi All,

I have a column QUANTITY in table DETAILS where it has values like 123.aa, 233.00, 0456, 983* and so on.

I want the values to be like 123,233,456,983 eliminating all the special characters and alphabets other than the numeric values.

How to achieve this ?? Using pentaho 5.2 version and mysql as a database.

Hope this is clear enough.

Thanks
Chinmaya

problem in Authentification page

$
0
0
Hello ;

sometimes i lose the CSS and JS files from the authentification page as shown in this [ATTACH]image[/ATTACH] , and there are no specific information from log of tomcat , any ideas to skip this.
Attached Images

How to avoid a JDBC autocommit?

$
0
0
When filling tables with lots of data it is sometimes helpful to switch of the transactional logging to avoid exploding Transaction-Log-Files (like this is done when doing a DB-Load).
On DB2 this is done with the command
Code:

alter table <tablename> activate not logged initially
. The transaction log will be switched off for the current transaction, so normally until the next commit or rollback.

When doing this with SQuirreL or SQL Workbench this works fine. I send something like
Code:

alter table <tablename> activate not logged initially;
insert into <tablename> (select * from <somewhere>);
commit;

And while the 'Insert into' runs I check the utilization of the transaction log with
Code:

select * from SYSIBMADM.LOG_UTILIZATION
and see, that this stands below 1%.

Doing the same in a Kettle ‘Execute SQL’-Step (either in a Job or a Transformation) let the utilization rise up permanently while the ‘insert into’ runs.:confused:
Here my test job
autocommit_test.kjb

I already tried to set up the connection with Connection Pooling and set ‘defaultAutoCommit=false’. I tried to set the parameter ‘AutoCommit=false’ in the Option panel which throws errors when Connection Pooling is not enabled but has no effect.

In the JDBC-Trace (traceLevel=35) I see several setAutoCommit()-calls and each setAutoCommit(false) is followed by a setAutoCommit(true)-call . Regardless the above settings…
Looking at a JDBC-Trace of SQL Workbench (with AutoCommit-Switch off ) there is only one setAutoCommit(false) call at the beginning.
pdiTrace_jdbc.v3.txt

The JDBC-Driver are both the same for Kettle and SQL Workbench and it does not matter whether JDBC-Level 3 or 4 Driver is used.

What am I doing wrong or is this a bug in Kettle?
Are there any other options to switch autocommit off?
Attached Files

Tableau Data Extract Output Plugin

$
0
0
Hi
I want to test Tableau Data Extract Output Plugin on Pentaho6.1.
1. install the plugin from Marketplace.
2.Download Mac OS X (image file, 64-bit) and copy files from Framework to /Pentaho/design-tools/data-integration/plugins/steps/TDEOutputPlugin/lib I also copy TDEOutputPlugin and put it under /plugins3.export LD_LIBRARY_PATH=/Applications/Pentaho/design-tools/data-integration/plugins/steps/TDEOutputPlugin/lib

I got this error

2016/08/16 15:21:50 - Tableau Data Extract Output.0 - ERROR (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49 by buildguy) :
2016/08/16 15:21:50 - Tableau Data Extract Output.0 - com.tableausoftware.TableauException: column name empty
2016/08/16 15:21:50 - Tableau Data Extract Output.0 - column name empty
2016/08/16 15:21:50 - Tableau Data Extract Output.0 - ERROR (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49 by buildguy) : Error initializing step [Tableau Data Extract Output]
2016/08/16 15:21:50 - Test Tableau Data Extract Output - ERROR (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49 by buildguy) : Step [Tableau Data Extract Output.0] failed to initialize!

Do you guys have any experience with this ?
Any suggestion ?

Thank you in advance.

Regards
Nudjaree

Replace Truncate Table Command

$
0
0
Migrating from ASE to MS Sql server 2014, my company is not giving permissions to execute the "Truncate Table" command. However, they allowed the use of a stored procedure "sp_truncate_table" passing the table name. Is there a way to have Pentaho execute the stored procedure instead of issuing the "truncate table" command for both the truncate table step and having the truncate table checked in the table output step? I have looked high and low and couldn't find a way. Thanks!

How to change color pie chart as value

Report Footer at bottom of last page

$
0
0
I have a report footer that has a dynamic height through the use of Block sub-band sections that can grow/shrink as needed. How can I force the Report Footer to always print together at the bottom of the last page? I am not using Page Footers in this format.

Plugin bug -- Pentaho can't find proper filepath?? How to install plugin?

$
0
0
Hi there ---

I do testing of Pentaho on my own computer, then deploy to a server once the testing is complete.


Anyway I got the plugin FastJsonInput to work on my own computer just fine. I installed it through the marketplace. I can see the files were saved in plugins/steps/.


However, on the server (with the exact same version of Pentaho located in the exact same Downloads folders)--

When I try to install the plugin via the marketplace, I get the error:

"Error installing/ uninstalling
plugins\steps\FastJsonInput\version.xml (The system cannot find the path specified).


This happens with literally every plugin on the marketplace. (Home computer, everything works just fine).

I even copied the files manually into the plugins\steps folder. Doesn't work.


So what's going on here? Is the home directory set up wrong? Why isn't Pentaho working here? Why can't I install this plugin?

Postgresql on AWS EC2 Instance

$
0
0
Hello,
I installed postgresql on an amazon aws instance running ubuntu. I received the attached error, when I tried to use the PostgreSQL bulk loader step to load data into my PostgreSQL database in Amazon EC2. I believe the error is due to the setting for the 'path to the psql client' in bulk loader step. How can i find the path to the psql client in amazon ec2?
I would appreciate any help provided.
Thanks
Attached Files

How to display blob image in pentaho reporting tool from Oracle DB

$
0
0
Hi Team,
we are struck with displaying BLOB image from Oracle DB in Pentaho Report tool.


We have a BLOB field called "CONTENT" which holds the PNG image format.


Tried BSHExpression but still image is not displayed when we previewed it. Instead Object is displayed(sun.awt.image.ToolkitImage@4ccdd423)


Steps Followed:


1. Connect to the database and write a query that fetches the BLOB field. Preview it to check if the query fetches any data.
2. Right click on the "functions" header and add a new function.
3. In the dialog box for the New Function, double click on the "Scripts" and select the BHSExpression. Click "OK".
4. In the "Expression" field for the "BHSExpression", copy the following code:


Object getValue()
{
var blobObject = dataRow.get("CONTENT");
long blobLength = blobObject.length();
byte[] blobContent = blobObject.getBytes((long)1, (int)blobLength);
return Toolkit.getDefaultToolkit().createImage(blobContent);
}


5. Drag and drop the BLOB field in the canvas and map the Attribute->field to the BHSEpression.

Please provide a solution as soon as possible.
Thanks,
Kalpana

Installing Agile BI on PDI Kettle - Spoon 5.0.1-stable

$
0
0
Hi All, After installing the Agile BI tool I no longer have Pentaho. This is following message I have got.
2016/08/17 14:11:33 - cfgbuilder - Warning: The configuration parameter [org] is not supported by the default configuration builder for scheme: sftp
2016/08/17 14:11:34 - General - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : Error starting Spoon shell
2016/08/17 14:11:34 - General - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : java.lang.NoClassDefFoundError: org/slf4j/LoggerFactory
2016/08/17 14:11:34 - General - at org.pentaho.agilebi.spoon.perspective.AbstractPerspective.<init>(AbstractPerspective.java:62)
2016/08/17 14:11:34 - General - at org.pentaho.agilebi.spoon.perspective.AgileBiVisualizationPerspective.<init>(AgileBiVisualizationPerspective.java:66)
2016/08/17 14:11:34 - General - at org.pentaho.agilebi.spoon.perspective.AgileBiVisualizationPerspective.<clinit>(AgileBiVisualizationPerspective.java:60)
2016/08/17 14:11:34 - General - at org.pentaho.agilebi.spoon.AgileBiSpoonVisualizationPlugin.getPerspective(AgileBiSpoonVisualizationPlugin.java:39)
2016/08/17 14:11:34 - General - at org.pentaho.di.ui.spoon.SpoonPluginManager.loadPlugin(SpoonPluginManager.java:95)
2016/08/17 14:11:34 - General - at org.pentaho.di.ui.spoon.SpoonPluginManager.<init>(SpoonPluginManager.java:72)
2016/08/17 14:11:34 - General - at org.pentaho.di.ui.spoon.SpoonPluginManager.<clinit>(SpoonPluginManager.java:63)
2016/08/17 14:11:34 - General - at org.pentaho.di.ui.spoon.Spoon.init(Spoon.java:802)
2016/08/17 14:11:34 - General - at org.pentaho.di.ui.spoon.Spoon.createContents(Spoon.java:8641)
2016/08/17 14:11:34 - General - at org.eclipse.jface.window.Window.create(Window.java:426)
2016/08/17 14:11:34 - General - at org.eclipse.jface.window.Window.open(Window.java:785)
2016/08/17 14:11:34 - General - at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:8672)
2016/08/17 14:11:34 - General - at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:625)
2016/08/17 14:11:34 - General - at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2016/08/17 14:11:34 - General - at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
2016/08/17 14:11:34 - General - at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2016/08/17 14:11:34 - General - at java.lang.reflect.Method.invoke(Method.java:606)
2016/08/17 14:11:34 - General - at org.pentaho.commons.launcher.Launcher.main(Launcher.java:134)
2016/08/17 14:11:34 - General - Caused by: java.lang.ClassNotFoundException: org.slf4j.LoggerFactory
2016/08/17 14:11:34 - General - at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
2016/08/17 14:11:34 - General - at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
2016/08/17 14:11:34 - General - at java.security.AccessController.doPrivileged(Native Method)
2016/08/17 14:11:34 - General - at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
2016/08/17 14:11:34 - General - at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
2016/08/17 14:11:34 - General - at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
2016/08/17 14:11:34 - General - at org.pentaho.di.core.plugins.KettleURLClassLoader.loadClass(KettleURLClassLoader.java:98)
2016/08/17 14:11:34 - General - at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
2016/08/17 14:11:34 - General - ... 18 more
stopping

Eliminate everything after comma in a string.

$
0
0
Hi All,

I have a field called quantity(varchar) in a table.

i want to insert it into another table into the column qty_label (varchar)


the rules are like this :-

if the field quantity contains comma(,) then everything will be removed after the comma including the comma itself.

e.g 123.00 = 123
123.. = 123
123. = 123

How to achieve this ??

Please help.

Thanks
Chinmaya

Problem with CST - Community Startup Tabs, Error processing component (tableC)

$
0
0
Hello ;

I install CST Plugin from the MarketPlace in Pentaho CE 6.1, and left all the configuration by default (file config.xml ), and when i click on the luncher , i have this error : Error processing component (tableC) [ATTACH]ScreenShot[/ATTACH] , i tried to reinstall the plugin also same problem.

Any one have this problem , any ideas to solve it.

PS : It work perfectlly when i login as user (suzy) . but as admin i have this problem

Thank you ;
Attached Images

Table input date data type

$
0
0
I'm using the Table Input step to read data from a Postgres database. The choice of SQL changes the data type of fields containing dates or date+time.

Both of the options below bring in all dates or date+time as data type=Date.

Answer No to "Do you want to Include the field-names in the SQL?" gives

SELECT *
FROM admin_info


Answer Yes to the same question

SELECT
id
, version
, consent_clinician_id
, consent_date
, familyid
, mother_post_code
, notes
, withdrawal_date
, withdrawal_reason
, withdrawal_status
FROM admin_info

where all the fields in table admin_info are listed.

BUT

if I then remove the fields that I don't want to create the SQL below, the date fields come in as datatype=Timestamp.
SELECT
id
, consent_date
, withdrawal_date
, withdrawal_status
FROM admin_info

This behavior is consistent across several different tables in the same database.

It's not a monumental problem but I wondered if this is a bug or a feature and if the latter, what's the purpose?

Nick

Reading Unidata NetCDF file

$
0
0
Hi everyone,

I'm trying to work with kettle fro reading netCDF unidata format. I found the official java lib for reading this http://www.unidata.ucar.edu/software...umentation.htm
Additionnaly, I think I've found a few weeks ago a plugin for kettle. Does anyone already use kettle for this kind of format and does anyone has a link for this kind of plugin?

Any help would be appreciated.

regards

Display report in CST (Community Startup Tabs)

$
0
0
I'm using CST to manage rules and users access to Pentaho CE 6.1, i try to display Luncher interface with dashboards and reports. For the dasboards, when i click it work perfectlly, But when i click to Report it show me nothing , is something wrong ?, is the same code used to displaying report as dashboard? or we can't display report from CST interface ?

this is y code to display my dashboard and report (rapport.prpt).

<tab title="Gestion des agents" fullScreen="false" tooltip=""><![CDATA[api/repos/%3Ahome%3Aadmin%3Atab3.pinb/generatedContent]]></tab>
<tab title="Rapport" fullScreen="false" tooltip=""><![CDATA[api/repos/%3Ahome%3Aadmin%3rapport.prpt/generatedContent]]></tab>

this my my Luncher interface img.jpg


need your answers please ;

Thank you
Attached Images

append/bring percentage (%) symbol next to numerical value

$
0
0
How to append/bring percentage (%) symbol next to numerical value in pentaho view, kindly refer to the field header Exceeding >15% Threshold where numeric value(9) is displayed and i want to show % symbol next to that
Attached Images

Shell component don't recognize regex filename

$
0
0
I'm trying to execute this script using shell component:

Code:

awk -F'\t' '{print NF; exit}' /mydir/.*\.txt$
Code:

2016/08/17 11:46:36 - Validar numero de columnas - Executing command : /opt/../mydir/null/kettle_292f84a2-649a-11e6-bd82-b5baf6dc4328shell
2016/08/17 11:46:36 - Validar numero de columnas - (stderr) awk: cmd. line:1: fatal: cannot open file `/mydir/.*.txt$' for reading (No such file or directory)

I need know what's the correct way.

I tried this but only work in console:

Code:

awk -F'\t' '{print NF; exit}' /mydir/*.txt
thanks a lot

Assistance with Uneven JSON

$
0
0
Hi Marabu,

can you help me figureout the transformation for the below uneven data... i tried with two json input, it didnt work.

{
"data": [
{
"result": [
{
"expand": "description,lead,url,projectKeys",
"self": "project/11301",
"id": "11301",
"key": "APR",
"name": "Access Point [APR/SCR]",
"avatarUrls": {
"48x48": "10201",
"24x24": "=10201",
"16x16": "d=10201",
"32x32": "102012"
},
"projectCategory": {
"self": "d10006",
"id": "10006",
"name": "IT",
"description": ""
},
"projectTypeKey": "software"
},


],
}
]
}
Viewing all 16689 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>