December 2, 2016, 10:23 pm
Hi All,
I am trying to set up Pentaho CE development on my IntelliJ IDE, I have been reading various resources including the official Pentaho docs but I am facing difficulty to complete this task.
I followed
https://groups.google.com/forum/?hl=...rs/kyEKMRnsT5Q to set up my dev environment.
IntelliJ recognized eclipse project set up and it did create all the module dependencies however I am not sure if something is wrong. I am getting errors while trying to resolve dependencies, such as "pentaho-registry;7.1-SNAPSHOT: not found" (and many others) for all the modules.
Sorry for my ignorance I am very new to Pentaho and don't know how the whole project is put together, could not find much docs explaining this. I have failed to get my eclipse environment set up as well (I am more comfortable with IntelliJ hence switched). In eclipse "ant clean-all resolve create-dot-classpath" does not create a run/debug configuration as explained in
https://github.com/pentaho/pentaho-kettle.
The good thing is I can successfully build project using ant commands in command prompt.
Could someone help me understand module dependencies and what I may be doing wrong here.
My set up:
- Windows 7 OS
- IntelliJ with IvyIdea plugin installed
- Ant set up with Ivy
- Environment vars set for Ant
- Added Junit, Ant, Ivy dependencies
I am happy to share more details if required..
Thanks,
R
↧
December 4, 2016, 8:36 am
Hi All,
I have a requirement where the set of records look like this.
Capture.JPG
for the part_number column you see some values are null.
So we have to update it to the previous value, once it is null.
if there is multiple null, than we will continue updating till it get a value.
Thanks in advance.
Chinmay
↧
↧
December 4, 2016, 11:55 pm
Hi,
I am getting error while using Z/OS plugin in pentaho 6.0.1 version in my window7 Machine with Java version 1.7
It works perfectly fine on pentaho 5.0.1.
Below is the error I am getting while double click on step:
Unable to open dialog for this step
java.lang.NoClassDefFoundError: org/apache/commons/vfs/FileSystemException
at com.legstar.pdi.zosfile.ZosFileInputDialog.initCompositeJaxbClassNamesCombo(ZosFileInputDialog.java:1083)
at com.legstar.pdi.zosfile.ZosFileInputDialog.setDialogFromMetaData(ZosFileInputDialog.java:1445)
at com.legstar.pdi.zosfile.ZosFileInputDialog.open(ZosFileInputDialog.java:201)
at org.pentaho.di.ui.spoon.delegates.SpoonStepsDelegate.editStep(SpoonStepsDelegate.java:125)
at org.pentaho.di.ui.spoon.Spoon.editStep(Spoon.java:8728)
at org.pentaho.di.ui.spoon.trans.TransGraph.editStep(TransGraph.java:3032)
at org.pentaho.di.ui.spoon.trans.TransGraph.mouseDoubleClick(TransGraph.java:755)
at org.eclipse.swt.widgets.TypedListener.handleEvent(Unknown Source)
at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)
at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)
at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source)
at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)
at org.pentaho.di.ui.spoon.Spoon.readAndDispatch(Spoon.java:1339)
at org.pentaho.di.ui.spoon.Spoon.waitForDispose(Spoon.java:7939)
at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:9214)
at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:653)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.pentaho.commons.launcher.Launcher.main(Launcher.java:92)
Caused by: java.lang.ClassNotFoundException: org.apache.commons.vfs.FileSystemException
at java.net.URLClassLoader$1.run(Unknown Source)
at java.net.URLClassLoader$1.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
at org.pentaho.di.core.plugins.KettleURLClassLoader.loadClassFromParent(KettleURLClassLoader.java:89)
at org.pentaho.di.core.plugins.KettleURLClassLoader.loadClass(KettleURLClassLoader.java:108)
at java.lang.ClassLoader.loadClass(Unknown Source)
... 21 more
Can Anyone tell me what is the problem with this step in pentaho 6.
Thanks in advance
--Nishank
↧
December 5, 2016, 1:06 am
hi every,
i'm really new in pentaho report designer, i've installed PRD, but toolbar (file, edit, view, etc) display is too small (please check this attachment), it's difficult to choose/read the toolbar
i want to increase size of toolbar text/icon, please help me,,,
thank for any respond :)
↧
December 5, 2016, 2:55 am
Hi,
i have a situation like:
STREAM->
A FLAG VOL
111 1 500
111 2 300
222 1 1000
Table_Target
A FLAG VOL
111 1 1500
I want in Table Target an update of record A=111:
A FLAG VOL
111 1 1500 - 300 +500=1700
It's possible with Java Script Transformation to do:
while (all_record_processed()){
Take Stream.Record with same KEY(a) ->difference= Vol (record with flag=1) - Vol(record with flag=2)
Update REcord with KEY(a) Vol-difference
}
Thanks
↧
↧
December 5, 2016, 4:01 am
Hi,
I just wanted to post here an error that I came across and could successfully solve.
When using the Formula step, in Spoon 6.1.0.1-196, i got the following error:
Quote:
Error calculate formula. Formula IF (.....))))) output field: NovaSituacao, error is: LibFormulaErrorValue{errorCode=0, errorMessage=Unexpected}
I've ommited the formula itself because it is too long. After trying a few modifications in my formula, I found the problem: there was a call to the logical AND function as the following:
Code:
AND([Days] > -[CalculatedDays]; [Days] <= 0)
I solved the problem by adding a ZERO before the minus operator.
So, after that modification I got:
Code:
AND([Days] > 0 - [CalculatedDays]; [Days] <= 0)
and the LibFormulaErrorValue was gone.
I hope it may help someone to "escape" from this error as well, at least for this situation.
PS: Do you guys think I should open an Issue on Pentaho JIRA for this?
↧
December 5, 2016, 4:29 am
I have a need to implement the logic inside java user class in Spoon.
I would like to create a data structure (an array or vector objects) that is globally visible inside my transformation
I would like to populate an array of objects from an object from InputTable
select name, lastname, age from users
I would like create array of "User" objects type using the class "User" constructor
User(String name, String last, int age)
and I would like this item to be globally visible in my Job
I hope I was clear in the description
Many thanks :D
↧
December 5, 2016, 5:58 am
hi i have this situation:
PK FLAG VOL QNT
111 1 1500 50
111 2 -300 20
222 1 200 10
222 2 -100 30
i want to do :
select sum(VOL), QNT(take value where flag=1)
group by PK
SO:
PK VOL QNT
111 1200 50
222 100 10
How i can to do?
thanks
↧
December 5, 2016, 9:15 am
Hi all.
I have just entered using Pentaho (6.1 Enterprise) in a new company, the main issue is that is have already created a cube with Schema Workbench but i have no results finding the uploaded file.
I can see is listed on Data Sources but when i go to Analysis Report or Interactive Report it doesn't appear, i selected a JNDI Redshift connection and already tried with a JDBC connection still no results.
Thanks for any help that you could give.
Cheers!
Alejandro
↧
↧
December 5, 2016, 11:09 am
Hello
I'm a new Kettle user.
I'm using a webservice Rest Client to generate PDF File, which is in the webservice response.
But I don't know how to convert this response in a correct pdf file.
I get the above result :
Code:
%PDF-1.4
%????
4 0 obj
<</Linearized 1/L 49562/O 6/E 46403/N 1/T 49368/H [ 1396 219]>>
endobj
xref
4 55
0000000016 00000 n
0000001615 00000 n
instead of
Code:
%PDF-1.4
%âãÏÓ
4 0 obj
<</Linearized 1/L 49562/O 6/E 46403/N 1/T 49368/H [ 1396 219]>>
endobj
xref
4 55
0000000016 00000 n
0000001615 00000 n
Thanks in advance
↧
December 5, 2016, 11:18 am
Hey everyone,
i am new to pentaho bi server, i used it a little bit to explore the demo cube using mondrian, bt for now am trying to publish a cube from Schema workbench, the publishing process was seccusseful, but when i try to open the cube in pentaho it gives an error "This page cannot be accessed directly. It must be linked to from other pages".
the logs are showing an error concerning foreign keys.
18:27:34,626 WARN [JdbcMetaData] unable to process foreign keys
java.sql.SQLException: java.lang.NullPointerException
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:910)
....
am working with pentaho 6.1.
↧
December 5, 2016, 12:33 pm
Good day Pentaho community,
I am wondering how easy is it to incorporate future updates provided by Pentaho if I make modifications & customizations to the current open source version of the BI server and report designer. Are there any modules that I shouldn't touch at all to make the process as painless as possible?
Anyone have any experience with this? I'm been searching but to no avail. Thanks in advance.
↧
December 5, 2016, 12:53 pm
Hello everyone, I have a transformation that gets a query from the input table and then writes result to a text file. The problem is that in some transformations the file format is in UTF-8 and another in ASCII. These transformations are configured in exactly the same way.
I would need the file format to be in UTF-8.
I try set the fields:
Format: LF terminated(Unix)
Codification: UTF-8
Any suggestions on why it happens and how I can fix it.A
Thanks in advance.AC
Kettle - Spoon version Stable Release - 4.2.0
SO - Ubuntu 14.04.4 LTS
↧
↧
December 5, 2016, 1:04 pm
Hi, we are trying to automate a workflow of several stored procedures that execute in a defined order and have different parameters to pass into each. We are finding this to be very problematic and are finding using parameters with the stored procedures very clunky and error prone. Is there a set way to achieve this in kettle? Should we stick with SSIS to do this as kettle appears to be better with traditional ETL rather than RDBMS ELT activity. Thanks in advance for any input.
↧
December 5, 2016, 4:28 pm
What are the steps that I need to follow to turn this set variable ${AgingPrd} as an output field in my output table?
↧
December 5, 2016, 4:29 pm
I have a question about ETL with Pentaho DI.
When designing an ETL we can do data transformation steps in database (procedures or SQL) and we can do this steps in a ETL tool like Pentaho DI, as far as I know there are steps that have better performance in ETL tool and others have better performance in database. For example there are ETL tools that make the sorts or aggregation faster than database procedures or SQL.I would like to know if there are more steps that go different in a ETL tool than in a database, in order to have some criteria to make a design decision. I am working with Pentaho DI and Oracle.
Also I would like to know the differences in performance of executing row by row and pipelines the rows through next setps and working in whole datasets processing steps like SQL.
Thanks in advance,
↧
December 6, 2016, 2:47 am
Hi,
pentaho v.6.1 and 7.0 (the same issue for both)
mongodb server 3.4 (i've tried also with the 3.0)
i'm trying with no success the query above (tested and running with no problem in mongo shell).
I've tried to mix in every way the composition of the query.
The red part is the part i've added in the mongo shell
I've inserted the above query (without red words) in the Tab Query of the Mongodb plugin and i've checked the flag "query is aggregation pipeline"
db.dati.aggregate(
[{$group:{_id:{"TARGA_IMPIANTO":"$TARGA_IMPIANTO","GENERATORE_CATEGORIA":"$GENERATORE_CATEGORIA","GENERATORE_PROGRESSIVO":"$GENERATORE_PROGRESSIVO"},count:{$sum:1}}}, {$sort : {TARGA_IMPIANTO : -1 }}], {allowDiskUse:true}
);
If you try to run this query on a little database it runs.
My goal is to find out every record with more than one repetition of the three grouped fields
These are the messages i receive:
Exceeded memory limit for $group .....Pass allowDiskUse:true to opt in (alloDiskUse without json notation {})
or
errmsg" : "Unrecognized pipeline stage name: 'allowDiskUse'" , if i use json notation for allowDiskUse.
Could please anyone try to help me ?
Thanks in advance
Regards
Sandro
↧
↧
December 6, 2016, 5:15 am
Hello.
My idea is create a dashboard that the user can select what dimensions he want show, like dynamic table in Excel. The problem is how to create a Selector that I can use to select the dimensions that I want. Now, I trying the code in MDX to feed my selector:
with
member [Measures].[Name1] as
'[Vendedor].CurrentMember.UniqueName'
member [Measures].[Name2] as
'[Cliente].CurrentMember.UniqueName'
SET [~ROWS1] AS
{[Vendedor].[Todos os Vendedores]}
SET [~ROWS2] AS
{[Cliente].[Todos os Clientes]}
select
NonEmptyCrossJoin([~ROWS1], [~ROWS2]) on ROWS,
({[Measures].[Name2], [Measures].[Name1]}) on Columns
from [Test]
But, it's returns a table with four columns, when I want a table with two columns:
| Name2 |
Name1 |
| Todos os Vendedores |
Todos os Clientes |
[Cliente].[Todos os Clientes] |
[Vendedor].[Todos os Vendedores] |
|---|
Can someone help me?
Thanks!
↧
December 6, 2016, 7:00 am
I have a directory that has files with no extension. They are, in reality, text files. If I simply rename the file from filename to filename.txt I'm all set. I have found that it works to I use the 'Move Files' entry and specifically set the file (e.g. C:\directory\filename) as the source, then set the file with extension (e.g. C:\directory\filename.txt) as the destination. However, I have to do this on a file-by-file basis, which is time consuming (and slower than if I were to just go in and do it in windows file explorer).
What I would like to do is use PDI to automate the process of renaming the files so that I can just point to the directory and rename all the files in one fell swoop.
I have tried to use regex to no avail (I am far (really far) from being proficient, so there may be a way and it may be easy).
If any of you smart people have any ideas about how to make this work, I'd appreciate hearing it!
PDI Version: 7.0
Many thanks!
↧
December 6, 2016, 8:16 am
Hi all,
I'm trying to launch Pentaho DI v7 on Windows 10, i have set my environnement variables (JAVA_HOME, PENTAHO_JAVA_HOME, ...) like it's recommended in another post but i can't launch it...
Here is what i have When i launch Spoon.bat in command line :C:\PDI\data-integration>spoon.bat
DEBUG: Using PENTAHO_JAVA_HOME
DEBUG: _PENTAHO_JAVA_HOME=C:\Program Files (x86)\Java\jre1.8.0_111
DEBUG: _PENTAHO_JAVA=C:\Program Files (x86)\Java\jre1.8.0_111\bin\javaw.exe
C:\PDI\data-integration>start "Spoon" "C:\Program Files (x86)\Java\jre1.8.0_111\bin\javaw.exe" "-Xms1024m" "-Xmx2048m" "-XX:MaxPermSize=256m" "-Dhttps.protocols=TLSv1,TLSv1.1,TLSv1.2" "-Djava.library.path=libswt\win32" "-DKETTLE_HOME=" "-DKETTLE_REPOSITORY=" "-DKETTLE_USER=" "-DKETTLE_PASSWORD=" "-DKETTLE_PLUGIN_PACKAGES=" "-DKETTLE_LOG_SIZE_LIMIT=" "-DKETTLE_JNDI_ROOT=" -jar launcher\pentaho-application-launcher-7.0.0.0-25.jar -lib ..\libswt\win32
Someone have an idea of what i can do to lauch it from windows (without using linux plateform) ?
↧