Quantcast
Channel: Pentaho Community Forums
Viewing all 16689 articles
Browse latest View live

setting decimal symbol in Select Values

$
0
0
Hello.
In my transformation I'm using step Select Values to convert string to number.
The problem is that in input files there is a mix of "decimal symbols". There are numbers with "." and with ",". (For example 0.087 and 5,37)
In Select Values there is a "decimal" field but I don't know how to set both symbols there.

Thanks

Outout file as a parameter

$
0
0
Hi,

I have a text file that contains a list of pathes to other files,
I want to scan that list and write to each of the pathes.
What is the best way of doing this? (I'm a total begginer in Pentaho)

Thanks a lot

Mondrian query execution time (Saiku stuff?)

$
0
0
Hi forum users,
my cube is very very simple,
it has one measure (count on ID field of fact table) and one dimension with 2 level, Department and Office, both reference to the table OrganizationUnit.
The table OrganizationUnit has 35000 rows, with 3 Department values (Dept1, Dept2, Dept3).
Dept1 has 2 Office (Office1, Office2), Dept2 has 1 Office (Office3), Dept3 has 34997 Office (Office4, .....).
How it is possible that when I analyze the cube with Saiku and drag Office to filter section it takes a life and return:
OlapException: Mondrian Error:Query timeout of 300 seconds reached
(300 is the mondrian.rolap.queryTimeout property value in my mondrian.properties)
What should I investigate?
There is some mondrian setting?
Thanks all.

PRD fails to load image

$
0
0
Just for testing purposes I created a report with an image, containing a cgg-created url, but it fails to load it.

This is what the log file says:

Code:

2014-02-13 14:20:03,530 [8057888]  WARN - org.pentaho.reporting.engine.classic.core.filter.types.ContentType - Failed to load content using value ResourceKey{schema=org.pentaho.reporting.libraries.resourceloader.loader.URLResourceLoader, identifier=http://localhost:8080/pentaho/plugin/cgg/api/services/draw?script=/home/FHBRN/Management_ckpt/chart_movements.js&outputType=png&userid=admin&password=password, factoryParameters={}, parent=null}
org.pentaho.reporting.libraries.resourceloader.ResourceLoadingException: Failed to open URL connection
    at org.pentaho.reporting.libraries.resourceloader.loader.URLResourceData.getResourceAsStream(URLResourceData.java:180)
    at org.pentaho.reporting.libraries.resourceloader.loader.AbstractResourceData.getResource(AbstractResourceData.java:101)
    at org.pentaho.reporting.libraries.docbundle.bundleloader.ZipResourceBundleLoader.loadBundle(ZipResourceBundleLoader.java:77)
    at org.pentaho.reporting.libraries.resourceloader.DefaultResourceManagerBackend.loadResourceBundle(DefaultResourceManagerBackend.java:393)
    at org.pentaho.reporting.libraries.docbundle.BundleResourceManagerBackend.loadResourceBundle(BundleResourceManagerBackend.java:187)
    at org.pentaho.reporting.libraries.docbundle.BundleResourceManagerBackend.loadResourceBundle(BundleResourceManagerBackend.java:187)
    at org.pentaho.reporting.libraries.docbundle.BundleResourceManagerBackend.loadResourceBundle(BundleResourceManagerBackend.java:187)
    at org.pentaho.reporting.libraries.docbundle.BundleResourceManagerBackend.loadResourceBundle(BundleResourceManagerBackend.java:187)
    at org.pentaho.reporting.libraries.docbundle.BundleResourceManagerBackend.loadResourceBundle(BundleResourceManagerBackend.java:187)
    at org.pentaho.reporting.libraries.docbundle.BundleResourceManagerBackend.loadResourceBundle(BundleResourceManagerBackend.java:187)
    at org.pentaho.reporting.libraries.docbundle.BundleResourceManagerBackend.loadResourceBundle(BundleResourceManagerBackend.java:187)
    at org.pentaho.reporting.libraries.docbundle.BundleResourceManagerBackend.loadResourceBundle(BundleResourceManagerBackend.java:187)
    at org.pentaho.reporting.libraries.docbundle.BundleResourceManagerBackend.loadResourceBundle(BundleResourceManagerBackend.java:187)
    at org.pentaho.reporting.libraries.docbundle.BundleResourceManagerBackend.loadResourceBundle(BundleResourceManagerBackend.java:187)
    at org.pentaho.reporting.libraries.docbundle.BundleResourceManagerBackend.loadResourceBundle(BundleResourceManagerBackend.java:187)
    at org.pentaho.reporting.libraries.docbundle.BundleResourceManagerBackend.loadResourceBundle(BundleResourceManagerBackend.java:187)
    at org.pentaho.reporting.libraries.docbundle.BundleResourceManagerBackend.loadResourceBundle(BundleResourceManagerBackend.java:187)
    at org.pentaho.reporting.libraries.resourceloader.ResourceManager.loadResourceBundle(ResourceManager.java:269)
    at org.pentaho.reporting.libraries.resourceloader.ResourceManager.load(ResourceManager.java:291)
    at org.pentaho.reporting.libraries.resourceloader.ResourceManager.create(ResourceManager.java:413)
    at org.pentaho.reporting.engine.classic.core.filter.types.ContentType.filter(ContentType.java:209)
    at org.pentaho.reporting.engine.classic.core.filter.types.ContentType.getValue(ContentType.java:94)
    at org.pentaho.reporting.engine.classic.core.filter.types.ContentType.getDesignValue(ContentType.java:145)
    at org.pentaho.reporting.engine.classic.core.layout.build.DefaultLayoutBuilderStrategy.computeValue(DefaultLayoutBuilderStrategy.java:254)
    at org.pentaho.reporting.engine.classic.core.layout.build.DefaultLayoutBuilderStrategy.processContent(DefaultLayoutBuilderStrategy.java:202)
    at org.pentaho.reporting.engine.classic.core.layout.build.DefaultLayoutBuilderStrategy.addBandInternal(DefaultLayoutBuilderStrategy.java:135)
    at org.pentaho.reporting.engine.classic.core.layout.build.DefaultLayoutBuilderStrategy.add(DefaultLayoutBuilderStrategy.java:85)
    at org.pentaho.reporting.engine.classic.core.layout.build.ReportRenderModelBuilder.add(ReportRenderModelBuilder.java:193)
    at org.pentaho.reporting.engine.classic.core.layout.AbstractRenderer.add(AbstractRenderer.java:389)
    at org.pentaho.reporting.engine.classic.core.layout.output.DefaultOutputFunction.print(DefaultOutputFunction.java:1374)
    at org.pentaho.reporting.engine.classic.core.layout.output.DefaultOutputFunction.reportStarted(DefaultOutputFunction.java:185)
    at org.pentaho.reporting.engine.classic.core.states.datarow.ExpressionEventHelper.fireReportStartedEvent(ExpressionEventHelper.java:482)
    at org.pentaho.reporting.engine.classic.core.states.datarow.ExpressionEventHelper.fireReportEvent(ExpressionEventHelper.java:92)
    at org.pentaho.reporting.engine.classic.core.states.InitialLayoutProcess.fireReportEvent(InitialLayoutProcess.java:221)
    at org.pentaho.reporting.engine.classic.core.states.SubLayoutProcess.fireReportEvent(SubLayoutProcess.java:217)
    at org.pentaho.reporting.engine.classic.core.states.process.ProcessState.fireReportEvent(ProcessState.java:1213)
    at org.pentaho.reporting.engine.classic.core.states.process.ReportHeaderHandler.advance(ReportHeaderHandler.java:47)
    at org.pentaho.reporting.engine.classic.core.states.process.ProcessState.advance(ProcessState.java:1004)
    at org.pentaho.reporting.engine.classic.core.layout.output.AbstractReportProcessor.processPage(AbstractReportProcessor.java:1329)
    at org.pentaho.reporting.engine.classic.core.layout.output.AbstractReportProcessor.processReport(AbstractReportProcessor.java:1736)
    at org.pentaho.reporting.designer.core.editor.report.layouting.ReportLayouter.layout(ReportLayouter.java:61)
    at org.pentaho.reporting.designer.core.editor.report.layouting.SharedElementRenderer.performLayouting(SharedElementRenderer.java:123)
    at org.pentaho.reporting.designer.core.editor.report.layouting.AbstractElementRenderer.performLayouting(AbstractElementRenderer.java:273)
    at org.pentaho.reporting.designer.core.editor.report.layouting.AbstractElementRenderer.getBounds(AbstractElementRenderer.java:256)
    at org.pentaho.reporting.designer.core.editor.report.layouting.AbstractElementRenderer.draw(AbstractElementRenderer.java:315)
    at org.pentaho.reporting.designer.core.editor.report.AbstractRenderComponent.paintComponent(AbstractRenderComponent.java:1346)
    at javax.swing.JComponent.paint(JComponent.java:1054)
    at javax.swing.JComponent.paintChildren(JComponent.java:887)
    at javax.swing.JComponent.paint(JComponent.java:1063)
    at javax.swing.JComponent.paintChildren(JComponent.java:887)
    at javax.swing.JComponent.paint(JComponent.java:1063)
    at javax.swing.JComponent.paintChildren(JComponent.java:887)
    at javax.swing.JComponent.paint(JComponent.java:1063)
    at javax.swing.JComponent.paintChildren(JComponent.java:887)
    at javax.swing.JComponent.paint(JComponent.java:1063)
    at javax.swing.JViewport.paint(JViewport.java:731)
    at javax.swing.JComponent.paintChildren(JComponent.java:887)
    at javax.swing.JComponent.paint(JComponent.java:1063)
    at javax.swing.JComponent.paintChildren(JComponent.java:887)
    at javax.swing.JComponent.paint(JComponent.java:1063)
    at javax.swing.JComponent.paintToOffscreen(JComponent.java:5219)
    at javax.swing.RepaintManager$PaintManager.paintDoubleBuffered(RepaintManager.java:1529)
    at javax.swing.RepaintManager$PaintManager.paint(RepaintManager.java:1452)
    at javax.swing.RepaintManager.paint(RepaintManager.java:1249)
    at javax.swing.JComponent._paintImmediately(JComponent.java:5167)
    at javax.swing.JComponent.paintImmediately(JComponent.java:4978)
    at org.pentaho.reporting.designer.core.editor.report.AbstractRenderComponent.repaintConditionally(AbstractRenderComponent.java:1937)
    at org.pentaho.reporting.designer.core.editor.report.AbstractRenderComponent$RootBandChangeHandler.nodeChanged(AbstractRenderComponent.java:194)
    at org.pentaho.reporting.engine.classic.core.AbstractReportDefinition.fireModelLayoutChanged(AbstractReportDefinition.java:1247)
    at org.pentaho.reporting.engine.classic.core.MasterReport.updateChangedFlagInternal(MasterReport.java:512)
    at org.pentaho.reporting.engine.classic.core.Element.notifyNodePropertiesChanged(Element.java:971)
    at org.pentaho.reporting.engine.classic.core.MasterReport.setResourceManager(MasterReport.java:502)
    at org.pentaho.reporting.designer.core.actions.report.SaveReportAction.saveReport(SaveReportAction.java:117)
    at org.pentaho.reporting.designer.core.actions.report.SaveReportAction.actionPerformed(SaveReportAction.java:67)
    at javax.swing.AbstractButton.fireActionPerformed(AbstractButton.java:2018)
    at javax.swing.AbstractButton$Handler.actionPerformed(AbstractButton.java:2341)
    at javax.swing.DefaultButtonModel.fireActionPerformed(DefaultButtonModel.java:402)
    at javax.swing.DefaultButtonModel.setPressed(DefaultButtonModel.java:259)
    at javax.swing.plaf.basic.BasicButtonListener.mouseReleased(BasicButtonListener.java:252)
    at java.awt.AWTEventMulticaster.mouseReleased(AWTEventMulticaster.java:289)
    at java.awt.Component.processMouseEvent(Component.java:6505)
    at javax.swing.JComponent.processMouseEvent(JComponent.java:3320)
    at java.awt.Component.processEvent(Component.java:6270)
    at java.awt.Container.processEvent(Container.java:2229)
    at java.awt.Component.dispatchEventImpl(Component.java:4861)
    at java.awt.Container.dispatchEventImpl(Container.java:2287)
    at java.awt.Component.dispatchEvent(Component.java:4687)
    at java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4832)
    at java.awt.LightweightDispatcher.processMouseEvent(Container.java:4492)
    at java.awt.LightweightDispatcher.dispatchEvent(Container.java:4422)
    at java.awt.Container.dispatchEventImpl(Container.java:2273)
    at java.awt.Window.dispatchEventImpl(Window.java:2719)
    at java.awt.Component.dispatchEvent(Component.java:4687)
    at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:735)
    at java.awt.EventQueue.access$200(EventQueue.java:103)
    at java.awt.EventQueue$3.run(EventQueue.java:694)
    at java.awt.EventQueue$3.run(EventQueue.java:692)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.security.ProtectionDomain$1.doIntersectionPrivilege(ProtectionDomain.java:76)
    at java.security.ProtectionDomain$1.doIntersectionPrivilege(ProtectionDomain.java:87)
    at java.awt.EventQueue$4.run(EventQueue.java:708)
    at java.awt.EventQueue$4.run(EventQueue.java:706)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.security.ProtectionDomain$1.doIntersectionPrivilege(ProtectionDomain.java:76)
    at java.awt.EventQueue.dispatchEvent(EventQueue.java:705)
    at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:242)
    at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:161)
    at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:150)
    at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:146)
    at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:138)
    at java.awt.EventDispatchThread.run(EventDispatchThread.java:91)
Caused by: java.net.ProtocolException: Server redirected too many  times (20)
    at sun.reflect.GeneratedConstructorAccessor94.newInstance(Unknown Source)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
    at sun.net.www.protocol.http.HttpURLConnection$6.run(HttpURLConnection.java:1675)
    at sun.net.www.protocol.http.HttpURLConnection$6.run(HttpURLConnection.java:1673)
    at java.security.AccessController.doPrivileged(Native Method)
    at sun.net.www.protocol.http.HttpURLConnection.getChainedException(HttpURLConnection.java:1671)
    at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1244)
    at org.pentaho.reporting.libraries.resourceloader.loader.URLResourceData.getResourceAsStream(URLResourceData.java:176)
    ... 110 more
Caused by: java.net.ProtocolException: Server redirected too many  times (20)
    at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1636)
    at sun.net.www.protocol.http.HttpURLConnection.getHeaderField(HttpURLConnection.java:2678)
    at java.net.HttpURLConnection.getHeaderFieldDate(HttpURLConnection.java:539)
    at org.pentaho.reporting.libraries.resourceloader.loader.URLResourceData.readMetaData(URLResourceData.java:146)
    at org.pentaho.reporting.libraries.resourceloader.loader.URLResourceData.getResourceAsStream(URLResourceData.java:174)
    ... 110 more


Anyone got any clue about this?

Thanks four your help!

Passing the sum from sub report to main report

$
0
0
CAn any one tell me how to pass the sumfunction value from sub report to main report

sum function is sum of the number column of subreport

i have 2 subreports

i want to pass the sumfunction value from two subreports
to the main reports where i want to add again the sum functions of the two subreport

eg say the sum functionvalue of subreport1 =12

sum functionvalue of subreport2 =24
then adding two in main report i want a functionvalue3 = sum functionvalue1+sum functionvalue2 =36

So how can i make this report .
thanks
Saurabh

How to load different targets based on conditions

$
0
0
I need to build a transformation which will load the data from one source table into multiple target tables on different database connections. The conditions has be verified by doing a lookup on a control table. Need help in understanding which transformation components can I use to achieve this.

Here is the dry-run of what I am trying to do:

1) Lookup table X on field Y to see if a value 'A' exists
2) if 'A' exist then load the data from table 'S' into target 'T1'
3) If 'B' exist then load the data from table 'S' into target 'T2'
likewise..........

Thanks in advance for help

BTable on Penthao 4.8

$
0
0
Hello Forum,


I install Pentaho 4.8 in two servers:



  • Tomcat BI server (Windows)
  • Websphere AS BI server ( Linux)



I download BTable zip file from http://sourceforge.net/projects/btable/ and then unzipped it in both server in the pentaho-solutions/system directory and finally I restarted the two BI servers.

From the browser I connect to Pentaho using the standard "joe/password" user, then I click on BTable item in Tools submenu:



  • connected to the Tomcat BI Server, the BTable page is displayed
  • connected to the Websphere AS BI server, the following error happened in the Websphere SystemOut.log file:



[2/13/14 16:07:51:846 CET] 0000002f CpkContentGen E pt.webdetails.cpf.SimpleContentGenerator createContent No method supplied.
[2/13/14 16:07:51:872 CET] 0000002d GenericServle E org.pentaho.platform.web.servlet.ServletBase error GenericServlet.ERROR_0002 - Could not get content generator: about
Note that in the BTable page is displayed the message “GenericServlet.ERROR_0002 - Could not get content generator: about” .

Can you help me to solve this issue?


Thank you,
Maurizio.

PRD: Can we use Excel Array Formula in the Excel generated by PRPT

$
0
0
In the reports generated by Pentaho, we have some cells on the summary line which need to be handled by complex Excel Array formula (Aka. Ctrl+Shift+Enter). So far, we can use Pentaho to handle the regular Excel formula very well and our Accounting people really love it. Is there any way that I can setup Excel Array Formula in the PRPT file? I am using the Pentaho report designer version 3.9.1. Many thanks in advance.

Startup Rule Engine: New Sparkl App in the Pentaho Marketplace

$
0
0
A bit of history

5 years ago, Aaron, at the time a Pentaho employee, started a thread at the forums on the following subject:
One of the replies was from a guy that didn't show much love for the concept
... or you could aim higher; Implement xactions in kettle. We have .ktr, .kjb and why not .kxa?
The way xactions work is not that different from a job; We have a start, several actions to choose from and a workflow we want it to follow. Every actionComponent could easily be mapped to a kettle step.
The only use case left to cover using xactions is to set environment variables, as CDA removed all needs for data handling and more recently the kettle reporting step solved the bursting use case.

Not any more. 5 years later, the final blow on xactions. This new application provides a much more easier (and powerful) way to do that

Startup Rule Engine

Startup Rule Engine

What is it

This is not a only a tool to allow administrators to set Pentaho environment variables; It's an initialization daemon for the BA platform

How it works

The principle is extremely simple: You drop .ktr / .kjb files in a specific directory (by default /system/startupRules/rules) and through the UI you specify when they need to be executed. There's currently 3 options:

  • Execution at platform start
  • Execution at user login
  • Execution at user logout

With this tool you can implement any logic you want; specific rules per group or per user, logging, alarms, triggering emails, your call.

The startup variable case

The initial use case we wanted to cover was setting a session variable, widely used for row level security. For that we simply developed a PDI step plugin that's now available to use, much like the set/get variables step.

Here's an example of the setVariables transformation. If you ever wrote an xaction, you'll realize how simple and powerful this new approach is:
Set Variables Transformation
How to get it

Unsurprisingly, through the Marketplace


How it was built

Unsurprisingly too, Sparkl!



R.I.P. xactions, you won't be missed :)

More...

Enclosure character within field on csv input step

$
0
0
Hello,
I have a file on which fields are are delimited by '|' and enclosed with '"'(double quote). I am clueless on what to do if the field itself contains a double quote. Lets say the input file has name and age -

name|age
"Mradul "|20
"Jain | "|103
"Julio"s "|1

Which, using the csv input step as described above, is being read as -
[name,age]
[Mradul,20]
[Jain |,103]
[Julio"s "|1]

What can I do if I have an extra enclosure character within the field? As age is varying, I can't read the file as fixed-width, even though name would always be 35 characters long. I've tried using a different enclosure, but some genius has entered that as well in the input. Is there anything I can do without changing the enclosure?

Much appreciated,
Mradul

Validate migration process with kettle

$
0
0
Hi everything,

Guys, I have a problem and i hope that you can help me. I am new with Kettle. Now I will explain my problem. I have two subsystems each with several tables. The A subsystem is a relational database with three tables, the B subsystem also is a relational database with six tables. Both are in the same database motor than is SQL Server. The information of A Subsystem was migrated to B SubSystem. One register in A can generate one register in each of tables of B. Now i need to validate than the migration were performed correctly. I have been searching on Pentaho Kettle and i see than i can perform this job with a transformation, but i don't know how to perform the remaining work. I need to validate for example than the column 1 from the table A1 from the Subsystem A is table is equal to column 1 from the table B1 from the Subsystem B, the column 2 from the table A1 from the Subsystem A is table is equal to column 1 from the table B3 from the Subsystem B.

I had thought to perform a query to table A1 from the Subsystem A and store each this columns in something like as Array after start a comparison with the destiny column knowing this:

SubSystem -Table- -Column- SubSystem -Table- -Column-
A A1 1 B B1 1
A A1 2 B B2 2
A A1 3 B B1 5
A A1 4 B B3 2

I need check out with this map for example than the data is identical in A-A1-1 == B-B1-1. If the data is not identical, i must register an error in a log table. Some idea for to perform this job with the tool`s kettle?.

I appreciate your colaboration and I hope that some can help me.

Thanks!!!!.

Pd. Sorry by my irregular english.

Reporting 5.0.1 dynamic column in the Custom Query

$
0
0
Hi there

I am beginner of pentaho reporting, i use pentaho reporting version 5.0.1,
I am going to design a report, the columns in the query is dynamically generated using parameters. What I do is:

1. I add a JDBC custom query
2. at root of master report, selected query -> name, then click ... to open custom query window
3. input query like:
SELECT ${column}
FROM OFFICES
where CITY=${city}

query running is ok, no error, but empty result.

Can anybody help me figur it out?

The sample is attached.
Attached Files

Order function does not work with calculated members

$
0
0
Physical MDX that Works (No Order By used on Calculated Member):
WITH
MEMBER [Measures].[M-541169778] AS 'ANCESTOR([Time].[Time].CurrentMember,[Time].[Time].[Year]).Name'
SELECT {[Measures].[M-541169778],[Measures].[Store Sales]} ON 0,
NON EMPTY FILTER({[Time].[Time].[Month].AllMembers}, ANCESTOR([Time].[Time].CurrentMember,[Time].[Time].[Year]).Name="1997") ON 1
FROM [Warehouse and Sales]


Physical MDX that Does not work (When Order By used on Calculated Member):

WITH
MEMBER [Measures].[M-541169778] AS 'ANCESTOR([Time].[Time].CurrentMember,[Time].[Time].[Year]).Name'
SELECT {[Measures].[M-541169778],[Measures].[Store Sales]} ON 0,
NON EMPTY ORDER(FILTER({[Time].[Time].[Month].AllMembers}, ANCESTOR([Time].[Time].CurrentMember,[Time].[Time].[Year]).Name="1997"), [M-541169778], BDESC) ON 1
FROM [Warehouse and Sales]


XMLA SoapFault:

<SOAP-ENV:Fault xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/">
<faultcode>SOAP-ENV:Client.00HSBD01</faultcode>
<faultstring>XMLA MDX parse failed</faultstring>
<faultactor>Mondrian</faultactor>
<detail>
<XA:error xmlns:XA="http://mondrian.sourceforge.net">
<code>00HSBD01</code>
<desc>The Mondrian XML: Mondrian Error:MDX object '[M-541169778]' not found in cube 'Warehouse and Sales'</desc>
</XA:error>
</detail>
</SOAP-ENV:Fault>

How do I create tabs for different charts tied to same parameters?

$
0
0
Instead of having all the graphs on one layout, how do I create a layout that has clickable tabs to bounce from graph to graph for a set of parameters??

Mike

REST Client (Get) with OAuth authentication

$
0
0
Hi

Please excuse my inexperience here...

I am trying to setup a REST Client to get data from a cloud based database using a well defined API. The Host uses OAuth to authenticate access.

I have a "Consumer Key" / "Consumer Secret" from the Host however I am struggling to see how to configure the REST (Get) transformation

At the moment, my URL looks like this:
https://api.xxxxxx.com/xxxx/xxxx/xxxxx/BalanceSheet?access_token=D5C2LxxxxxxxxxxxxxxxxJ15K . The Authentication / SSL / Headers / Parameters tabs are currently empty. On running this, the response is that the "Consumer Key is unrecognised"

Does the REST Client doesn't allow for OAuth authentication? If so, how do I set it up?

Any help would be very much appreciated!

thanks
Graeme

Am I that stupid?? Cant find marketplace in CE 5.0.1

$
0
0
Hi you all

I really think I'm stupid, because I'm working with Pentaho CE 5.0.1 and I can't find marketplace anywhere.
In my portal....I click Home and appears:
1.jpg

Nothing like Marketplace anywhere

I've checked the folder ...biserver-ce\pentaho-solutions\system and Marketplace is in there, but only there....

I'm desperate now....please heeeeelp!!


King regards!
Attached Images

How can I know who's guilty?

$
0
0
Hi!

I have one transformation who make a text file, and it works almost find because sometimes this appens :

Code:

2| 300050| 305369| 1| 302644|F Laurent|TiersPersonnePhysique||FLAURENT||NULL||||||||||0|N|N|41|||DOMICILE_CONNU
2| 2| 300267| 301861| 1| 302125|D Edgard|TiersPersonnePhysique||DEDGARD||NULL||||||||||0|N|N|41|||DOMICILE_CONNU
 2| 300193| 302012| 1| 302386|L Pierre|TiersPersonnePhysique||LPIERRE||NULL||||||||||0|N|N|41|||DOMICILE_CONNU

or this

Code:

2| 300889| 304442| 1| 305096|F Laurent|TiersPersonnePhysique||FLAURENT||NULL||||||||||0|N|N|41|||DOMICILE_CONNU
300050| 305369| 1| 302644|F Laurent|TiersPersonnePhysique||FLAURENT||NULL||||||||||0|N|N|41|||DOMICILE_CONNU
2| 300050| 305369| 1| 302644|F Laurent|TiersPersonnePhysique||FLAURENT||NULL||||||||||0|N|N|41|||DOMICILE_CONNU

And if I ran again my transformation à few minutes latter, my file is perfect.

So who's guilty?

store aggregated field in (mysql) database

$
0
0
I'm importing 500k 'activities' from a round 2000 xml files in my warehouse.
Each activity has an identifier which is a varchar(255).
It should be unique, but it is not.
I want to add a field which contains how often an identifier is used.
The table in simple form has the fields: stage_activity_key, iati_identifier, occurence_iati_identifier

I tried it with mysql:
Code:

TRUNCATE stage_activity_temp;

insert into stage_activity_temp (`iati-identifier`, occurence_iati_identifier)
SELECT `iati-identifier` , count(*)
FROM `stage_activity`
GROUP BY `iati-identifier`;

update stage_activity a
left join stage_activity_temp b on
a.`iati-identifier` like b.`iati-identifier`
set a.occurence_iati_identifier=b.occurence_iati_identifier ;

But after 50000 seconds the update query was still running...

I tried it with pdi with a simple 3 step transformation:
get rows from stage_activity, lookup occurence, update stage_activity
But (i assume) because of database/table locking only 20000 rows are read and buffered and no rows are updated.

I considered to use a group by step when importing the activities, but sorting 500k rows (and still growing), doesn't seem a wise decision.

Does anybody know a clever solution?
Should it help to use a lookup table for the iati-identifier, so I can update using an integer key?
table like (activity_key, identifier_key, identifier, occurence)

The data is only renewed daily (at most).

Hope somebody can help.

Jaap-Andre

LinearForwardSelection in Linux

$
0
0
Hi folks,
I hope someone here can help me on the following issue:
I’m using Cygwin terminal (the latest version) on Windows 7 (64-bit) and weka-3-7-10. I can recall Weka GUI chooser and use Explorer without any problem. The problem starts once I try to use LinearForwardSelection as a search method in linux command line (it works fine from Explorer). I’m using the following command:

$ java -cp $d/weka-3-7-10/weka.jar weka.classifiers.meta.AttributeSelectedClassifier -t data/RomanARFFdata/Roman.arff -i -E "weka.attributeSelection.CfsSubsetEval -P 1 -E 1" -S "weka.attributeSelection.LinearForwardSelection -D 0 -N 5 -I -K 50 -T 0" -W weka.classifiers.functions.LinearRegression -- -S 0 -R 1.0E-8

And I get this message: Weka exception: Can't find class called: weka.attributeSelection.LinearForwardSelection

Am I missing anything here? As said it seems the package is installed, as appears from package manager and also as I am able to use it through Explorer, but I can’t figure out what’s going wrong once I try to use Linux command line. I also reinstalled the package from package manager but still it doesn't work. To give you more idea on this, if I choose a search method other than LinearForwardSelection (such as BestFirst) in the above command, everything works fine.

Any thought is appreciated.

Cheers,
Mohamad

"Unique Connections" not really unique sometimes

$
0
0
I am using Kettle GA 5.0.1-stable. I have a transformation with several sub-transformations. Each of these transformations is set to use "Unique Connections" by checking the "Make the transformation database transactional" under the Transformation Settings dialog. I am connecting to MySQL 5.0.41 database using the jdbc connector version 5.1.28. And I am using JNDI jdbc.properties to specify my connection properties. When everything goes well, the transformation succeeds and commits to the database at the end, as expected. But once in a while (on an average 1 in 5 times), the transformation fails for the following reasons:
1) Foreign key constraint violation
2) Database deadlock during INSERT/UPDATE

After spending several days of debugging at the MySQL level (by enabling general query logging) and configuring log4jdbc-log4j2 in Kettle, I have found that whenever one of the above two issues happen, Kettle has *surely* got the *wrong* database connection. I can see that the step that fails for the above 2 mentioned issues is using a different connection instance for the same JNDI, than the rest of the steps having the same JNDI configuration. I was expecting that, by using unique connections setting, there will be one and only one connection used by the entire transformation. I don't know how Kettle got the wrong connection for a step and that too only sometimes, though all my transformation and settings are correctly using the same JNDI name for connecting to the database.

Any suggestions on where to look for resolving this issue?
Viewing all 16689 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>