Quantcast
Channel: Pentaho Community Forums
Viewing all 16689 articles
Browse latest View live
↧

Import users and roles from the Pentaho Enterprise Edition

March 15, 2018, 2:05 am
$
0
0
Hi, I currently use the Pentaho Enterprise Edition server (versione 7). If I will install the Pentaho Community server, is there a way to import users and profiles from the Pentaho Enterprise Edition server?


These 3 dbs exist: Jackrabbit, Hibernate and quartz, but which of the three contains the information on the profiles?I await your help

Best Regards
↧
Search

Pentaho DI: Free?

March 15, 2018, 5:27 am
$
0
0
Hi!

I apologize for the basic question, but would like to know if any version of Pentaho DI is free for use in companies.
In the website of pentaho this information is not very clear.
I downloaded version 8.0 from sourceforge and apparently there are no licenses or anything like that.

Thank you!
↧
↧

Conversion Problema - The maximum length of cell contents (text) is 32,767 characters

March 15, 2018, 6:38 am
$
0
0
I'm trying to pass from a csv file to a XLSX (Excel 2007 and Above) but i get an error "Error writing field (15,3356) : java.lang.IllegalArgumentException: The maximum length of cell contents (text) is 32,767 characters".

I Know this is a Excel limitation.

Any solution for this problem?

Thanks
↧

How to differentiate same attribute in xml ???

March 15, 2018, 4:19 am
$
0
0
Quote:
<component> <section>
<templateId root="2.16.840.1.113883.10.20.22.2.6" />
<templateId root="2.16.840.1.113883.10.20.22.2.6" extension="2015-08-01" />
<templateId root="2.16.840.1.113883.10.20.22.2.6.1" />
<templateId root="2.16.840.1.113883.10.20.22.2.6.1" extension="2015-08-01" />
<id root="4AC08EA4-181A-11E8-B5A3-E60446556304" />
<code code="48765-2" codeSystem="2.16.840.1.113883.6.1" codeSystemName="LOINC" displayName="Allergies, Adverse Reactions, Alerts" />
<title>Allergies</title>
<text>
<table>
<thead>
<tr>
<th>Active Allergy</th>
<th>Reactions</th>
<th>Severity</th>
<th>Noted Date</th>
<th>Comments</th>
</tr>
</thead>
<tbody>
<tr ID="allergy2">
<td ID="allergy2allergen">Adhesive Tape-Silicones</td>
<td>
<content ID="allergy2reaction1">Red skin color</content>
</td>
<td ID="allergy2severity">Low</td>
<td>04/30/2012</td>
<td ID="allergy2comments">
<paragraph>Skin gets red and irritated</paragraph>
</td>
</tr>
<tr ID="allergy3">
<td ID="allergy3allergen">Aspirin</td>
<td>
<content ID="allergy3reaction1">Nausea</content>
</td>
<td ID="allergy3severity">Low</td>
<td>07/17/2012</td>
<td ID="allergy3comments" />
</tr>
<tr ID="allergy4">
<td ID="allergy4allergen">Hydrocodone</td>
<td>
<content ID="allergy4reaction1">Hives</content>
</td>
<td ID="allergy4severity">High</td>
<td>10/04/2016</td>
<td ID="allergy4comments" />
</tr>
<tr ID="allergy5">
<td ID="allergy5allergen">Iodine</td>
<td />
<td ID="allergy5severity">Low</td>
<td>04/30/2012</td>
<td ID="allergy5comments">
<paragraph>Unknown reaction. Allergy identified in childhood</paragraph>
</td>
</tr>
<tr ID="allergy6">
<td ID="allergy6allergen">Latex</td>
<td>
<content ID="allergy6reaction1">Rash</content>
</td>
<td ID="allergy6severity">High</td>
<td>09/16/2015</td>
<td ID="allergy6comments" />
</tr>
<tr ID="allergy7">
<td ID="allergy7allergen">Peanut</td>
<td>
<content ID="allergy7reaction1">Acne</content>
</td>
<td ID="allergy7severity" />
<td>10/06/2016</td>
<td ID="allergy7comments" />
</tr>
<tr ID="allergy8">
<td ID="allergy8allergen">Penicillin</td>
<td>
<content ID="allergy8reaction1">Rash</content>
</td>
<td ID="allergy8severity">High</td>
<td>09/22/2015</td>
<td ID="allergy8comments" />
</tr>
<tr ID="allergy9">
<td ID="allergy9allergen">Sulfa (Sulfonamide Antibiotics)</td>
<td>
<content ID="allergy9reaction1">Hives</content>
</td>
<td ID="allergy9severity">High</td>
<td>04/30/2012</td>
<td ID="allergy9comments" />
</tr>
<tr ID="allergy10">
<td ID="allergy10allergen">Tetracycline</td>
<td>
<content ID="allergy10reaction1">Stomach ache</content>
</td>
<td ID="allergy10severity">Low</td>
<td>04/30/2012</td>
<td ID="allergy10comments" />
</tr>
</tbody>
</table>
</text>
</section>
</component>


how to get value of different <td> values from this?????
↧

Text File Output Performance Optimizations

March 15, 2018, 1:41 pm
$
0
0
We have a transformation that runs a query, does a bunch of lookups and then writes the in-memory stream to text files (CSV) on the PDI server using Text file output step. We are running into performance issues outputting a small volume of ~3 million rows.

The flow is

  • Redshift query using table input step - ~ 6 minutes
  • Approximately 30 Look up steps - ~ 3 minutes
  • Write in memory data in text files (to folder on PDI server or AWS S3) ~ 20 minutes.


After the last look up step finishes around the 9th minute, the Text File output step crawls for another 11 minutes or so - and hence a total of 20 minutes.

Also tried using the No. Of Copies step but that has not helped. There has to be a better way to write output files. Any help or pointers around speeding the Text file output step would be really appreciated. Thanks in advance.
↧
↧

One input to multiples outputs

March 15, 2018, 6:28 pm
$
0
0
Hey everybody,

So I'm having a challenge to figure out what's the best way to get one .CSV (input) and have multiple outputs based on a specific parameter. For example, let's say I have a system that register all sales transactions from my company. Something like this:

SALESMAN TRANSACTION TYPE DATE AMOUT
David New Contract
2/3/15
$5,000.00
David Recurring Fee
2/5/15
$3,400.00
Abner New Contract
2/8/15
$2,000.00
David End of Contract
2/12/15
-$3,500.00
Mary Recurring Fee
2/15/15
$7,000.00
Abner Recurring Fee
2/18/15
$2,100.00
Mary New Contract
2/22/15
$13,000.00
Mary Recurring Fee
2/25/15
$2,200.00


My question is, how can I have an output where I would get one file just for David, another for Abner and a third file for Mary with their own individual transactions?

Please, have in mind that the system has over 200 hundreds Salesman.

Thanks!!!!
↧

Mail step: Using variable as destination address causes Invalid Address error

March 16, 2018, 7:17 am
$
0
0
Posted this on the Vantara community page but thought it would be worth a shot here too

Just wondering if anyone else has come across this problem

I have a job that generates a user's email by getting the user who last modified an excel file. I then set this address as a variable called USER_EMAIL. I then have ${USER_EMAIL} in the destination box of the mail step.

If I run the job directly in PDI, it works fine. I created a bat file in order to schedule the job using Windows task scheduler. If I launch the bat file directly, it also works fine however if Task scheduler opens it, I get an Invalid Address error. It appears that the variable is not being substituted

This is the error from the log:

Code:
2018/03/16 09:44:38 - Success Mail - ERROR (version 8.0.0.0-28, build 8.0.0.0-28 from 2017-11-05 07.27.50 by buildguy) : Problem while sending message: javax.mail.SendFailedException: Invalid Addresses;  nested exception is:
com.sun.mail.smtp.SMTPAddressFailedException: 501 5.1.3 Invalid address


2018/03/16 09:44:38 - Success Mail - ERROR (version 8.0.0.0-28, build 8.0.0.0-28 from 2017-11-05 07.27.50 by buildguy) :    ** Invalid Addresses

2018/03/16 09:44:38 - Success Mail - ERROR (version 8.0.0.0-28, build 8.0.0.0-28 from 2017-11-05 07.27.50 by buildguy) :          ${USER_EMAIL}



↧

lazy conversion

March 17, 2018, 7:44 am
$
0
0
I understand that one of the advantages of using the lazy conversion option is that it speeds up performance for large records that have many fields in the file layout.

I am wondering if it makes sense to use the lazy conversion option if I have:
1) Records that have 20 fields or less
2) Flle containing 7,000 records
3) Passing data from one Text File to Oracle database (Or is the lazy conversion option works best for passing data from input file to output file?)

The bottom line is that I'd like to know the best practice of using the lazy conversion option.

Thanks,

Claudia
↧
Search

Parsing XML with repeating elements

March 18, 2018, 12:28 pm
$
0
0
Hi all,

I have a problem to parse a XML content I got from WebServices lookup step (Magento result). The content is as follows
<SOAP-ENV:Body>
<ns1:callResponse>
<callReturn SOAP-ENC:arrayType="ns2:Map[78]" xsi:type="SOAP-ENC:Array">
<item xsi:type="ns2:Map">
<item>
<key xsi:type="xsd:string">product_id</key>
<value xsi:type="xsd:string">9088</value>
</item>
<item>
<key xsi:type="xsd:string">sku</key>
<value xsi:type="xsd:string">15861</value>
</item>
<item>
<key xsi:type="xsd:string">name</key>
<value xsi:type="xsd:string">part1</value>
</item>
<item>
<key xsi:type="xsd:string">set</key>
<value xsi:type="xsd:string">4</value>
</item>
<item>
<key xsi:type="xsd:string">type</key>
<value xsi:type="xsd:string">simple</value>
</item>
<item>
<key xsi:type="xsd:string">category_ids</key>
<value SOAP-ENC:arrayType="xsd:ur-type[0]" xsi:type="SOAP-ENC:Array"/>
</item>
<item>
<key xsi:type="xsd:string">website_ids</key>
<value SOAP-ENC:arrayType="xsd:string[1]" xsi:type="SOAP-ENC:Array">
<item xsi:type="xsd:string">1</item>
</value>
</item>
</item>
<item xsi:type="ns2:Map">
<item>
<key xsi:type="xsd:string">product_id</key>
<value xsi:type="xsd:string">9109</value>
</item>
<item>
<key xsi:type="xsd:string">sku</key>
<value xsi:type="xsd:string">15882</value>
</item>
<item>
<key xsi:type="xsd:string">name</key>
<value xsi:type="xsd:string">part2</value>
</item>
<item>
<key xsi:type="xsd:string">set</key>
<value xsi:type="xsd:string">4</value>
</item>
<item>
<key xsi:type="xsd:string">type</key>
<value xsi:type="xsd:string">simple</value>
</item>
<item>
<key xsi:type="xsd:string">category_ids</key>
<value SOAP-ENC:arrayType="xsd:ur-type[0]" xsi:type="SOAP-ENC:Array"/>
</item>
<item>
<key xsi:type="xsd:string">website_ids</key>
<value SOAP-ENC:arrayType="xsd:string[1]" xsi:type="SOAP-ENC:Array">
<item xsi:type="xsd:string">1</item>
</value>
</item>
</item>
......
Is there a way to simply get data in following colums?
product_id, SKU, name, set

Any help will be appreciated. Thank you very much
Magdalena
↧
↧

PDI Client received SOAP Fault from server

March 19, 2018, 5:07 pm
$
0
0
I recently setup the PDI 8 with BA-Server repository.
However, I can't save the transformations or jobs. The error log is attached.
Thanks for any help.
André.

OS: CentOS 6.9
BA-Server CE 8 (Production Mode Config)
PDI 8



It's the log:


java.lang.reflect.InvocationTargetException: Error saving transformation: org.pentaho.di.core.exception.KettleException:
Unable to save repository element [/home/admin/pdi_repository/rScript]


Unable to load transformation with id [983980c3-b4b6-477d-b8fd-d31cbbc81211]


Unable to read shared objects from repository


Unable to load shared objects
Client received SOAP Fault from server: exception while getting data for file with id "2b62f4a3-0b1c-4b61-bc2b-e283ffc99f8e"


Reference number: d388b809-c508-4cf3-8a1d-8fb8459b40a5 Please see the server log to find more detail regarding exact cause of the failure.








at org.pentaho.di.ui.spoon.dialog.SaveProgressDialog$1.run(SaveProgressDialog.java:74)
at org.eclipse.jface.operation.ModalContext$ModalContextThread.run(ModalContext.java:113)
Caused by: org.pentaho.di.core.exception.KettleException:
Unable to save repository element [/home/admin/pdi_repository/rScript]


Unable to load transformation with id [983980c3-b4b6-477d-b8fd-d31cbbc81211]


Unable to read shared objects from repository


Unable to load shared objects
Client received SOAP Fault from server: exception while getting data for file with id "2b62f4a3-0b1c-4b61-bc2b-e283ffc99f8e"


Reference number: d388b809-c508-4cf3-8a1d-8fb8459b40a5 Please see the server log to find more detail regarding exact cause of the failure.








at org.pentaho.di.repository.pur.PurRepository.save(PurRepository.java:1952)
at org.pentaho.di.repository.pur.PurRepository.save(PurRepository.java:1920)
at org.pentaho.di.repository.AbstractRepository.save(AbstractRepository.java:126)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.pentaho.di.ui.repo.RepositorySessionTimeoutHandler.invoke(RepositorySessionTimeoutHandler.java:71)
at com.sun.proxy.$Proxy87.save(Unknown Source)
at org.pentaho.di.ui.spoon.dialog.SaveProgressDialog$1.run(SaveProgressDialog.java:70)
... 1 more
Caused by: org.pentaho.di.core.exception.KettleException:
Unable to load transformation with id [983980c3-b4b6-477d-b8fd-d31cbbc81211]


Unable to read shared objects from repository


Unable to load shared objects
Client received SOAP Fault from server: exception while getting data for file with id "2b62f4a3-0b1c-4b61-bc2b-e283ffc99f8e"


Reference number: d388b809-c508-4cf3-8a1d-8fb8459b40a5 Please see the server log to find more detail regarding exact cause of the failure.






at org.pentaho.di.repository.pur.PurRepository.loadTransformation(PurRepository.java:2843)
at org.pentaho.di.repository.pur.PurRepository.saveTransOrJob(PurRepository.java:3049)
at org.pentaho.di.repository.pur.PurRepository.saveKettleEntity(PurRepository.java:2975)
at org.pentaho.di.repository.pur.PurRepository.saveTrans(PurRepository.java:2066)
at org.pentaho.di.repository.pur.PurRepository.save(PurRepository.java:1930)
... 10 more
Caused by: org.pentaho.di.core.exception.KettleException:
Unable to read shared objects from repository


Unable to load shared objects
Client received SOAP Fault from server: exception while getting data for file with id "2b62f4a3-0b1c-4b61-bc2b-e283ffc99f8e"


Reference number: d388b809-c508-4cf3-8a1d-8fb8459b40a5 Please see the server log to find more detail regarding exact cause of the failure.




at org.pentaho.di.repository.pur.PurRepository.loadAndCacheSharedObjects(PurRepository.java:1732)
at org.pentaho.di.repository.pur.PurRepository.readTransSharedObjects(PurRepository.java:1792)
at org.pentaho.di.repository.pur.PurRepository.loadTransformation(PurRepository.java:2833)
... 14 more
Caused by: org.pentaho.di.core.exception.KettleException:
Unable to load shared objects
Client received SOAP Fault from server: exception while getting data for file with id "2b62f4a3-0b1c-4b61-bc2b-e283ffc99f8e"


Reference number: d388b809-c508-4cf3-8a1d-8fb8459b40a5 Please see the server log to find more detail regarding exact cause of the failure.


at org.pentaho.di.repository.pur.PurRepository.readSharedObjects(PurRepository.java:1282)
at org.pentaho.di.repository.pur.PurRepository.loadAndCacheSharedObjects(PurRepository.java:1727)
... 16 more
Caused by: com.sun.xml.ws.fault.ServerSOAPFaultException: Client received SOAP Fault from server: exception while getting data for file with id "2b62f4a3-0b1c-4b61-bc2b-e283ffc99f8e"


Reference number: d388b809-c508-4cf3-8a1d-8fb8459b40a5 Please see the server log to find more detail regarding exact cause of the failure.
at com.sun.xml.ws.fault.SOAP11Fault.getProtocolException(SOAP11Fault.java:193)
at com.sun.xml.ws.fault.SOAPFaultBuilder.createException(SOAPFaultBuilder.java:131)
at com.sun.xml.ws.client.sei.StubHandler.readResponse(StubHandler.java:253)
at com.sun.xml.ws.db.DatabindingImpl.deserializeResponse(DatabindingImpl.java:203)
at com.sun.xml.ws.db.DatabindingImpl.deserializeResponse(DatabindingImpl.java:290)
at com.sun.xml.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:119)
at com.sun.xml.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:92)
at com.sun.xml.ws.client.sei.SEIStub.invoke(SEIStub.java:161)
at com.sun.proxy.$Proxy116.getDataAsNodeForReadInBatch(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.pentaho.di.repository.pur.UnifiedRepositoryInvocationHandler.invoke(UnifiedRepositoryInvocationHandler.java:39)
at com.sun.proxy.$Proxy117.getDataAsNodeForReadInBatch(Unknown Source)
at org.pentaho.platform.repository2.unified.webservices.jaxws.UnifiedRepositoryToWebServiceAdapter.getDataForReadInBatch(UnifiedRepositoryToWebServiceAdapter.java:204)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.pentaho.di.repository.pur.UnifiedRepositoryInvocationHandler.invoke(UnifiedRepositoryInvocationHandler.java:39)
at com.sun.proxy.$Proxy104.getDataForReadInBatch(Unknown Source)
at org.pentaho.di.repository.pur.PurRepository.readSharedObjects(PurRepository.java:1246)
... 17 more





↧

Update step is not working when column is missed

March 20, 2018, 8:38 am
$
0
0
Hi Sir,Madam,


We are trying to to load data from text file input to Update step. actually few columns are not exist in DB and when we are running the ETL's,
it didn't thorow any error,hope kettle should throw error like , column is missed or some other relevant message.


We cleared DB cache from (Tools -> Database -> Clear Cache and Tools -> Repository -> Clear Shared objective Cache)

sorry, i am unable to add transformation, previously we used to have option for attachment but i am not able see the option now

[IMG]C:\Users\raminalamalpu\Desktop\fact.png[/IMG]


Thanks
↧

Launch Transformation in Remote server

March 21, 2018, 6:07 am
$
0
0
Hello,

We have set up a server in which we have installed a copy of PDI and we have stored a transformation/job. The server requires authentication.

We want to create a .bat file that everyone in our team has stored locally. When the .bat file is launched, the the following happens:

(1) Connect to the remote server
(2) launch the PDI installed in the server
(3) launch the transformation/job stored in the server

Can anyone help me on how to do this? We have thought to do this using a a .bat file but probably there is a better way to do so.

Thanks in advance.
↧

list filenames

March 21, 2018, 10:05 am
$
0
0
How to list filenames which is available in browser

Get filenames and directories with http url is not working with username and password.

http://username:password@URL

Can anyone suggest the solution will it be possible to do it by using the GetFilenames step or by with different step
↧
↧

Amazon S3 - XMLBuilder

March 22, 2018, 10:32 am
$
0
0
Hello EveryBody,

Currently I was use the S3 File Output Transformation ans then follow the next step:

1) Insert Acces Key
2) Insert Secret Key
3) Browse the folder and select and PDI shoe me the followint error:

2018/03/22 14:20:52 - Spoon - ERROR (version 8.0.0.0-28, build 8.0.0.0-28 from 2017-11-05 07.27.50 by buildguy) : java.lang.NoClassDefFoundError: com/jamesmurty/utils/XMLBuilder
2018/03/22 14:20:52 - Spoon - at org.jets3t.service.ServiceException.getXmlMessageAsBuilder(ServiceException.java:270)
2018/03/22 14:20:52 - Spoon - at org.jets3t.service.impl.rest.httpclient.RestStorageService.performRequest(RestStorageService.java:543)
2018/03/22 14:20:52 - Spoon - at org.jets3t.service.impl.rest.httpclient.RestStorageService.performRequest(RestStorageService.java:277)
2018/03/22 14:20:52 - Spoon - at org.jets3t.service.impl.rest.httpclient.RestStorageService.performRestGet(RestStorageService.java:1090)
2018/03/22 14:20:52 - Spoon - at org.jets3t.service.impl.rest.httpclient.RestStorageService.performRestGet(RestStorageService.java:1062)
2018/03/22 14:20:52 - Spoon - at org.jets3t.service.impl.rest.httpclient.RestStorageService.getObjectImpl(RestStorageService.java:2253)
2018/03/22 14:20:52 - Spoon - at org.jets3t.service.impl.rest.httpclient.RestStorageService.getObjectImpl(RestStorageService.java:2190)
2018/03/22 14:20:52 - Spoon - at org.jets3t.service.StorageService.getObject(StorageService.java:1167)
2018/03/22 14:20:52 - Spoon - at org.jets3t.service.S3Service.getObject(S3Service.java:2674)
2018/03/22 14:20:52 - Spoon - at org.jets3t.service.S3Service.getObject(S3Service.java:89)
2018/03/22 14:20:52 - Spoon - at org.jets3t.service.StorageService.getObject(StorageService.java:552)
2018/03/22 14:20:52 - Spoon - at org.jets3t.service.S3Service.getObject(S3Service.java:1468)
2018/03/22 14:20:52 - Spoon - at org.pentaho.s3.vfs.S3FileObject.getObjectFromS3(S3FileObject.java:142)
2018/03/22 14:20:52 - Spoon - at org.pentaho.s3.vfs.S3FileObject.doGetType(S3FileObject.java:215)
2018/03/22 14:20:52 - Spoon - at org.apache.commons.vfs2.provider.AbstractFileObject.getType(AbstractFileObject.java:1517)
2018/03/22 14:20:52 - Spoon - at org.pentaho.vfs.ui.VfsFileChooserDialog.updateParentFileCombo(VfsFileChooserDialog.java:1004)
2018/03/22 14:20:52 - Spoon - at org.pentaho.vfs.ui.VfsFileChooserDialog.open(VfsFileChooserDialog.java:512)
2018/03/22 14:20:52 - Spoon - at org.pentaho.di.ui.vfs.VfsFileChooserHelper.browse(VfsFileChooserHelper.java:117)
2018/03/22 14:20:52 - Spoon - at org.pentaho.di.ui.vfs.VfsFileChooserHelper.browse(VfsFileChooserHelper.java:97)
2018/03/22 14:20:52 - Spoon - at org.pentaho.amazon.s3.S3FileOutputDialog$27.widgetSelected(S3FileOutputDialog.java:1198)
2018/03/22 14:20:52 - Spoon - at org.eclipse.swt.widgets.TypedListener.handleEvent(Unknown Source)
2018/03/22 14:20:52 - Spoon - at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)


Please anybody can help me please.

Best Regards.
↧

Copy Files Step in Pentaho

March 22, 2018, 11:14 pm
$
0
0
Copy Files Step in Pentaho

replacing variable wrong in copy file step in pentaho. For example: VAR1 is replaces by /CURRENT_PATH/$VAR1 value printed logs .

any suggestion please?
↧
Search

Insert Carriage Return

March 23, 2018, 5:42 am
$
0
0
Is there any way to insert a carriage return in PDI?

I have two strings and I want to concatenate both strings but inserting in the middle a carriage return.

Example:

String1: "My name is David and"
String2: "I am 20 years old"

FinalString:

"My name is David
and I am 20 years old"

Can anyone help me on how to do this?
↧

Auto increment data based on column

March 23, 2018, 8:53 am
$
0
0
Hi Sir,Madam,

PDI 6.1, JAVA 1.7, MySQL DB.
I want to add my sample transformation and my sample excel file to explain in-detailed about my logic but PDI forum is not allowing me to add any objects. Sorry for that. below is my excel data.

PRODUCT DESCRIPTION UNITS
F00001 added 350
I need to generate rows 350 times based on UNITS column.

example: While generating the 350 rows PRODUCT column data i.e. should start fromF00001 and end with value F0000350 that means, record should auto increment based on UNITS column. I am able to generate 350 rows using Clone row step but not able to increment the value. Could you please help on this scenario.

expected output :

PRODUCT DESCRIPTION UNITS
F00001 added 350
F00002 added 350
F00003 added 350
F00004 added 350
F00005 added 350
F00006 added 350
.
.
.
F0000350 added 350
Thanks,
Santhi
↧
↧

Where to download SAP HANA Bulk Loader plugin?

March 23, 2018, 10:36 am
↧

Rollback on DB2 with Delete steps

March 26, 2018, 4:51 am
$
0
0
I designed a jobs, transformations combination, that takes a list of ids that need to be deleted from other tables, for each id at the same time. The transformation that does eventually do the deletion has 14 delete steps and two update steps. Because this is too slow for 2 million ids, I start the delete transformation with a package of 500 ids and the transformation gets run in parallel, 10 times. The amount of deletions a single started transformation does is well within the limits of the rollback log. If I track the number of deleted rows, I can see, that all rows got deleted and no errors were thrown. After the top job is finished I can see that the number of deleted rows dwindles constantly to about the original number minus 200.000 rows. So, I seem to be running into a database problem, maybe just DB2, that seems like the rollback log gets filled to the brim and almost everything gets rolled back. It seems that it does not matter whether I check "Make the transformation database transactional" or not and I would prefer to check it.

Do I run into a bug or is there a logical flaw?
↧

Calling REST AIP with pagination

March 27, 2018, 7:48 pm
$
0
0
I have a REST api call to extract data periodically.
The API has pagination, one time return back 50 rows or something.

Let say I'm calling http://www.blabla.com/pageid=1

The return format is in json like below
{
"data" :
[
{"field1": "field value", "field2": "field2 value"},
{"field1": "field value", "field2": "field2 value"},
{"field1": "field value", "field2": "field2 value"},
..
]
,
"total" : 80
"prev_url": "http://www.blabla.com/pageid=1",
"next_url": "http://www.blabla.com/pageid=3"
}


I need to repeat the REST call till the next_url value is empty.
How can I achieve that in PDI?


Any suggestion is appreciated.
Thanks.
↧
Viewing all 16689 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>