Quantcast
Channel: Pentaho Community Forums
Viewing all articles
Browse latest Browse all 16689

Memory error

$
0
0
Hi all,

I need your help as always:

Finally I 've done a JOB that generate a SOAP request to Oracle CRMoD, get the XML, parse it and save it to a table.

These are the operations:

1. Truncate target table "B"
2. Evaluate if there are any record to be requested in the table "A"
3. Trasformation that take the 1st record from table "A" and do a SOAP request and save the collected data in table "B"
4. Update of table "A" of the processed record.



Now here is the problem:
After 272 processed (and always after 272 processed records) I receive a JAVA Out of Memory error.
I've tried to modify the script Spoon.bat in the following way:
Code:

if "%PENTAHO_DI_JAVA_OPTIONS%"=="" set PENTAHO_DI_JAVA_OPTIONS="-Xms6g" "-Xmx6g" "-XX:MaxPermSize=4g"
Of course with no luck!
This wouldn't be a problem... the MAIN problem is that the process keeps running until I have another error related to the GC Memory, then process dies.
At the moment I've set up the same job with a twist...
The Job counts how many records had been processed and after 270 there is another evaluate step that do an ABORT on the current job.
Then I've cheated on Windows Task Scheduler to launch the process every minute (of course if the job isn't already running).

Does anybody has a better approach ?


Thanks

P.S. If you need any help with the SOAP request just ask.

Viewing all articles
Browse latest Browse all 16689

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>