Quantcast
Channel: Pentaho Community Forums
Viewing all 16689 articles
Browse latest View live
↧

PDI 7.1 Sybase IQ 12.7

March 8, 2018, 6:20 am
$
0
0
Hi everyone,

I was wondering if someone could help me with this. I am running on PDI 7.1 (I also tested this on PDI 8.0) a query with a table input step to a Sybase IQ 12.7 DB. If I use a top 1 or top 1000 everything works fine. Even up to top 1000000, but if I remove the top it doesn't do anything. I waited 30 minutes until I decided to cancel it. It seems like this is loading the whole result set in memory before it does anything else. Is it possible to change that?
I am using jconn3.jar and jconn4.jar and both of them take a long time to start. So far, the only way to get this to work is by using pan.bat. I still have to wait and it sometimes fails as well (I have waited over 1 hour), but at least it sometimes works.

Any ideas?

Cheers.
↧
Search

Write email attachments to filesystem fails

March 8, 2018, 7:38 am
$
0
0
Hello,

I have to process emails with attachments. Processing the email body works fine. I write the attachments of the email with the job step "Get mails (Pop3/IMAP)" to a given and existing folder on the Windows server. This works fine as long as the filename of the attachments only contain "nice" characters like letters, numbers or the . (dot) for the extension. Whenever the filename of an attachment contains characters like parentheses or umlauts, the job step crashes, because the step tries to transform the filename to UTF-8 and produces a filename which cannot be written to the Windows filesystem. The transformation of the filename is not necessary. I am able to copy those files with the special characters in the filename to the filesystem manually.

I don't find a way to make the job step "Get mails (POP3/IMAP)" to ignore special characters in the filename of attachments and write them just the way they are to the Windows filesystem.

Has anyone the same issue and a solution?

Best Regards
Volker
↧
↧

Replace in string Whole Word confusion

March 8, 2018, 8:09 am
$
0
0
Okay so I have some values coming in for numeric fields. Sometimes I get just a plain period and sometimes I get actual numerical values such as 12.34

I want to replace the periods when it is only a period in that field, because this is being loaded into redshift into a numeric column and trying to insert a period makes it fail

When I tried a string replace to do periods to 0's, it did the following:

. --> 0
12.34 --> 12034

Then I tried the option for Whole Word set to Y because I though it would use the logic "only replace if the entire field value matches the search field". However it gave me this:

. --> .
12.34 --> 0


Am I doing something wrong or is there an option to only replace when the entire value is a thing. I don't want to do a massive string of filters and replaces...
↧

How to prevent a job from running (Windows Scheduler) if it hasn't already finished?

March 8, 2018, 1:22 pm
$
0
0
Hello,
I have scheduled our Pentaho jobs to run using Windows Task Scheduler which invokes a batch file. (Job is scheduled to run every 2 hours)
The batch file just contains the curl command like : curl -L "http://cluster:cluster@xx.xx.xxx.xxx:8081/kettle/runJob/?job=/prod/StartJobxxx"
Since this command just posts http request, the batch program exits immediately. In the Windows Task Scheduler, I have set the option "If the task is already running, then the following rule applies to "Do not start a new instance".

I would like the scheduled job to not kick off if one is already running (Our jobs take varying times to run depending on the volume being processed).How can I accomplish this? Any suggestions on your implementation would be really appreciated.

Our environment : Pentaho CE 7.1, File repository, Configured carte on port 8081 to run jobs and also to check the job status on PDI Status page. (I tried Kitchen scheduling but that doesn't provide me a PDI status page to check job status)


Thanks
Ravi
↧

Capture hop result in job level

March 8, 2018, 8:56 pm
$
0
0
Hello all,

I have one job that have lets say N different independent branch of transformation that run independently, once all transformation run successfully ONLY THAN after that I want to run one more transformation.
So is there a way I can capture HOP result or transformation status at JOB level so that if all well execute last transformation.
Please find image of the same problem, could you give better idea.
Attached Images
 
↧
↧

How to modify a field or add a field to an array of rows

March 9, 2018, 5:10 am
$
0
0
Hello,

I am using Pentaho 4 and I am using the Javascript step in a transform.
I am unable to upload the transform I am using. I have tried many different
things but did not keep track of previous steps since there have been so many.
Followed examples in this forum and via some Safari books.

My goal is to buffer all the rows that come in. Then to output these
rows but with a new field added that is either a "Y" or a "N". I am not
sure how to get this new field added and set its value. I can get it to output
the existing rows but cannot figure out how to add a new field with value before outputting.

Thank you

Code:
I have two tabs. One is the Start tab and one is the Transform tab.

--Start tab has
var parentrow = new Array();

--Transform tab has
trans_Status = SKIP_TRANSFORMATION;
parentrow.push(row); // buffering all the rows into an array


// lastrow comes from "identify last row in stream"
if (lastrow)
{

// some complex processing is done here to determine what value to set the added field value to.

    for (i=0; i<parentrow.length; i++)
    {
          // how to add and set new field to "Y" or "N" to the row and then output it??
          putRow(parentrow[i]);
    }
}
↧

Salesforce API 41.0

March 9, 2018, 6:13 am
$
0
0
Hello - is there a way for Pentaho 7.1 to support Salesforce API 41.0 in Salesforce Input step? By default the step uses https://login.salesforce.com/services/Soap/u/37.0, but we've migrated to use a higher Salesforce API version, and changing the Salesforce Webservice URL to https://login.salesforce.com/services/Soap/u/41.0 would give us an error:

'Cannot connect to Salesforce with username []. Please check username and password. Exception: Error connecting to Salesforce!
unable to find end tag at: START_TAG seen ...</orgDefaultCurrencyIsoCode><orgDefaultCurrencyLocale>... @1:901'


Thanks
↧

How to color the inside of the plot frame without overlaying the grid?

March 9, 2018, 8:31 am
$
0
0
Hello,

I made a dashboard with a lightgrey background (not a plain white one, like I usually do). As I dropped in my charts I realized they are actually transparent and therefore also the area inside the chart. I wanna highlight the inside area of the plot (inside the plotframe), so I tried to change that with my subpar knowledge of extension points and came across plot_fillStyle (plotBG_fillStyle didn't work). Unfortunately, using it covers up the automatic grid of the chart, which I definitely need.

Is there any way to get the grid above/on top of the white filling of the plot, am I using a completely wrong extension point or is there an entire different method to do this?
I could also be missing something pretty obvious. As I am away from work, I can only respond as of next Thursday.
Help would be appreciated.

I also attached a picture of what I have. (no fillings - left; plot_fillStyle=white - right)

Thanks in advance,
Raoul
Attached Images
 
↧
Search

Pentaho 7.1 AuditLog

March 11, 2018, 9:19 pm
$
0
0
I'm using Pentaho 7.1 and I have some questions

1) As I know, AuditLog file always being appended. Can I split Pentaho 7.1 AuditLog by max filesize in pentaho.xml?
2) (audit) log file better or log SQL better? If I use SQL log and it (Pentaho) insert too much data, introduce significant memory overhead, what can i do? how can I replace (in case of turn off)

Thank in advantage
↧
↧

PDI keeps complaining about data type conflict

March 12, 2018, 3:46 am
$
0
0
I am doing a database join in PDI 7 on SQL Server 2016. It keeps whining about a type conflict between the field from the database that is used for the lookup in relation to the string field. I have set all in the stream to String and used a CAST as nvarchar(16) in the database query and still it dares to say that one is a String and the other a Number. Where does this bug find its origin and how can I work around it without changing to a full load of the one side with a merge join?
↧

Log user access to reports

March 12, 2018, 9:54 am
$
0
0
Hi all.

Is it possible to log whenever users access reports using "Report designer" without using other tools ?

Thanks so much!
↧

Parsing variables in S3 output step

March 12, 2018, 11:25 am
$
0
0
In the S3 output step, I am trying to right append the file name text with a numeric variable and it does not parse it. It simply puts the ${vbatchid} in the file name on the S3 bucket. We are on version 6.1.0.16 Has anyone successfully parsed variable names using the S3 Output step ?
↧

Is this a bug? - Text file output line split

March 12, 2018, 9:59 pm
$
0
0
Hi,

I have a transformation file that is for some reason splitting and creating a new line from a description in a file. It splits mid word as opposed to something like a , or a ;. I cannot use a , as my delimiter as there are other descriptions that have ,'s in them. I am using a ; but this word does not include one. Attaching pictures of the line straight out of the database, my text file output properties, and how it looks in the final file.
↧
↧

MongoDB and Date Search

March 13, 2018, 2:04 am
$
0
0
Hi I am also facing similar kind of issue

My JSON query is (Mongo DB)
{ "timeStamp": { $gte: ISODate("2016-12-02T21:15:00.000+0000") },
$and: [ { "timeStamp": { $lte: ISODate("2016-12-06T21:15:00.000+0000") } } ],
"tag_id": { $ne: "Tag1} }
'

Tried following query also
{ "tag_id": "Tag1",
"timeStamp": ISODate("2016-05-02T14:40:00.000+0000") }
No result for above query as well

Not able to get any data

But when I use

{ "tag_id": "Tag1}

I get the desired data.I have tried your solution also.No result.

Kindly Support
↧

Convert String to Date

March 13, 2018, 3:20 am
$
0
0
Hi Everyone
I am also facing this problem and i need help
i have date with GMT And BST time zone i would to delete this on my csv file Monday, March 5, 2018 11:11:05 AM GMT , Thursday, September 21, 2017 5:30:54 PM BST
after deleting thhis GMT and BST , i would like to convert to date like mm/dd/yyyy hh:mm:ss or dd/mm/yyyy hh:mm:ss
↧
Search

Problem with plugin STPivot 4 - Pentaho Community v.8

March 13, 2018, 4:18 pm
$
0
0
Hi! I have installed Pentaho Bi-Server version 8.0 community edition, and got the STPivot 4 plugin from the marketplace. But when I choose a new STPivot view, the plugin is not working and show this error message.

Sorry, something went wrong
Please try again or contact your system administrator.


Anyone has the same problem?

Regards.
Caro.
↧

Excel Writer export as a Excel table

March 14, 2018, 3:27 am
$
0
0
Hi,

I am working on PDI (v7.1) and I am appending data into an excel sheet. Data is appending into the excel sheet perfectly but I need to copy it as a table (format= Excel table).

Is there anyway anybody can suggest me?

Thanks in advanced!!
↧
↧

Common Table Expressions

March 14, 2018, 11:28 am
$
0
0
I have been trying to use Common Table Expressions when writing SQL in PDI, but I receive errors. Is it possible to use them? If so, is there a setting or specific input type I need to use?
↧

Is Kerberos auth Enterprise only?

March 14, 2018, 7:33 pm
$
0
0
Saw this message "...As Kerberos authentication is an Enterprise-only feature in the Hadoop shims,..." on this ticket JIRA.

Can Matt or someone please confirm that Kettle with Kerberos can only be used on an Enterprise version.
Just need to know as I've been trying to figure it out on Community edition.

Thanks.
↧

Mongo DB with parameters

March 14, 2018, 11:14 pm
$
0
0
Hello
I am trying to use Parameters in my mongo db query
in Pentaho Report Designer 7.2

My JSON query is



{
"time" :
{ $gte :
{ $date : "2016-05-02T15:10:00Z" }
},
"time" :
{ $lte :
{ $date : "2016-05-02T15:50:00Z" }
},
"tag_id": "${TagName}"
}




where TagName is my properties are

Parameters are:-
Name:-TagName
Label:-TagName
Display Type:-Dropdown
Query:-MongoQuery
value:-tag_name


I am not able to get desired data.Kindly Support.
↧
Viewing all 16689 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>