close
↧
[pdi] 指数の取り扱い
↧
指数の含まれたcsvファイルの取り扱い
こんにちは。
ETLで取り込むCSVファイルについてご教示ください。
やりたいこと
-1.23457E-05のような指数の含まれたCSVを取り込み、数値として扱いたい
・このような場合Stringで取り込むしかないのでしょうか。
・Stringで取り込んだ場合、-0.0000123456789へ変換するにはどうすれば良いでしょうか。
変換可能なステップがあるのでしょうか。もしくはJavaScriptで変換になるのでしょうか。
以上、よろしくお願いいたします。
Spoon version 6.0.1.0-386
ETLで取り込むCSVファイルについてご教示ください。
やりたいこと
-1.23457E-05のような指数の含まれたCSVを取り込み、数値として扱いたい
・このような場合Stringで取り込むしかないのでしょうか。
・Stringで取り込んだ場合、-0.0000123456789へ変換するにはどうすれば良いでしょうか。
変換可能なステップがあるのでしょうか。もしくはJavaScriptで変換になるのでしょうか。
以上、よろしくお願いいたします。
Spoon version 6.0.1.0-386
↧
↧
New Reporting Platform - Suggestions, Use Cases?
I would like to present the following use case and ask for suggestions on the best approach we can use in this situation:
My company provides customized reports on demand to our customers.
Customers buy new customized reports on our database. They will be available in the administrative environment of each client on our site. These reports are developed by us and implemented in VBA (Word and Excel). Usually, we develope a stored procedure that will provide data to the report and VBA is used to run the stored procedure and supply data to a spreadsheet or word document. VBA is dealing with a report queue and sending e-mail to customers with these reports attached. This structure has existed for about 12 years and we believe that it is necessary to improve this proccess. The main problem is the VBA instability to the volume of cases, high volume of decentralized code and difficult to maintain (typical procedural code).
We would like to implement improvements that will improve the quality and delivery time of these projects. Especially ensuring stability in the processing of reports and better error handling, among other expectations we have. And I would like to read suggestions and use cases that can assist us in making decisions.
Our doubts and ways we think of tread:
1) Replacement of VBA technology for a modern platform that adds time and quality in the generation of reports, since VBA is quite unstable. Including the SERVER and also SUBMITTED REPORT. We thought of many options: Jasper Reports, Pentaho, Crystal .. and continue research, but still no conclusive results, since I must ensure that the new technology could replace the VBA in everything he does;
2) The creation of stored procedures for data extraction for the report is the same as the best one? Or should we start from for BI tools that can assist in data extraction more efficiently? Something to help us to configure the data extractions easier.
Our plataform:
1. SQL SERVER;
2. Windows machine with VBA runing (control the report queue and proccess/generate reports).
We are open to platform changes. But with respect to use another database management system, it can be a little tricky… as in most cases, I believe.
What do you recommend? What usually employ on your company? Your suggestions will be most welcome!
thank you
My company provides customized reports on demand to our customers.
Customers buy new customized reports on our database. They will be available in the administrative environment of each client on our site. These reports are developed by us and implemented in VBA (Word and Excel). Usually, we develope a stored procedure that will provide data to the report and VBA is used to run the stored procedure and supply data to a spreadsheet or word document. VBA is dealing with a report queue and sending e-mail to customers with these reports attached. This structure has existed for about 12 years and we believe that it is necessary to improve this proccess. The main problem is the VBA instability to the volume of cases, high volume of decentralized code and difficult to maintain (typical procedural code).
We would like to implement improvements that will improve the quality and delivery time of these projects. Especially ensuring stability in the processing of reports and better error handling, among other expectations we have. And I would like to read suggestions and use cases that can assist us in making decisions.
Our doubts and ways we think of tread:
1) Replacement of VBA technology for a modern platform that adds time and quality in the generation of reports, since VBA is quite unstable. Including the SERVER and also SUBMITTED REPORT. We thought of many options: Jasper Reports, Pentaho, Crystal .. and continue research, but still no conclusive results, since I must ensure that the new technology could replace the VBA in everything he does;
2) The creation of stored procedures for data extraction for the report is the same as the best one? Or should we start from for BI tools that can assist in data extraction more efficiently? Something to help us to configure the data extractions easier.
Our plataform:
1. SQL SERVER;
2. Windows machine with VBA runing (control the report queue and proccess/generate reports).
We are open to platform changes. But with respect to use another database management system, it can be a little tricky… as in most cases, I believe.
What do you recommend? What usually employ on your company? Your suggestions will be most welcome!
thank you
↧
Mysql y Cubo Modrian - Problema en schema Workbench
Estimados,
Gracias por leer este post, soy uno mas de los que se inician en pentaho y ven mucho potencial en esta herramienta, tengo un mysql y via SW, cree el siguiente cubo de 2 dimensiones y 2 metricas, con un modelo Fact_ventas, Dim_Producto y Dim_vendedor, algo sencillo
<Schema name="Esquema Ventas">
<Dimension type="StandardDimension" visible="true" name="Dim_vendedor">
<Hierarchy name="vendedor" visible="true" hasAll="true">
<Table name="dim_vendedor" alias="">
</Table>
<Level name="ejecutivo" visible="true" column="ejecutivo" type="String" uniqueMembers="false" levelType="Regular">
</Level>
<Level name="id_ejecutivo" visible="true" column="ejecutivo_id" type="Integer" uniqueMembers="false" levelType="Regular">
</Level>
</Hierarchy>
</Dimension>
<Dimension type="StandardDimension" visible="true" name="Dim_producto">
<Hierarchy name="producto" visible="true" hasAll="true">
<Table name="dim_producto" alias="">
</Table>
<Level name="producto" visible="true" column="Product_Name" type="String" uniqueMembers="false" levelType="Regular">
</Level>
<Level name="id_producto" visible="true" column="Product_id" type="Integer" uniqueMembers="false" levelType="Regular">
</Level>
</Hierarchy>
</Dimension>
<Cube name="Cubo Ventas" visible="true" cache="true" enabled="true">
<Table name="fact_ventas">
</Table>
<DimensionUsage source="Dim_vendedor" name="VenD" visible="true" foreignKey="Ejecutivo_id">
</DimensionUsage>
<DimensionUsage source="Dim_producto" name="PROD" visible="true" foreignKey="Product_id">
</DimensionUsage>
<Measure name="Cantidad" column="cantidad" datatype="Integer" aggregator="sum" visible="true">
</Measure>
<Measure name="Monto" column="monto" datatype="Integer" aggregator="sum" visible="true">
</Measure>
</Cube>
</Schema>
Con los errores de la imagen adjunta, ya no se que puede ser, por favor su ayuda?
Graciaserror.jpgbase mysql.jpg
Gracias por leer este post, soy uno mas de los que se inician en pentaho y ven mucho potencial en esta herramienta, tengo un mysql y via SW, cree el siguiente cubo de 2 dimensiones y 2 metricas, con un modelo Fact_ventas, Dim_Producto y Dim_vendedor, algo sencillo
<Schema name="Esquema Ventas">
<Dimension type="StandardDimension" visible="true" name="Dim_vendedor">
<Hierarchy name="vendedor" visible="true" hasAll="true">
<Table name="dim_vendedor" alias="">
</Table>
<Level name="ejecutivo" visible="true" column="ejecutivo" type="String" uniqueMembers="false" levelType="Regular">
</Level>
<Level name="id_ejecutivo" visible="true" column="ejecutivo_id" type="Integer" uniqueMembers="false" levelType="Regular">
</Level>
</Hierarchy>
</Dimension>
<Dimension type="StandardDimension" visible="true" name="Dim_producto">
<Hierarchy name="producto" visible="true" hasAll="true">
<Table name="dim_producto" alias="">
</Table>
<Level name="producto" visible="true" column="Product_Name" type="String" uniqueMembers="false" levelType="Regular">
</Level>
<Level name="id_producto" visible="true" column="Product_id" type="Integer" uniqueMembers="false" levelType="Regular">
</Level>
</Hierarchy>
</Dimension>
<Cube name="Cubo Ventas" visible="true" cache="true" enabled="true">
<Table name="fact_ventas">
</Table>
<DimensionUsage source="Dim_vendedor" name="VenD" visible="true" foreignKey="Ejecutivo_id">
</DimensionUsage>
<DimensionUsage source="Dim_producto" name="PROD" visible="true" foreignKey="Product_id">
</DimensionUsage>
<Measure name="Cantidad" column="cantidad" datatype="Integer" aggregator="sum" visible="true">
</Measure>
<Measure name="Monto" column="monto" datatype="Integer" aggregator="sum" visible="true">
</Measure>
</Cube>
</Schema>
Con los errores de la imagen adjunta, ya no se que puede ser, por favor su ayuda?
Graciaserror.jpgbase mysql.jpg
↧
Problemas con SW y Mysql
Estimados,
Soy nuevo en la suite y estoy tratando de generar un cubo para verlo en jpivot, para lo que me cree algunas tablas en mysql, pero no he logrado generar ningúnbase mysql.jpgerror.jpg cubo, me aparecen x en mi modelo schema workbench, por favor su ayuda, no se que hago mal. Adjunto imagenes.
Gracias por cualquier comentario
Saludos
Alejandro
Soy nuevo en la suite y estoy tratando de generar un cubo para verlo en jpivot, para lo que me cree algunas tablas en mysql, pero no he logrado generar ningúnbase mysql.jpgerror.jpg cubo, me aparecen x en mi modelo schema workbench, por favor su ayuda, no se que hago mal. Adjunto imagenes.
Gracias por cualquier comentario
Saludos
Alejandro
↧
↧
DataStage to pentaho migration,what step in pentaho works as transformer in Datastage
Hi Any one is there with knowledge of migration from Datastage to pentaho.
We are migrating all our ETL jobs in datastage to pentaho, and we are not able to find any step in pentaho which works similar to Transformer in DataStage.
If any one has this knowledge could you please tell us which step or steps to use?.
We are migrating all our ETL jobs in datastage to pentaho, and we are not able to find any step in pentaho which works similar to Transformer in DataStage.
If any one has this knowledge could you please tell us which step or steps to use?.
↧
Environment Variable values are clearing when I restart the Spoon tool
When I close and open the Spoon tool all the values of environment variable values are getting cleared off but the environment variables are present with empty or null values.
Could you please tell me if there is any setting or option available in PDI to keep the values intact even if I restarted the Spoon design tool.
Could you please tell me if there is any setting or option available in PDI to keep the values intact even if I restarted the Spoon design tool.
↧
Cant Run Kitchen.bat
Hello,,
I want to ask something.
I put my kitchen.bat file in the "C:\Kettle\Kitchen.bat". Sadly I cant run kitchen.bat unless my command prompt in the kitchen.bat folder.
This is the message
C:\Users>C:\kettle\kitchen.bat /file:"Q:\80000 - Forecasting\89999 - Kettle\fcpost-facialskincare.kjb"
WARNING: Using java from path
DEBUG: _PENTAHO_JAVA_HOME=
DEBUG: _PENTAHO_JAVA=java.exe
C:\Users
The system cannot find the path specified.
The system cannot find the path specified.
C:\Users>"java.exe" "-Xms1024m" "-Xmx2048m" "-XX:MaxPermSize=256m" "-Dhttps.protocols=TLSv1,TLSv1.1,TLSv1.2" "-Djava.library.path=libswt\win64" "-DKETTLE_HOME=" "-DKETTLE_REPOSITORY=" "-DKETTLE_USER=" "-DKETTLE_PASSWORD=" "-DKETTLE_PLUGIN_PACKAGES=" "-DKETTLE_LOG_SIZE_LIMIT=" "-DKETTLE_JNDI_ROOT=" -jar launcher\pentaho-application-launcher-6.0.1.0-386.jar -lib ..\libswt\win64 -main org.pentaho.di.kitchen.Kitchen /file:"Q:\80000 - Forecasting\89999 - Kettle\fcpost-facialskincare.kjb"
Error: Unable to access jarfile launcher\pentaho-application-launcher-6.0.1.0-386.jar
but when i am in the kettle folder, i can run kichen.bat properly. So i have to go to kettle folder and run kitchen.bat /file:"bla bla bla.kjb"
Can someone helpme?
thanks n sorry for my bad english, i hope you know what i mean.
I want to ask something.
I put my kitchen.bat file in the "C:\Kettle\Kitchen.bat". Sadly I cant run kitchen.bat unless my command prompt in the kitchen.bat folder.
This is the message
Quote:
C:\Users>C:\kettle\kitchen.bat /file:"Q:\80000 - Forecasting\89999 - Kettle\fcpost-facialskincare.kjb"
WARNING: Using java from path
DEBUG: _PENTAHO_JAVA_HOME=
DEBUG: _PENTAHO_JAVA=java.exe
C:\Users
The system cannot find the path specified.
The system cannot find the path specified.
C:\Users>"java.exe" "-Xms1024m" "-Xmx2048m" "-XX:MaxPermSize=256m" "-Dhttps.protocols=TLSv1,TLSv1.1,TLSv1.2" "-Djava.library.path=libswt\win64" "-DKETTLE_HOME=" "-DKETTLE_REPOSITORY=" "-DKETTLE_USER=" "-DKETTLE_PASSWORD=" "-DKETTLE_PLUGIN_PACKAGES=" "-DKETTLE_LOG_SIZE_LIMIT=" "-DKETTLE_JNDI_ROOT=" -jar launcher\pentaho-application-launcher-6.0.1.0-386.jar -lib ..\libswt\win64 -main org.pentaho.di.kitchen.Kitchen /file:"Q:\80000 - Forecasting\89999 - Kettle\fcpost-facialskincare.kjb"
Error: Unable to access jarfile launcher\pentaho-application-launcher-6.0.1.0-386.jar
Can someone helpme?
thanks n sorry for my bad english, i hope you know what i mean.
↧
PDI as a business layer between source and webapplications/services
I am considering using PDI to publish webservices on a reasonably large scale.
The idea is that PDI would basically function as a business layer between databases/source and webapplications. I don't imagine PDI will be directly accessed directly by external consumers but always indirectly even when the end-product is a webservice itself (we currently provide many webservices to our clients).
I do have a working proof of concept (with carte), so I know how. However there are still some questions I need help with.
I have some concerns regarding performance (overhead PDI), serviceability / monitoring and scalibility.
PDI would have to answer requests in a reasonably high rate of speed.
I would appreciate insight from the community/pentaho on these topics.
And also your general views on the concept of this plan; are there other companies that use PDI in this way?
I'm also interested what the enterprise addition would offer extra specifically with regards to functionality in the above businesscase.
We're a medium sized IT services company ~200 employees. We employ many developers and IT specialists.
We already use PDI for many ETL integration solution to everyones satisfaction and it's expanding its domain (that's my doing..).
The idea is that PDI would basically function as a business layer between databases/source and webapplications. I don't imagine PDI will be directly accessed directly by external consumers but always indirectly even when the end-product is a webservice itself (we currently provide many webservices to our clients).
I do have a working proof of concept (with carte), so I know how. However there are still some questions I need help with.
I have some concerns regarding performance (overhead PDI), serviceability / monitoring and scalibility.
PDI would have to answer requests in a reasonably high rate of speed.
I would appreciate insight from the community/pentaho on these topics.
And also your general views on the concept of this plan; are there other companies that use PDI in this way?
I'm also interested what the enterprise addition would offer extra specifically with regards to functionality in the above businesscase.
We're a medium sized IT services company ~200 employees. We employ many developers and IT specialists.
We already use PDI for many ETL integration solution to everyones satisfaction and it's expanding its domain (that's my doing..).
↧
↧
Data storage in Pentaho transformation which are database transactional
Hi,
I want to know that for transformation which are marked as database transactional, where is the data stored before the final commit?
I want to know that for transformation which are marked as database transactional, where is the data stored before the final commit?
↧
Entry to update with following key could not be found
I am trying to update an Oracle table using Pentaho Community Edition ETL tool the input widget uses is a file. Unfortunately I am getting the following error 'Entry to update with following key could not be found'. The primary key records and the columns are present in the table. What do I have to do here as I have never seen this error before?
↧
number of lines in a String
Hello,
I want to determine the number of lines in a string.
I tried as follows:
= stringcount([myparam],char(13))
but this is always 0.
Thank you
Norbert
I want to determine the number of lines in a string.
I tried as follows:
= stringcount([myparam],char(13))
but this is always 0.
Thank you
Norbert
↧
Pass Update Columns as Variables
I want to update columns of a table. The issue is I need to pas the table name as a variable along with the columns. I don't want to define my keys and my columns as static values. Need them as variables. Can this be done? If yes any idea on how to do it. A working example thanks. An attachment is provided.
↧
↧
passing NULL as a Parameter in DB Call Procedure
Hi All,
Relatively new to pentaho and i am trying to get a job to run a database stored procedure. Ive struggled through lots of other posts and got to a place now where it is trying to run the procedure but getting the error
ORA-06502: PL/SQL: numeric or value error: character to number conversion error
ORA-06512: at line 1
THe issue is that the procedure has 3 arguments, but i would like the first two to be NULL. I currently have a set that is placing NULL inaide a parameter. It seems as though Pentaho is treating this as a string so when running it is PROCEDURE('NULL','NULL','14-JAN-2016).
Is there a way i can get pentaho to run this as PROCEDURE(NULL,NULL,'14-JAN-2016')?
THe procedure runs fine with these parameters in SQL Developer or sqlplus.
THanks
Gareth
Relatively new to pentaho and i am trying to get a job to run a database stored procedure. Ive struggled through lots of other posts and got to a place now where it is trying to run the procedure but getting the error
ORA-06502: PL/SQL: numeric or value error: character to number conversion error
ORA-06512: at line 1
THe issue is that the procedure has 3 arguments, but i would like the first two to be NULL. I currently have a set that is placing NULL inaide a parameter. It seems as though Pentaho is treating this as a string so when running it is PROCEDURE('NULL','NULL','14-JAN-2016).
Is there a way i can get pentaho to run this as PROCEDURE(NULL,NULL,'14-JAN-2016')?
THe procedure runs fine with these parameters in SQL Developer or sqlplus.
THanks
Gareth
↧
Moving PDI transformation to a different server
Hi, I am new to PDI and I have created a transformation in Spoon from a Text file input to a HBase Output on a virtual machine. I need to run the transformation on a server with no desktop environment installed. I have copied the .ktr file to the new server and have created the same HBase table and column family on the new server, and I have attempted to add the PDI mapping by manually adding the row and columns in the pentaho_mappings table on the new server; running the command "scan 'pentaho_mappings' " returns the same result on both servers.
However, running the transformation from Pan with the command "pan.sh -file=[filepath] " works on the virtual machine, but on the new server it throws the exception:
2016/01/14 17:11:12 - HBase Output.0 - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : Unexpected error
2016/01/14 17:11:12 - HBase Output.0 - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : org.pentaho.di.core.exception.KettleException:
2016/01/14 17:11:12 - HBase Output.0 - Problem inserting row into HBase: No columns to insert
2016/01/14 17:11:12 - HBase Output.0 - No columns to insert
2016/01/14 17:11:12 - HBase Output.0 -
2016/01/14 17:11:12 - HBase Output.0 - at org.pentaho.di.trans.steps.hbaseoutput.HBaseOutput.processRow(HBaseOutput.java:290)
...
What problems could be caused by this attempted manual migration of the transformation to the new server? Is there a better way to migrate a transformation to a different environment? I can't imagine that there is no way to get a transformation on a server without creating it in Spoon.
However, running the transformation from Pan with the command "pan.sh -file=[filepath] " works on the virtual machine, but on the new server it throws the exception:
2016/01/14 17:11:12 - HBase Output.0 - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : Unexpected error
2016/01/14 17:11:12 - HBase Output.0 - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : org.pentaho.di.core.exception.KettleException:
2016/01/14 17:11:12 - HBase Output.0 - Problem inserting row into HBase: No columns to insert
2016/01/14 17:11:12 - HBase Output.0 - No columns to insert
2016/01/14 17:11:12 - HBase Output.0 -
2016/01/14 17:11:12 - HBase Output.0 - at org.pentaho.di.trans.steps.hbaseoutput.HBaseOutput.processRow(HBaseOutput.java:290)
...
What problems could be caused by this attempted manual migration of the transformation to the new server? Is there a better way to migrate a transformation to a different environment? I can't imagine that there is no way to get a transformation on a server without creating it in Spoon.
↧
変数を使用したファイル入力
こんにちは。
度々申し訳ないのですが、テキストファイル入力で、ファイル名を変数で取得する場合の処理を教えてください。
・対象フォルダには、ｙｙｙｙｍｍｄｄ.csv形式でデータが入っています。
・前日のデータをテーブルに追加したい。
Java ScriptステップのsetVariableで変数にファイル名を取得するところまではできています。
その後ステップの、テキストファイル入力で\\192.168.1.1\aaaa\bbbb\${FILE_NAME}を指定してもファイルが読み込まれません。
エラーも特には表示されません。
Java Scriptステップのログを確認して、${FILE_NAME}に対象ファイル名が入っていることは確認しています。
何か方法が間違っているのでしょうか。それともファイル名を変数に代入することがまずいのでしょうか。
ご存知の方が見えましたら、ご教示賜りたいです。
よろしくお願いいたします。
度々申し訳ないのですが、テキストファイル入力で、ファイル名を変数で取得する場合の処理を教えてください。
・対象フォルダには、ｙｙｙｙｍｍｄｄ.csv形式でデータが入っています。
・前日のデータをテーブルに追加したい。
Java ScriptステップのsetVariableで変数にファイル名を取得するところまではできています。
その後ステップの、テキストファイル入力で\\192.168.1.1\aaaa\bbbb\${FILE_NAME}を指定してもファイルが読み込まれません。
エラーも特には表示されません。
Java Scriptステップのログを確認して、${FILE_NAME}に対象ファイル名が入っていることは確認しています。
何か方法が間違っているのでしょうか。それともファイル名を変数に代入することがまずいのでしょうか。
ご存知の方が見えましたら、ご教示賜りたいです。
よろしくお願いいたします。
↧
\xEE\x8C\xB4 error
HI all,
l'm geting following error.source data in the table with special characters such as "?" or "■"。so happen \xEE\x8C\xB4 error
PLS
2016/01/15 14:07:07 - Version checker - OK
2016/01/15 14:07:12 - RepositoriesMeta - Reading repositories XML file: D:\kettle\data-integration\.kettle\repositories.xml
2016/01/15 14:07:15 - Spoon - Connected to metastore : kettle, added to delegating metastore
2016/01/15 14:07:51 - Spoon - 正在开始任务...
2016/01/15 14:07:51 - j_wmp_sale_order - 开始执行任务
2016/01/15 14:07:51 - j_wmp_sale_order - 开始项[set_order_variable]
2016/01/15 14:07:51 - set_order_variable - Loading transformation from repository [set_order_variable] in directory [/zzzhs/order]
2016/01/15 14:07:54 - set_order_variable - 为了转换解除补丁开始 [set_order_variable]
2016/01/15 14:07:54 - 获取变量.0 - 完成处理 (I=0, O=0, R=1, W=1, U=0, E=0
2016/01/15 14:07:54 - 设置变量.0 - Setting environment variables...
2016/01/15 14:07:54 - 设置变量.0 - Set variable ${AfterDate} to value ['2016-01-07']
2016/01/15 14:07:54 - 设置变量.0 - Finished after 1 rows.
2016/01/15 14:07:54 - 设置变量.0 - 完成处理 (I=0, O=0, R=1, W=1, U=0, E=0
2016/01/15 14:07:54 - j_wmp_sale_order - 开始项[t_Del_Tp_wmp_sale_order]
2016/01/15 14:07:54 - t_Del_Tp_wmp_sale_order - Loading transformation from repository [t_Del_Tp_wmp_sale_order] in directory [/zzzhs/order]
2016/01/15 14:07:56 - t_Del_Tp_wmp_sale_order - 为了转换解除补丁开始 [t_Del_Tp_wmp_sale_order]
2016/01/15 14:07:56 - output_temp_table.0 - Connected to database [alog_wh_cs] (commit=1000)
2016/01/15 14:07:56 - clear_temp_table.0 - Finished reading query, closing connection.
2016/01/15 14:07:56 - clear_temp_table.0 - 完成处理 (I=0, O=0, R=0, W=1, U=0, E=0
2016/01/15 14:08:00 - Input_wmp_sale_order.0 - Finished reading query, closing connection.
2016/01/15 14:08:00 - Input_wmp_sale_order.0 - 完成处理 (I=32685, O=0, R=0, W=32685, U=0, E=0
2016/01/15 14:08:01 - output_temp_table.0 - 完成处理 (I=0, O=32685, R=32685, W=32685, U=0, E=0
2016/01/15 14:08:01 - j_wmp_sale_order - 开始项[delte_temp_SaleOrder]
2016/01/15 14:08:04 - j_wmp_sale_order - 开始项[t_wmp_sale_order]
2016/01/15 14:08:04 - t_wmp_sale_order - Loading transformation from repository [t_wmp_sale_order] in directory [/zzzhs/order]
2016/01/15 14:08:07 - t_wmp_sale_order - 为了转换解除补丁开始 [t_wmp_sale_order]
2016/01/15 14:08:07 - output_wmp_sale_order.0 - Connected to database [alog_wh_cs] (commit=1000)
2016/01/15 14:08:12 - JavaScript代码.0 - Optimization level set to 9.
2016/01/15 14:08:32 - output_wmp_sale_order.0 - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : Because of an error, this step can't continue:
2016/01/15 14:08:32 - output_wmp_sale_order.0 - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : org.pentaho.di.core.exception.KettleException:
2016/01/15 14:08:32 - output_wmp_sale_order.0 - Error batch inserting rows into table [tp_wmp_sale_order].
2016/01/15 14:08:32 - output_wmp_sale_order.0 - Errors encountered (first 10):
2016/01/15 14:08:32 - output_wmp_sale_order.0 -
2016/01/15 14:08:32 - output_wmp_sale_order.0 -
2016/01/15 14:08:32 - output_wmp_sale_order.0 - Error updating batch
2016/01/15 14:08:32 - output_wmp_sale_order.0 - Incorrect string value: '\xEE\x8C\xB4' for column 'buyer_name' at row 330
2016/01/15 14:08:32 - output_wmp_sale_order.0 -
2016/01/15 14:08:32 - output_wmp_sale_order.0 -
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable(TableOutput.java:342)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.processRow(TableOutput.java:118)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at java.lang.Thread.run(Thread.java:745)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - Caused by: org.pentaho.di.core.exception.KettleDatabaseBatchException:
2016/01/15 14:08:32 - output_wmp_sale_order.0 - Error updating batch
2016/01/15 14:08:32 - output_wmp_sale_order.0 - Incorrect string value: '\xEE\x8C\xB4' for column 'buyer_name' at row 330
2016/01/15 14:08:32 - output_wmp_sale_order.0 -
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at org.pentaho.di.core.database.Database.createKettleDatabaseBatchException(Database.java:1386)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable(TableOutput.java:289)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - ... 3 more
2016/01/15 14:08:32 - output_wmp_sale_order.0 - Caused by: java.sql.BatchUpdateException: Incorrect string value: '\xEE\x8C\xB4' for column 'buyer_name' at row 330
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at com.mysql.jdbc.PreparedStatement.executeBatchedInserts(PreparedStatement.java:1836)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at com.mysql.jdbc.PreparedStatement.executeBatch(PreparedStatement.java:1456)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable(TableOutput.java:285)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - ... 3 more
2016/01/15 14:08:32 - output_wmp_sale_order.0 - Caused by: java.sql.SQLException: Incorrect string value: '\xEE\x8C\xB4' for column 'buyer_name' at row 330
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1074)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4120)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4052)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2503)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at com.mysql.jdbc.ServerPreparedStatement.serverExecute(ServerPreparedStatement.java:1399)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at com.mysql.jdbc.ServerPreparedStatement.executeInternal(ServerPreparedStatement.java:857)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2458)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2375)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2359)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at com.mysql.jdbc.PreparedStatement.executeBatchedInserts(PreparedStatement.java:1792)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - ... 5 more
2016/01/15 14:08:32 - Input_wmp_sale_order.0 - Finished reading query, closing connection.
2016/01/15 14:08:32 - t_wmp_sale_order - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : 错误被检测到!
2016/01/15 14:08:32 - JavaScript代码.0 - 完成处理 (I=0, O=0, R=19001, W=19001, U=0, E=0
2016/01/15 14:08:32 - Input_wmp_sale_order.0 - 完成处理 (I=29003, O=0, R=0, W=29002, U=0, E=0
2016/01/15 14:08:32 - output_wmp_sale_order.0 - 完成处理 (I=0, O=8999, R=9000, W=8000, U=0, E=1
2016/01/15 14:08:32 - t_wmp_sale_order - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : 错误被检测到!
2016/01/15 14:08:32 - t_wmp_sale_order - 转换被检测
2016/01/15 14:08:32 - t_wmp_sale_order - 转换正在杀死其他步骤!
2016/01/15 14:08:32 - j_wmp_sale_order - 完成作业项[t_wmp_sale_order] (结果=[false])
2016/01/15 14:08:32 - j_wmp_sale_order - 完成作业项[delte_temp_SaleOrder] (结果=[false])
2016/01/15 14:08:32 - j_wmp_sale_order - 完成作业项[t_Del_Tp_wmp_sale_order] (结果=[false])
2016/01/15 14:08:32 - j_wmp_sale_order - 完成作业项[set_order_variable] (结果=[false])
2016/01/15 14:08:32 - j_wmp_sale_order - 任务执行完毕
2016/01/15 14:08:32 - Spoon - 任务已经结束.
l'm geting following error.source data in the table with special characters such as "?" or "■"。so happen \xEE\x8C\xB4 error
PLS
2016/01/15 14:07:07 - Version checker - OK
2016/01/15 14:07:12 - RepositoriesMeta - Reading repositories XML file: D:\kettle\data-integration\.kettle\repositories.xml
2016/01/15 14:07:15 - Spoon - Connected to metastore : kettle, added to delegating metastore
2016/01/15 14:07:51 - Spoon - 正在开始任务...
2016/01/15 14:07:51 - j_wmp_sale_order - 开始执行任务
2016/01/15 14:07:51 - j_wmp_sale_order - 开始项[set_order_variable]
2016/01/15 14:07:51 - set_order_variable - Loading transformation from repository [set_order_variable] in directory [/zzzhs/order]
2016/01/15 14:07:54 - set_order_variable - 为了转换解除补丁开始 [set_order_variable]
2016/01/15 14:07:54 - 获取变量.0 - 完成处理 (I=0, O=0, R=1, W=1, U=0, E=0
2016/01/15 14:07:54 - 设置变量.0 - Setting environment variables...
2016/01/15 14:07:54 - 设置变量.0 - Set variable ${AfterDate} to value ['2016-01-07']
2016/01/15 14:07:54 - 设置变量.0 - Finished after 1 rows.
2016/01/15 14:07:54 - 设置变量.0 - 完成处理 (I=0, O=0, R=1, W=1, U=0, E=0
2016/01/15 14:07:54 - j_wmp_sale_order - 开始项[t_Del_Tp_wmp_sale_order]
2016/01/15 14:07:54 - t_Del_Tp_wmp_sale_order - Loading transformation from repository [t_Del_Tp_wmp_sale_order] in directory [/zzzhs/order]
2016/01/15 14:07:56 - t_Del_Tp_wmp_sale_order - 为了转换解除补丁开始 [t_Del_Tp_wmp_sale_order]
2016/01/15 14:07:56 - output_temp_table.0 - Connected to database [alog_wh_cs] (commit=1000)
2016/01/15 14:07:56 - clear_temp_table.0 - Finished reading query, closing connection.
2016/01/15 14:07:56 - clear_temp_table.0 - 完成处理 (I=0, O=0, R=0, W=1, U=0, E=0
2016/01/15 14:08:00 - Input_wmp_sale_order.0 - Finished reading query, closing connection.
2016/01/15 14:08:00 - Input_wmp_sale_order.0 - 完成处理 (I=32685, O=0, R=0, W=32685, U=0, E=0
2016/01/15 14:08:01 - output_temp_table.0 - 完成处理 (I=0, O=32685, R=32685, W=32685, U=0, E=0
2016/01/15 14:08:01 - j_wmp_sale_order - 开始项[delte_temp_SaleOrder]
2016/01/15 14:08:04 - j_wmp_sale_order - 开始项[t_wmp_sale_order]
2016/01/15 14:08:04 - t_wmp_sale_order - Loading transformation from repository [t_wmp_sale_order] in directory [/zzzhs/order]
2016/01/15 14:08:07 - t_wmp_sale_order - 为了转换解除补丁开始 [t_wmp_sale_order]
2016/01/15 14:08:07 - output_wmp_sale_order.0 - Connected to database [alog_wh_cs] (commit=1000)
2016/01/15 14:08:12 - JavaScript代码.0 - Optimization level set to 9.
2016/01/15 14:08:32 - output_wmp_sale_order.0 - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : Because of an error, this step can't continue:
2016/01/15 14:08:32 - output_wmp_sale_order.0 - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : org.pentaho.di.core.exception.KettleException:
2016/01/15 14:08:32 - output_wmp_sale_order.0 - Error batch inserting rows into table [tp_wmp_sale_order].
2016/01/15 14:08:32 - output_wmp_sale_order.0 - Errors encountered (first 10):
2016/01/15 14:08:32 - output_wmp_sale_order.0 -
2016/01/15 14:08:32 - output_wmp_sale_order.0 -
2016/01/15 14:08:32 - output_wmp_sale_order.0 - Error updating batch
2016/01/15 14:08:32 - output_wmp_sale_order.0 - Incorrect string value: '\xEE\x8C\xB4' for column 'buyer_name' at row 330
2016/01/15 14:08:32 - output_wmp_sale_order.0 -
2016/01/15 14:08:32 - output_wmp_sale_order.0 -
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable(TableOutput.java:342)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.processRow(TableOutput.java:118)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at java.lang.Thread.run(Thread.java:745)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - Caused by: org.pentaho.di.core.exception.KettleDatabaseBatchException:
2016/01/15 14:08:32 - output_wmp_sale_order.0 - Error updating batch
2016/01/15 14:08:32 - output_wmp_sale_order.0 - Incorrect string value: '\xEE\x8C\xB4' for column 'buyer_name' at row 330
2016/01/15 14:08:32 - output_wmp_sale_order.0 -
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at org.pentaho.di.core.database.Database.createKettleDatabaseBatchException(Database.java:1386)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable(TableOutput.java:289)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - ... 3 more
2016/01/15 14:08:32 - output_wmp_sale_order.0 - Caused by: java.sql.BatchUpdateException: Incorrect string value: '\xEE\x8C\xB4' for column 'buyer_name' at row 330
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at com.mysql.jdbc.PreparedStatement.executeBatchedInserts(PreparedStatement.java:1836)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at com.mysql.jdbc.PreparedStatement.executeBatch(PreparedStatement.java:1456)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable(TableOutput.java:285)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - ... 3 more
2016/01/15 14:08:32 - output_wmp_sale_order.0 - Caused by: java.sql.SQLException: Incorrect string value: '\xEE\x8C\xB4' for column 'buyer_name' at row 330
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1074)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4120)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4052)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2503)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at com.mysql.jdbc.ServerPreparedStatement.serverExecute(ServerPreparedStatement.java:1399)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at com.mysql.jdbc.ServerPreparedStatement.executeInternal(ServerPreparedStatement.java:857)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2458)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2375)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2359)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - at com.mysql.jdbc.PreparedStatement.executeBatchedInserts(PreparedStatement.java:1792)
2016/01/15 14:08:32 - output_wmp_sale_order.0 - ... 5 more
2016/01/15 14:08:32 - Input_wmp_sale_order.0 - Finished reading query, closing connection.
2016/01/15 14:08:32 - t_wmp_sale_order - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : 错误被检测到!
2016/01/15 14:08:32 - JavaScript代码.0 - 完成处理 (I=0, O=0, R=19001, W=19001, U=0, E=0
2016/01/15 14:08:32 - Input_wmp_sale_order.0 - 完成处理 (I=29003, O=0, R=0, W=29002, U=0, E=0
2016/01/15 14:08:32 - output_wmp_sale_order.0 - 完成处理 (I=0, O=8999, R=9000, W=8000, U=0, E=1
2016/01/15 14:08:32 - t_wmp_sale_order - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : 错误被检测到!
2016/01/15 14:08:32 - t_wmp_sale_order - 转换被检测
2016/01/15 14:08:32 - t_wmp_sale_order - 转换正在杀死其他步骤!
2016/01/15 14:08:32 - j_wmp_sale_order - 完成作业项[t_wmp_sale_order] (结果=[false])
2016/01/15 14:08:32 - j_wmp_sale_order - 完成作业项[delte_temp_SaleOrder] (结果=[false])
2016/01/15 14:08:32 - j_wmp_sale_order - 完成作业项[t_Del_Tp_wmp_sale_order] (结果=[false])
2016/01/15 14:08:32 - j_wmp_sale_order - 完成作业项[set_order_variable] (结果=[false])
2016/01/15 14:08:32 - j_wmp_sale_order - 任务执行完毕
2016/01/15 14:08:32 - Spoon - 任务已经结束.
↧
↧
Unable to load {0} shim. PDI fails to load mapr410 shim.
Hi,
I need help to figure out why Pentaho DI wouldn't load the mapr410 shim. No idea where to look for errors.
The shim is untouched and as after fresh install.
I'm using Pentaho 6 on Ubuntu 14.04. x64.
This is all the info I get out of the console:
10:51:20 /o/P/d/data-integration sudo ./spoon.sh
[sudo] password for christianwirth:
/opt/Pentaho/design-tools/data-integration
DEBUG: Found JAVA two folders up
DEBUG: Found Pentaho License two folders up
DEBUG: _PENTAHO_JAVA_HOME=/opt/Pentaho/design-tools/data-integration/../../java
DEBUG: _PENTAHO_JAVA=/opt/Pentaho/design-tools/data-integration/../../java/bin/java
DEBUG: PENTAHO_INSTALLED_LICENSE_PATH=/opt/Pentaho/design-tools/data-integration/../../.installedLicenses.xml
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=256m; support was removed in 8.0
(SWT:5835): IBUS-WARNING **: The owner of /home/christianwirth/.config/ibus/bus is not root!
10:51:29,941 INFO [KarafInstance]
*******************************************************************************
*** Karaf Instance Number: 1 at /opt/Pentaho/design-tools/data-integration/ ***
*** ./system/karaf//data1 ***
*** Karaf Port:8801 ***
*** OSGI Service Port:9050 ***
*******************************************************************************
Jan 15, 2016 10:51:30 AM org.apache.karaf.main.Main$KarafLockCallback lockAquired
INFO: Lock acquired. Setting startlevel to 100
2016/01/15 10:51:31 - General - Logging plugin type found with ID: CheckpointLogTable
2016-01-15 10:51:32.540:INFO:oejs.Server:jetty-8.1.15.v20140411
2016-01-15 10:51:32.567:INFO:oejs.AbstractConnector:Started NIOSocketConnectorWrapper@0.0.0.0:9050
log4j:ERROR Could not parse url [file:/opt/Pentaho/design-tools/data-integration/./system/osgi/log4j.xml].
java.io.FileNotFoundException: /opt/Pentaho/design-tools/data-integration/./system/osgi/log4j.xml (No such file or directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.<init>(FileInputStream.java:138)
at java.io.FileInputStream.<init>(FileInputStream.java:93)
at sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:90)
at sun.net.www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:188)
at org.apache.log4j.xml.DOMConfigurator$2.parse(DOMConfigurator.java:765)
at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:871)
at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:778)
at org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:526)
at org.apache.log4j.LogManager.<clinit>(LogManager.java:127)
at org.apache.log4j.Logger.getLogger(Logger.java:104)
at org.apache.commons.logging.impl.Log4JLogger.getLogger(Log4JLogger.java:262)
at org.apache.commons.logging.impl.Log4JLogger.<init>(Log4JLogger.java:108)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
at org.apache.commons.logging.impl.LogFactoryImpl.createLogFromClass(LogFactoryImpl.java:1025)
at org.apache.commons.logging.impl.LogFactoryImpl.discoverLogImplementation(LogFactoryImpl.java:844)
at org.apache.commons.logging.impl.LogFactoryImpl.newInstance(LogFactoryImpl.java:541)
at org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:292)
at org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:269)
at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:657)
at org.springframework.osgi.extender.internal.activator.ContextLoaderListener.<clinit>(ContextLoaderListener.java:253)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
at java.lang.Class.newInstance(Class.java:442)
at org.apache.felix.framework.Felix.createBundleActivator(Felix.java:4336)
at org.apache.felix.framework.Felix.activateBundle(Felix.java:2141)
at org.apache.felix.framework.Felix.startBundle(Felix.java:2064)
at org.apache.felix.framework.Felix.setActiveStartLevel(Felix.java:1291)
at org.apache.felix.framework.FrameworkStartLevelImpl.run(FrameworkStartLevelImpl.java:304)
at java.lang.Thread.run(Thread.java:745)
log4j:WARN No appenders could be found for logger (org.springframework.osgi.extender.internal.activator.ContextLoaderListener).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/core
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/beans
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/parameterized-types
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/security
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/wsdl/
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/2005/08/addressing
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2004/08/addressing
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-management (137) [org.apache.cxf.management.InstrumentationManager]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-wsdl (140) [org.apache.cxf.wsdl.WSDLManager]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-xml (142) [org.apache.cxf.binding.xml.XMLBindingFactory, org.apache.cxf.binding.xml.wsdl11.XMLWSDLExtensionLoader]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-soap (143) [org.apache.cxf.binding.soap.SoapBindingFactory, org.apache.cxf.binding.soap.SoapTransportFactory]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/bindings/soap
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-http (144) [org.apache.cxf.transport.http.HTTPTransportFactory, org.apache.cxf.transport.http.HTTPWSDLExtensionLoader, org.apache.cxf.transport.http.policy.HTTPClientAssertionBuilder, org.apache.cxf.transport.http.policy.HTTPServerAssertionBuilder, org.apache.cxf.transport.http.policy.NoOpPolicyInterceptorProvider]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-policy (167) [org.apache.cxf.ws.policy.PolicyEngine, org.apache.cxf.policy.PolicyDataEngine, org.apache.cxf.ws.policy.AssertionBuilderRegistry, org.apache.cxf.ws.policy.PolicyInterceptorProviderRegistry, org.apache.cxf.ws.policy.PolicyBuilder, org.apache.cxf.ws.policy.PolicyAnnotationListener, org.apache.cxf.ws.policy.attachment.ServiceModelPolicyProvider, org.apache.cxf.ws.policy.attachment.external.DomainExpressionBuilderRegistry, org.apache.cxf.ws.policy.attachment.external.EndpointReferenceDomainExpressionBuilder, org.apache.cxf.ws.policy.attachment.external.URIDomainExpressionBuilder, org.apache.cxf.ws.policy.attachment.wsdl11.Wsdl11AttachmentPolicyProvider, org.apache.cxf.ws.policy.mtom.MTOMAssertionBuilder, org.apache.cxf.ws.policy.mtom.MTOMPolicyInterceptorProvider]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/transports/http/configuration
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/simple
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-frontend-jaxws (146) [org.apache.cxf.jaxws.context.WebServiceContextResourceResolver]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxws
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxrs
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxrs-client
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-corba (156) [org.apache.cxf.binding.corba.CorbaBindingFactory, org.apache.cxf.binding.corba.wsdl.WSDLExtensionRegister]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/binding/coloc
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-local (158) [org.apache.cxf.transport.local.LocalTransportFactory]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-object (159) [org.apache.cxf.binding.object.ObjectBindingFactory]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/binding/object
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-http-jetty (160) [org.apache.cxf.transport.http_jetty.JettyDestinationFactory, org.apache.cxf.transport.http_jetty.JettyHTTPServerEngineFactory, org.apache.cxf.transport.http.ContinuationProviderFactory]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/transports/htt.../configuration
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-jms (162) [org.apache.cxf.transport.jms.JMSTransportFactory, org.apache.cxf.transport.jms.wsdl11.JMSWSDLExtensionLoader]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-udp (164) [org.apache.cxf.transport.udp.UDPTransportFactory]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/policy
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/ns/ws-policy
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/2006/07/ws-policy
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2004/09/policy
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/wss/2004/...secext-1.0.xsd
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/wss/2004/...tility-1.0.xsd
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/2000/09/xmldsig#
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/ws-sx/ws-...ypolicy/200702
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-addr (184) [org.apache.cxf.ws.addressing.policy.AddressingAssertionBuilder, org.apache.cxf.ws.addressing.policy.UsingAddressingAssertionBuilder, org.apache.cxf.ws.addressing.policy.AddressingPolicyInterceptorProvider, org.apache.cxf.ws.addressing.impl.AddressingWSDLExtensionLoader, org.apache.cxf.ws.addressing.WSAddressingFeature$WSAddressingFeatureApplier, org.apache.cxf.ws.addressing.MAPAggregator$MAPAggregatorLoader]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/ws/addressing
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-mex (189) [org.apache.cxf.ws.mex.MEXServerListener]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-security (186) [org.apache.cxf.ws.security.policy.WSSecurityPolicyLoader, org.apache.cxf.ws.security.cache.CacheCleanupListener]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-rm (188) [org.apache.cxf.ws.rm.RMManager, org.apache.cxf.ws.rm.policy.RMPolicyInterceptorProvider, org.apache.cxf.ws.rm.policy.RM10AssertionBuilder, org.apache.cxf.ws.rm.policy.RM12AssertionBuilder, org.apache.cxf.ws.rm.policy.WSRMP12PolicyLoader, org.apache.cxf.ws.rm.policy.MC11PolicyLoader, org.apache.cxf.ws.rm.policy.RSPPolicyLoader]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/ws/rm/manager
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2005/02/rm/policy
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-javascript (190) [org.apache.cxf.javascript.JavascriptServerListener]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/clustering
Jan 15, 2016 10:51:33 AM org.pentaho.caching.impl.PentahoCacheManagerFactory$RegistrationHandler$1 onSuccess
INFO: New Caching Service registered
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/Pentaho/design-tools/data-integration/launcher/../lib/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/Pentaho/design-tools/data-integration/plugins/pentaho-big-data-plugin/lib/slf4j-log4j12-1.7.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Jan 15, 2016 10:51:34 AM org.apache.cxf.endpoint.ServerImpl initDestination
INFO: Setting the server's publish address to be /lineage
Jan 15, 2016 10:51:35 AM org.apache.cxf.endpoint.ServerImpl initDestination
INFO: Setting the server's publish address to be /marketplace
Refreshing GOE props...
2016-01-15 10:51:35 weka.gui.GenericObjectEditor registerEditors
INFO: ---Registering Weka Editors---
Trying to add database driver (JDBC): RmiJdbc.RJDriver - Warning, not in CLASSPATH?
Trying to add database driver (JDBC): jdbc.idbDriver - Warning, not in CLASSPATH?
Trying to add database driver (JDBC): org.gjt.mm.mysql.Driver - Warning, not in CLASSPATH?
Trying to add database driver (JDBC): com.mckoi.JDBCDriver - Warning, not in CLASSPATH?
10:51:35,666 ERROR [WebjarsURLConnection] Error Transforming zip
java.io.IOException: Pipe closed
at java.io.PipedInputStream.checkStateForReceive(PipedInputStream.java:260)
at java.io.PipedInputStream.receive(PipedInputStream.java:226)
at java.io.PipedOutputStream.write(PipedOutputStream.java:149)
at java.util.zip.DeflaterOutputStream.deflate(DeflaterOutputStream.java:253)
at java.util.zip.ZipOutputStream.closeEntry(ZipOutputStream.java:256)
at org.pentaho.osgi.platform.webjars.WebjarsURLConnection.transform(WebjarsURLConnection.java:190)
at org.pentaho.osgi.platform.webjars.WebjarsURLConnection.access$000(WebjarsURLConnection.java:54)
at org.pentaho.osgi.platform.webjars.WebjarsURLConnection$2.call(WebjarsURLConnection.java:90)
at org.pentaho.osgi.platform.webjars.WebjarsURLConnection$2.call(WebjarsURLConnection.java:87)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
the rest of the log is in the following post, due to post-length restrictions.
Please help, I have no idea what to look for....
I need help to figure out why Pentaho DI wouldn't load the mapr410 shim. No idea where to look for errors.
The shim is untouched and as after fresh install.
I'm using Pentaho 6 on Ubuntu 14.04. x64.
This is all the info I get out of the console:
10:51:20 /o/P/d/data-integration sudo ./spoon.sh
[sudo] password for christianwirth:
/opt/Pentaho/design-tools/data-integration
DEBUG: Found JAVA two folders up
DEBUG: Found Pentaho License two folders up
DEBUG: _PENTAHO_JAVA_HOME=/opt/Pentaho/design-tools/data-integration/../../java
DEBUG: _PENTAHO_JAVA=/opt/Pentaho/design-tools/data-integration/../../java/bin/java
DEBUG: PENTAHO_INSTALLED_LICENSE_PATH=/opt/Pentaho/design-tools/data-integration/../../.installedLicenses.xml
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=256m; support was removed in 8.0
(SWT:5835): IBUS-WARNING **: The owner of /home/christianwirth/.config/ibus/bus is not root!
10:51:29,941 INFO [KarafInstance]
*******************************************************************************
*** Karaf Instance Number: 1 at /opt/Pentaho/design-tools/data-integration/ ***
*** ./system/karaf//data1 ***
*** Karaf Port:8801 ***
*** OSGI Service Port:9050 ***
*******************************************************************************
Jan 15, 2016 10:51:30 AM org.apache.karaf.main.Main$KarafLockCallback lockAquired
INFO: Lock acquired. Setting startlevel to 100
2016/01/15 10:51:31 - General - Logging plugin type found with ID: CheckpointLogTable
2016-01-15 10:51:32.540:INFO:oejs.Server:jetty-8.1.15.v20140411
2016-01-15 10:51:32.567:INFO:oejs.AbstractConnector:Started NIOSocketConnectorWrapper@0.0.0.0:9050
log4j:ERROR Could not parse url [file:/opt/Pentaho/design-tools/data-integration/./system/osgi/log4j.xml].
java.io.FileNotFoundException: /opt/Pentaho/design-tools/data-integration/./system/osgi/log4j.xml (No such file or directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.<init>(FileInputStream.java:138)
at java.io.FileInputStream.<init>(FileInputStream.java:93)
at sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:90)
at sun.net.www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:188)
at org.apache.log4j.xml.DOMConfigurator$2.parse(DOMConfigurator.java:765)
at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:871)
at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:778)
at org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:526)
at org.apache.log4j.LogManager.<clinit>(LogManager.java:127)
at org.apache.log4j.Logger.getLogger(Logger.java:104)
at org.apache.commons.logging.impl.Log4JLogger.getLogger(Log4JLogger.java:262)
at org.apache.commons.logging.impl.Log4JLogger.<init>(Log4JLogger.java:108)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
at org.apache.commons.logging.impl.LogFactoryImpl.createLogFromClass(LogFactoryImpl.java:1025)
at org.apache.commons.logging.impl.LogFactoryImpl.discoverLogImplementation(LogFactoryImpl.java:844)
at org.apache.commons.logging.impl.LogFactoryImpl.newInstance(LogFactoryImpl.java:541)
at org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:292)
at org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:269)
at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:657)
at org.springframework.osgi.extender.internal.activator.ContextLoaderListener.<clinit>(ContextLoaderListener.java:253)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
at java.lang.Class.newInstance(Class.java:442)
at org.apache.felix.framework.Felix.createBundleActivator(Felix.java:4336)
at org.apache.felix.framework.Felix.activateBundle(Felix.java:2141)
at org.apache.felix.framework.Felix.startBundle(Felix.java:2064)
at org.apache.felix.framework.Felix.setActiveStartLevel(Felix.java:1291)
at org.apache.felix.framework.FrameworkStartLevelImpl.run(FrameworkStartLevelImpl.java:304)
at java.lang.Thread.run(Thread.java:745)
log4j:WARN No appenders could be found for logger (org.springframework.osgi.extender.internal.activator.ContextLoaderListener).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/core
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/beans
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/parameterized-types
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/security
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/wsdl/
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/2005/08/addressing
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2004/08/addressing
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-management (137) [org.apache.cxf.management.InstrumentationManager]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-wsdl (140) [org.apache.cxf.wsdl.WSDLManager]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-xml (142) [org.apache.cxf.binding.xml.XMLBindingFactory, org.apache.cxf.binding.xml.wsdl11.XMLWSDLExtensionLoader]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-soap (143) [org.apache.cxf.binding.soap.SoapBindingFactory, org.apache.cxf.binding.soap.SoapTransportFactory]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/bindings/soap
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-http (144) [org.apache.cxf.transport.http.HTTPTransportFactory, org.apache.cxf.transport.http.HTTPWSDLExtensionLoader, org.apache.cxf.transport.http.policy.HTTPClientAssertionBuilder, org.apache.cxf.transport.http.policy.HTTPServerAssertionBuilder, org.apache.cxf.transport.http.policy.NoOpPolicyInterceptorProvider]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-policy (167) [org.apache.cxf.ws.policy.PolicyEngine, org.apache.cxf.policy.PolicyDataEngine, org.apache.cxf.ws.policy.AssertionBuilderRegistry, org.apache.cxf.ws.policy.PolicyInterceptorProviderRegistry, org.apache.cxf.ws.policy.PolicyBuilder, org.apache.cxf.ws.policy.PolicyAnnotationListener, org.apache.cxf.ws.policy.attachment.ServiceModelPolicyProvider, org.apache.cxf.ws.policy.attachment.external.DomainExpressionBuilderRegistry, org.apache.cxf.ws.policy.attachment.external.EndpointReferenceDomainExpressionBuilder, org.apache.cxf.ws.policy.attachment.external.URIDomainExpressionBuilder, org.apache.cxf.ws.policy.attachment.wsdl11.Wsdl11AttachmentPolicyProvider, org.apache.cxf.ws.policy.mtom.MTOMAssertionBuilder, org.apache.cxf.ws.policy.mtom.MTOMPolicyInterceptorProvider]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/transports/http/configuration
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/simple
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-frontend-jaxws (146) [org.apache.cxf.jaxws.context.WebServiceContextResourceResolver]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxws
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxrs
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxrs-client
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-corba (156) [org.apache.cxf.binding.corba.CorbaBindingFactory, org.apache.cxf.binding.corba.wsdl.WSDLExtensionRegister]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/binding/coloc
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-local (158) [org.apache.cxf.transport.local.LocalTransportFactory]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-object (159) [org.apache.cxf.binding.object.ObjectBindingFactory]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/binding/object
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-http-jetty (160) [org.apache.cxf.transport.http_jetty.JettyDestinationFactory, org.apache.cxf.transport.http_jetty.JettyHTTPServerEngineFactory, org.apache.cxf.transport.http.ContinuationProviderFactory]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/transports/htt.../configuration
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-jms (162) [org.apache.cxf.transport.jms.JMSTransportFactory, org.apache.cxf.transport.jms.wsdl11.JMSWSDLExtensionLoader]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-udp (164) [org.apache.cxf.transport.udp.UDPTransportFactory]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/policy
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/ns/ws-policy
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/2006/07/ws-policy
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2004/09/policy
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/wss/2004/...secext-1.0.xsd
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/wss/2004/...tility-1.0.xsd
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/2000/09/xmldsig#
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/ws-sx/ws-...ypolicy/200702
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-addr (184) [org.apache.cxf.ws.addressing.policy.AddressingAssertionBuilder, org.apache.cxf.ws.addressing.policy.UsingAddressingAssertionBuilder, org.apache.cxf.ws.addressing.policy.AddressingPolicyInterceptorProvider, org.apache.cxf.ws.addressing.impl.AddressingWSDLExtensionLoader, org.apache.cxf.ws.addressing.WSAddressingFeature$WSAddressingFeatureApplier, org.apache.cxf.ws.addressing.MAPAggregator$MAPAggregatorLoader]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/ws/addressing
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-mex (189) [org.apache.cxf.ws.mex.MEXServerListener]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-security (186) [org.apache.cxf.ws.security.policy.WSSecurityPolicyLoader, org.apache.cxf.ws.security.cache.CacheCleanupListener]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-rm (188) [org.apache.cxf.ws.rm.RMManager, org.apache.cxf.ws.rm.policy.RMPolicyInterceptorProvider, org.apache.cxf.ws.rm.policy.RM10AssertionBuilder, org.apache.cxf.ws.rm.policy.RM12AssertionBuilder, org.apache.cxf.ws.rm.policy.WSRMP12PolicyLoader, org.apache.cxf.ws.rm.policy.MC11PolicyLoader, org.apache.cxf.ws.rm.policy.RSPPolicyLoader]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/ws/rm/manager
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2005/02/rm/policy
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-javascript (190) [org.apache.cxf.javascript.JavascriptServerListener]
Jan 15, 2016 10:51:33 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/clustering
Jan 15, 2016 10:51:33 AM org.pentaho.caching.impl.PentahoCacheManagerFactory$RegistrationHandler$1 onSuccess
INFO: New Caching Service registered
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/Pentaho/design-tools/data-integration/launcher/../lib/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/Pentaho/design-tools/data-integration/plugins/pentaho-big-data-plugin/lib/slf4j-log4j12-1.7.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Jan 15, 2016 10:51:34 AM org.apache.cxf.endpoint.ServerImpl initDestination
INFO: Setting the server's publish address to be /lineage
Jan 15, 2016 10:51:35 AM org.apache.cxf.endpoint.ServerImpl initDestination
INFO: Setting the server's publish address to be /marketplace
Refreshing GOE props...
2016-01-15 10:51:35 weka.gui.GenericObjectEditor registerEditors
INFO: ---Registering Weka Editors---
Trying to add database driver (JDBC): RmiJdbc.RJDriver - Warning, not in CLASSPATH?
Trying to add database driver (JDBC): jdbc.idbDriver - Warning, not in CLASSPATH?
Trying to add database driver (JDBC): org.gjt.mm.mysql.Driver - Warning, not in CLASSPATH?
Trying to add database driver (JDBC): com.mckoi.JDBCDriver - Warning, not in CLASSPATH?
10:51:35,666 ERROR [WebjarsURLConnection] Error Transforming zip
java.io.IOException: Pipe closed
at java.io.PipedInputStream.checkStateForReceive(PipedInputStream.java:260)
at java.io.PipedInputStream.receive(PipedInputStream.java:226)
at java.io.PipedOutputStream.write(PipedOutputStream.java:149)
at java.util.zip.DeflaterOutputStream.deflate(DeflaterOutputStream.java:253)
at java.util.zip.ZipOutputStream.closeEntry(ZipOutputStream.java:256)
at org.pentaho.osgi.platform.webjars.WebjarsURLConnection.transform(WebjarsURLConnection.java:190)
at org.pentaho.osgi.platform.webjars.WebjarsURLConnection.access$000(WebjarsURLConnection.java:54)
at org.pentaho.osgi.platform.webjars.WebjarsURLConnection$2.call(WebjarsURLConnection.java:90)
at org.pentaho.osgi.platform.webjars.WebjarsURLConnection$2.call(WebjarsURLConnection.java:87)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
the rest of the log is in the following post, due to post-length restrictions.
Please help, I have no idea what to look for....
↧
Change schema with Parameter dynamically problem
In Pentaho Data Integration (Spoon) can use syntax for select schema dynamically by parse parameter like this
SELECT *
FROM ${SCHEMA}.Table_Name
It's work fine.
But If you use the same method in CDE sql query, it will not work.
What's wrong with it ? And how to fix it ?
I'm really appreciate any help in advance.
SELECT *
FROM ${SCHEMA}.Table_Name
It's work fine.
But If you use the same method in CDE sql query, it will not work.
What's wrong with it ? And how to fix it ?
I'm really appreciate any help in advance.
↧
Problem passing parameter to mailstep
Hello all,
I encounter a problem which i cant solve. In my JOB i want to mail reports to my employees.
My job looks like this:
First a transformation which only has a Table Input and a Copy Rows To Result. The query in the Table Input gives me the employee ID's from the employees.
Next in my job another transformation. This transformation has Execute once per input row checked and passes the parameter EmployeeID.
In this transformation a get rows from result starts an table Input with variabeles. So the table input executes once per EmployeeID.
This al works fine. After the table input i execute a PRPT which i created in PRD. I give this PRPT a html output.
This html output i store in a parameter so i can send it in the body of my email.
This also works fine.
But then,
In this transformation i call a Job which must email the HTML to my employees.
I pass the parameter ${html_body} which i use in the comment section of the mail step.
I also pass the parameter ${EmailAddress} which i of course use in the MailTo section.
But here the problems arrive.
My ${html_body} is working correctly, but my ${EmailAddress} doesnt.
The first email goes to the text ${EmailAddress} and the second email goes for example to: JoeyJonker@mail.com
But the first mail has to go to JoeyJonker@mail.com!!!!
So all my employees get the wrong mail.
Any ideas??
Thanks in advance!!
I encounter a problem which i cant solve. In my JOB i want to mail reports to my employees.
My job looks like this:
First a transformation which only has a Table Input and a Copy Rows To Result. The query in the Table Input gives me the employee ID's from the employees.
Next in my job another transformation. This transformation has Execute once per input row checked and passes the parameter EmployeeID.
In this transformation a get rows from result starts an table Input with variabeles. So the table input executes once per EmployeeID.
This al works fine. After the table input i execute a PRPT which i created in PRD. I give this PRPT a html output.
This html output i store in a parameter so i can send it in the body of my email.
This also works fine.
But then,
In this transformation i call a Job which must email the HTML to my employees.
I pass the parameter ${html_body} which i use in the comment section of the mail step.
I also pass the parameter ${EmailAddress} which i of course use in the MailTo section.
But here the problems arrive.
My ${html_body} is working correctly, but my ${EmailAddress} doesnt.
The first email goes to the text ${EmailAddress} and the second email goes for example to: JoeyJonker@mail.com
But the first mail has to go to JoeyJonker@mail.com!!!!
So all my employees get the wrong mail.
Any ideas??
Thanks in advance!!
↧