Our group is attempting to setup Pentaho Data Integration with Carte using Dynamic Clustering Installation along with a Repo.
We have attempted to use the following documentation to assist in the setup:
http://wiki.pentaho.com/display/EAI/Carte+Configuration
http://wiki.pentaho.com/display/EAI/...+Documentation
http://open-bi.blogspot.com/2009/11/
However, we are stuck and have a few questions
Here is our setup:
- Using Data Integration Community Edition 5.2
-Master Server - Ubuntu 14.04 - no UI
-Installed JRE - sudo apt-get install default-jre
-Downloaded and extracted the community edition to the following location /opt/pentaho/server/data-integration
-In this folder, I have a file called carte-config-master.xml.
-This file looks like the following (The sensitive fields are 'x''d out):
<slave_config>
<!--
Document description...
- masters: You can list the slave servers to which this slave has to report back to.
If this is a master, we will contact the other masters to get a list of all the slaves in the cluster.
- report_to_masters : send a message to the defined masters to let them know we exist (Y/N)
- slaveserver : specify the slave server details of this carte instance.
IMPORTANT : the username and password specified here are used by the master instances to connect to this slave.
-->
<slaveserver>
<name>Master</name>
<hostname>xx.xx.xx.xx</hostname>
<port>8090</port>
<username>cluster</username>
<password>xxxxx</password>
<webAppName>pentaho-di</webAppName>
<master>Y</master>
</slaveserver>
<repository>
<name>xxxxxxx</name>
<username>postgres</username>
<password>xxxxxxx</password>
</repository>
</slave_config>
--This appears to start up correctly with the following command ./carte.sh carte-config.master.xml
-Slave Server: Ubuntu 14.04 with no UI
-Installed JRE - sudo apt-get install default-jre
-Downloaded and extracted the community edition to the following location /opt/pentaho/server/data-integration
-In this folder, I have a file called carte-config-slave.xml.
-This file looks like the following (The sensitive fields are 'x''d out):<slave_config>
<masters>
<slaveserver>
<name>Master</name>
<hostname>xx.xx.xx.xxx</hostname>
<port>8090</port>
<username>cluster</username>
<password>xxxxxx</password>
<webAppName>pentaho-di</webAppName>
<master>Y</master>
</slaveserver>
</masters>
<report_to_masters>Y</report_to_masters>
<slaveserver>
<name>slave1</name>
<hostname>xx.xx.xx.xx</hostname>
<port>8091</port>
<username>cluster</username>
<password>xxxxxxx</password>
<master>N</master>
</slaveserver>
<repository>
<name>xxxxxx</name>
<username>postgres</username>
<password>xxxxxxx</password>
</repository>
</slave_config>
--This does not start up correct with the following command
./carte.sh carte-slave-config.xml
The following error occurs:
2014/12/16 15:44:14 - Carte - Installing timer to purge stale objects after 1440 minutes.
Attempting to load ESAPI.properties via file I/O.
Attempting to load ESAPI.properties as resource file via file I/O.
Not found in 'org.owasp.esapi.resources' directory or file not readable: /opt/pentaho/server/data-integration/ESAPI.properties
Not found in SystemResource Directory/resourceDirectory: .esapi/ESAPI.properties
Not found in 'user.home' (/home/ubuntu) directory: /home/ubuntu/esapi/ESAPI.properties
Loading ESAPI.properties via file I/O failed. Exception was: java.io.FileNotFoundException
Attempting to load ESAPI.properties via the classpath.
SUCCESSFULLY LOADED ESAPI.properties via the CLASSPATH from '/ (root)' using current thread context class loader!
SecurityConfiguration for Validator.ConfigurationFile not found in ESAPI.properties. Using default: validation.properties
Attempting to load validation.properties via file I/O.
Attempting to load validation.properties as resource file via file I/O.
Not found in 'org.owasp.esapi.resources' directory or file not readable: /opt/pentaho/server/data-integration/validation.properties
Not found in SystemResource Directory/resourceDirectory: .esapi/validation.properties
Not found in 'user.home' (/home/ubuntu) directory: /home/ubuntu/esapi/validation.properties
Loading validation.properties via file I/O failed.
Attempting to load validation.properties via the classpath.
validation.properties could not be loaded by any means. fail. Exception was: java.lang.IllegalArgumentException: Failed to load ESAPI.properties as a classloader resource.
SecurityConfiguration for Logger.LogServerIP not either "true" or "false" in ESAPI.properties. Using default: true
2014/12/16 15:44:14 - Carte - ERROR (version 5.2.0.0, build 1 from 2014-09-30_19-48-28 by buildguy) : Unable to register to master slave server [Master] on address [10.81.39.98:8090]
2014/12/16 15:44:14 - Carte - ERROR (version 5.2.0.0, build 1 from 2014-09-30_19-48-28 by buildguy) : Unable to register to master slave server [Master] on address [10.81.39.98:8090]
Exception in thread "main" java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.pentaho.commons.launcher.Launcher.main(Launcher.java:92)
Caused by: java.lang.NullPointerException
at org.pentaho.di.www.Carte.runCarte(Carte.java:183)
at org.pentaho.di.www.Carte.main(Carte.java:172)
... 5 more
My questions are as follows:
-How do I correct the error on the slave server?
-Is the setup correct?
-Is the setup of the repository correct? The documentation on using a repository with Carte is not clear.
-How can I test it once I get past the errors?
-Is having no UI a problem?
Additional questions?
-I was planning on using developer workstations to develop transformations? How are these deployed to the repository?
-We were planning on using the Carte web services and use a custom web page we develop to call the carte web services? Is this feasible with the current setup?
We have attempted to use the following documentation to assist in the setup:
http://wiki.pentaho.com/display/EAI/Carte+Configuration
http://wiki.pentaho.com/display/EAI/...+Documentation
http://open-bi.blogspot.com/2009/11/
However, we are stuck and have a few questions
Here is our setup:
- Using Data Integration Community Edition 5.2
-Master Server - Ubuntu 14.04 - no UI
-Installed JRE - sudo apt-get install default-jre
-Downloaded and extracted the community edition to the following location /opt/pentaho/server/data-integration
-In this folder, I have a file called carte-config-master.xml.
-This file looks like the following (The sensitive fields are 'x''d out):
<slave_config>
<!--
Document description...
- masters: You can list the slave servers to which this slave has to report back to.
If this is a master, we will contact the other masters to get a list of all the slaves in the cluster.
- report_to_masters : send a message to the defined masters to let them know we exist (Y/N)
- slaveserver : specify the slave server details of this carte instance.
IMPORTANT : the username and password specified here are used by the master instances to connect to this slave.
-->
<slaveserver>
<name>Master</name>
<hostname>xx.xx.xx.xx</hostname>
<port>8090</port>
<username>cluster</username>
<password>xxxxx</password>
<webAppName>pentaho-di</webAppName>
<master>Y</master>
</slaveserver>
<repository>
<name>xxxxxxx</name>
<username>postgres</username>
<password>xxxxxxx</password>
</repository>
</slave_config>
--This appears to start up correctly with the following command ./carte.sh carte-config.master.xml
-Slave Server: Ubuntu 14.04 with no UI
-Installed JRE - sudo apt-get install default-jre
-Downloaded and extracted the community edition to the following location /opt/pentaho/server/data-integration
-In this folder, I have a file called carte-config-slave.xml.
-This file looks like the following (The sensitive fields are 'x''d out):<slave_config>
<masters>
<slaveserver>
<name>Master</name>
<hostname>xx.xx.xx.xxx</hostname>
<port>8090</port>
<username>cluster</username>
<password>xxxxxx</password>
<webAppName>pentaho-di</webAppName>
<master>Y</master>
</slaveserver>
</masters>
<report_to_masters>Y</report_to_masters>
<slaveserver>
<name>slave1</name>
<hostname>xx.xx.xx.xx</hostname>
<port>8091</port>
<username>cluster</username>
<password>xxxxxxx</password>
<master>N</master>
</slaveserver>
<repository>
<name>xxxxxx</name>
<username>postgres</username>
<password>xxxxxxx</password>
</repository>
</slave_config>
--This does not start up correct with the following command
./carte.sh carte-slave-config.xml
The following error occurs:
2014/12/16 15:44:14 - Carte - Installing timer to purge stale objects after 1440 minutes.
Attempting to load ESAPI.properties via file I/O.
Attempting to load ESAPI.properties as resource file via file I/O.
Not found in 'org.owasp.esapi.resources' directory or file not readable: /opt/pentaho/server/data-integration/ESAPI.properties
Not found in SystemResource Directory/resourceDirectory: .esapi/ESAPI.properties
Not found in 'user.home' (/home/ubuntu) directory: /home/ubuntu/esapi/ESAPI.properties
Loading ESAPI.properties via file I/O failed. Exception was: java.io.FileNotFoundException
Attempting to load ESAPI.properties via the classpath.
SUCCESSFULLY LOADED ESAPI.properties via the CLASSPATH from '/ (root)' using current thread context class loader!
SecurityConfiguration for Validator.ConfigurationFile not found in ESAPI.properties. Using default: validation.properties
Attempting to load validation.properties via file I/O.
Attempting to load validation.properties as resource file via file I/O.
Not found in 'org.owasp.esapi.resources' directory or file not readable: /opt/pentaho/server/data-integration/validation.properties
Not found in SystemResource Directory/resourceDirectory: .esapi/validation.properties
Not found in 'user.home' (/home/ubuntu) directory: /home/ubuntu/esapi/validation.properties
Loading validation.properties via file I/O failed.
Attempting to load validation.properties via the classpath.
validation.properties could not be loaded by any means. fail. Exception was: java.lang.IllegalArgumentException: Failed to load ESAPI.properties as a classloader resource.
SecurityConfiguration for Logger.LogServerIP not either "true" or "false" in ESAPI.properties. Using default: true
2014/12/16 15:44:14 - Carte - ERROR (version 5.2.0.0, build 1 from 2014-09-30_19-48-28 by buildguy) : Unable to register to master slave server [Master] on address [10.81.39.98:8090]
2014/12/16 15:44:14 - Carte - ERROR (version 5.2.0.0, build 1 from 2014-09-30_19-48-28 by buildguy) : Unable to register to master slave server [Master] on address [10.81.39.98:8090]
Exception in thread "main" java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.pentaho.commons.launcher.Launcher.main(Launcher.java:92)
Caused by: java.lang.NullPointerException
at org.pentaho.di.www.Carte.runCarte(Carte.java:183)
at org.pentaho.di.www.Carte.main(Carte.java:172)
... 5 more
My questions are as follows:
-How do I correct the error on the slave server?
-Is the setup correct?
-Is the setup of the repository correct? The documentation on using a repository with Carte is not clear.
-How can I test it once I get past the errors?
-Is having no UI a problem?
Additional questions?
-I was planning on using developer workstations to develop transformations? How are these deployed to the repository?
-We were planning on using the Carte web services and use a custom web page we develop to call the carte web services? Is this feasible with the current setup?