Uploaded image for project: 'Blazegraph (by SYSTAP)'
  1. Blazegraph (by SYSTAP)
  2. BLZG-703

Lose log4j-1.2.15.jar when installing cluster

    Details

    • Type: Bug
    • Status: Closed - Won't Fix
    • Resolution: Cannot Reproduce
    • Affects Version/s: BIGDATA_RELEASE_1_2_2
    • Fix Version/s: None
    • Component/s: Other
    • Labels:

      Description

      When use the command ' ant install ' to install the cluster ,it will tell you install successful .But in the folder '/nas/bigdata/benchmark/lib/apache/' ,it only have the file 'zookeeper-3.3.3.jar' (lose the log4j-1.2.15.jar).You can add this file to the folder manually.

        Activity

        Hide
        bryanthompson bryanthompson added a comment -

        I can not duplicate this issue. The actual log4j JAR version depends on the bigdata release and must be specified in build.properties. For example, in the 1.2.3 development branch in SVN it is currently:

        log4j.version=1.2.17
        

        If you replace the JAR in the lib directory in the source tree but do not update the log4j.version in build.properties then you might observe the problem that you have described. However, I believe that it is more likely that the install would fail when it failed to locate the jar to be installed.

        When I follow the procedure below to install the cluster (using 2 DS instances on the same workstation -- this is done for CI purposes), then I observe the log4j JAR in the DIST artifact:

        -rw-r--r-- 0/0          489883 2013-08-08 07:46:00 bigdata-1.2.3/bigdata/lib/apache/log4j-1.2.17.jar
        

        and when the distribution is installed, I observe the log4j jar in the target lib directory:

        -rw-r--r-- 1 root root   489883 Aug  8 07:48 log4j-1.2.17.jar
        

        The installation procedure used for CI (2 DS on one node) is

        # Note: The added steps of creating a DIST archive and deploying it
        # are only necessary to verify that the DIST archive actually contains
        # all of the necessary files from the project.  Otherwise you can skip
        # over that step and do the install from the project directory.
        
        FED=benchmark
        NAS=/nas/bigdata/${FED}
        LAS=/data/bigdata/${FED}
        
        # Source directory for release version.
        #REL=~/workspace/BIGDATA_RELEASE_1_0_0
        REL=~/workspace/BIGDATA_RELEASE_1_2_0
        
        # Distribution specific version.
        #DIST=bigdata-1.0.5
        DIST=bigdata-1.2.2
        
        # create the DIST
        cd $REL
        ant ant-install-artifact
        
        # extract DIST to DIST specific directory
        rm -rf /nas/bigdata/${DIST}
        tar xzvof DIST.${DIST}.tgz -C /nas/bigdata/
        
        cd /nas/bigdata/${DIST}
        
        # remove the existing install ($LAS is cleared by bigdata destroy)
        rm -rf $NAS
        
        # install distribution.
        ant ant-install
        
        # setup environment
        source $NAS/bin/bigdataenv
        
        ##
        # Replace any edits to the bigdataCluster config file before starting the cluster.
        #
        # See $NAS/config/bigdataCluster.
        ##
        bigdata start
        
        Show
        bryanthompson bryanthompson added a comment - I can not duplicate this issue. The actual log4j JAR version depends on the bigdata release and must be specified in build.properties. For example, in the 1.2.3 development branch in SVN it is currently: log4j.version=1.2.17 If you replace the JAR in the lib directory in the source tree but do not update the log4j.version in build.properties then you might observe the problem that you have described. However, I believe that it is more likely that the install would fail when it failed to locate the jar to be installed. When I follow the procedure below to install the cluster (using 2 DS instances on the same workstation -- this is done for CI purposes), then I observe the log4j JAR in the DIST artifact: -rw-r--r-- 0/0 489883 2013-08-08 07:46:00 bigdata-1.2.3/bigdata/lib/apache/log4j-1.2.17.jar and when the distribution is installed, I observe the log4j jar in the target lib directory: -rw-r--r-- 1 root root 489883 Aug 8 07:48 log4j-1.2.17.jar The installation procedure used for CI (2 DS on one node) is # Note: The added steps of creating a DIST archive and deploying it # are only necessary to verify that the DIST archive actually contains # all of the necessary files from the project. Otherwise you can skip # over that step and do the install from the project directory. FED=benchmark NAS=/nas/bigdata/${FED} LAS=/data/bigdata/${FED} # Source directory for release version. #REL=~/workspace/BIGDATA_RELEASE_1_0_0 REL=~/workspace/BIGDATA_RELEASE_1_2_0 # Distribution specific version. #DIST=bigdata-1.0.5 DIST=bigdata-1.2.2 # create the DIST cd $REL ant ant-install-artifact # extract DIST to DIST specific directory rm -rf /nas/bigdata/${DIST} tar xzvof DIST.${DIST}.tgz -C /nas/bigdata/ cd /nas/bigdata/${DIST} # remove the existing install ($LAS is cleared by bigdata destroy) rm -rf $NAS # install distribution. ant ant-install # setup environment source $NAS/bin/bigdataenv ## # Replace any edits to the bigdataCluster config file before starting the cluster. # # See $NAS/config/bigdataCluster. ## bigdata start
        Hide
        bryanthompson bryanthompson added a comment -

        You need to give "bigdata start" a minute or so to start the various services. At that point I see all services running correctly with no problems in resolving the log4j dependency.

        listServices.sh
        java version "1.6.0_27"
        Java(TM) SE Runtime Environment (build 1.6.0_27-b07)
        Java HotSpot(TM) 64-Bit Server VM (build 20.2-b06, mixed mode)
        
        
        BIGDATA(R)
        
                           Flexible
                           Reliable
                          Affordable
              Web-Scale Computing for the Enterprise
        
        Copyright SYSTAP, LLC 2006-2013.  All rights reserved.
        
        bigdata01.systap.com
        Thu Aug 08 07:52:05 EDT 2013
        Linux/2.6.18-348.1.1.el5 amd64
        AMD Phenom(tm) II X4 945 Processor Family 16 Model 4 Stepping 3, AuthenticAMD #CPU=4
        Sun Microsystems Inc. 1.6.0_27
        freeMemory=244139520
        buildVersion=1.2.2
        
        Dependency         License
        ICU                http://source.icu-project.org/repos/icu/icu/trunk/license.html
        bigdata-ganglia    http://www.apache.org/licenses/LICENSE-2.0.html
        colt               http://acs.lbl.gov/software/colt/license.html
        commons-codec      http://www.apache.org/licenses/LICENSE-2.0.html
        commons-fileupload http://www.apache.org/licenses/LICENSE-2.0.html
        commons-io         http://www.apache.org/licenses/LICENSE-2.0.html
        commons-logging    http://www.apache.org/licenses/LICENSE-2.0.html
        dsiutils           http://www.gnu.org/licenses/lgpl-2.1.html
        fastutil           http://www.apache.org/licenses/LICENSE-2.0.html
        flot               http://www.opensource.org/licenses/mit-license.php
        high-scale-lib     http://creativecommons.org/licenses/publicdomain
        httpclient         http://www.apache.org/licenses/LICENSE-2.0.html
        httpclient-cache   http://www.apache.org/licenses/LICENSE-2.0.html
        httpcore           http://www.apache.org/licenses/LICENSE-2.0.html
        httpmime           http://www.apache.org/licenses/LICENSE-2.0.html
        jetty              http://www.apache.org/licenses/LICENSE-2.0.html
        jquery             https://github.com/jquery/jquery/blob/master/MIT-LICENSE.txt
        log4j              http://www.apache.org/licenses/LICENSE-2.0.html
        lucene             http://www.apache.org/licenses/LICENSE-2.0.html
        nanohttp           http://elonen.iki.fi/code/nanohttpd/#license
        nxparser           http://sw.deri.org/2006/08/nxparser/license.txt
        river              http://www.apache.org/licenses/LICENSE-2.0.html
        servlet-api        http://www.apache.org/licenses/LICENSE-2.0.html
        sesame             http://www.openrdf.org/download.jsp
        slf4j              http://www.slf4j.org/license.html
        zookeeper          http://www.apache.org/licenses/LICENSE-2.0.html
        
        jini : reggie-dl.jar requested from bigdata01.systap.com:34311
        jini : jsk-dl.jar requested from bigdata01.systap.com:34312
        Waiting 5000ms for service discovery.
        Zookeeper is running.
        Discovered 1 jini service registrars.
           192.168.1.50
        Discovered 7 services
        Discovered 0 stale bigdata services.
        Discovered 6 live bigdata services.
        Discovered 1 other services.
        Bigdata services by serviceIface:
          There are 1 instances of com.bigdata.jini.start.IServicesManagerService on 1 hosts
          There are 1 instances of com.bigdata.journal.ITransactionService on 1 hosts
          There are 2 instances of com.bigdata.service.IDataService on 1 hosts
          There are 1 instances of com.bigdata.service.ILoadBalancerService on 1 hosts
          There are 1 instances of com.bigdata.service.IMetadataService on 1 hosts
        Bigdata services by hostname:
          There are 6 live bigdata services on bigdata01.systap.com
            There are 1 com.bigdata.jini.start.IServicesManagerService services
            There are 1 com.bigdata.journal.ITransactionService services
            There are 2 com.bigdata.service.IDataService services
            There are 1 com.bigdata.service.ILoadBalancerService services
            There are 1 com.bigdata.service.IMetadataService services
        
        Show
        bryanthompson bryanthompson added a comment - You need to give "bigdata start" a minute or so to start the various services. At that point I see all services running correctly with no problems in resolving the log4j dependency. listServices.sh java version "1.6.0_27" Java(TM) SE Runtime Environment (build 1.6.0_27-b07) Java HotSpot(TM) 64-Bit Server VM (build 20.2-b06, mixed mode) BIGDATA(R) Flexible Reliable Affordable Web-Scale Computing for the Enterprise Copyright SYSTAP, LLC 2006-2013. All rights reserved. bigdata01.systap.com Thu Aug 08 07:52:05 EDT 2013 Linux/2.6.18-348.1.1.el5 amd64 AMD Phenom(tm) II X4 945 Processor Family 16 Model 4 Stepping 3, AuthenticAMD #CPU=4 Sun Microsystems Inc. 1.6.0_27 freeMemory=244139520 buildVersion=1.2.2 Dependency License ICU http://source.icu-project.org/repos/icu/icu/trunk/license.html bigdata-ganglia http://www.apache.org/licenses/LICENSE-2.0.html colt http://acs.lbl.gov/software/colt/license.html commons-codec http://www.apache.org/licenses/LICENSE-2.0.html commons-fileupload http://www.apache.org/licenses/LICENSE-2.0.html commons-io http://www.apache.org/licenses/LICENSE-2.0.html commons-logging http://www.apache.org/licenses/LICENSE-2.0.html dsiutils http://www.gnu.org/licenses/lgpl-2.1.html fastutil http://www.apache.org/licenses/LICENSE-2.0.html flot http://www.opensource.org/licenses/mit-license.php high-scale-lib http://creativecommons.org/licenses/publicdomain httpclient http://www.apache.org/licenses/LICENSE-2.0.html httpclient-cache http://www.apache.org/licenses/LICENSE-2.0.html httpcore http://www.apache.org/licenses/LICENSE-2.0.html httpmime http://www.apache.org/licenses/LICENSE-2.0.html jetty http://www.apache.org/licenses/LICENSE-2.0.html jquery https://github.com/jquery/jquery/blob/master/MIT-LICENSE.txt log4j http://www.apache.org/licenses/LICENSE-2.0.html lucene http://www.apache.org/licenses/LICENSE-2.0.html nanohttp http://elonen.iki.fi/code/nanohttpd/#license nxparser http://sw.deri.org/2006/08/nxparser/license.txt river http://www.apache.org/licenses/LICENSE-2.0.html servlet-api http://www.apache.org/licenses/LICENSE-2.0.html sesame http://www.openrdf.org/download.jsp slf4j http://www.slf4j.org/license.html zookeeper http://www.apache.org/licenses/LICENSE-2.0.html jini : reggie-dl.jar requested from bigdata01.systap.com:34311 jini : jsk-dl.jar requested from bigdata01.systap.com:34312 Waiting 5000ms for service discovery. Zookeeper is running. Discovered 1 jini service registrars. 192.168.1.50 Discovered 7 services Discovered 0 stale bigdata services. Discovered 6 live bigdata services. Discovered 1 other services. Bigdata services by serviceIface: There are 1 instances of com.bigdata.jini.start.IServicesManagerService on 1 hosts There are 1 instances of com.bigdata.journal.ITransactionService on 1 hosts There are 2 instances of com.bigdata.service.IDataService on 1 hosts There are 1 instances of com.bigdata.service.ILoadBalancerService on 1 hosts There are 1 instances of com.bigdata.service.IMetadataService on 1 hosts Bigdata services by hostname: There are 6 live bigdata services on bigdata01.systap.com There are 1 com.bigdata.jini.start.IServicesManagerService services There are 1 com.bigdata.journal.ITransactionService services There are 2 com.bigdata.service.IDataService services There are 1 com.bigdata.service.ILoadBalancerService services There are 1 com.bigdata.service.IMetadataService services

          People

          • Assignee:
            Unassigned
            Reporter:
            silversail silversail
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: