Details

      Description

      Prepare a 1.0.3 maintenance release which incorporates the enhancement described by [1].

      [1] https://sourceforge.net/apps/trac/bigdata/ticket/422 (Support temp triple store wrapped by a BigdataSail)

        Activity

        Hide
        bryanthompson bryanthompson added a comment -

        This is a minor maintenance release. The following changes exist with reference to the 1.0.2 release:

        - https://sourceforge.net/apps/trac/bigdata/ticket/269  (Refactor performance counters using accessor interface)
        - https://sourceforge.net/apps/trac/bigdata/ticket/385  (FastRDFValueCoder2: ArrayIndexOutOfBoundsException)
        - https://sourceforge.net/apps/trac/bigdata/ticket/391  (Release age advanced on WORM mode journal)
        - https://sourceforge.net/apps/trac/bigdata/ticket/392  (Add a DELETE by access path method to the NanoSparqlServer)
        - https://sourceforge.net/apps/trac/bigdata/ticket/393  (Add "context-uri" request parameter to specify the default context for INSERT in the REST API)
        - https://sourceforge.net/apps/trac/bigdata/ticket/394  (log4j configuration error message in WAR deployment)
        - https://sourceforge.net/apps/trac/bigdata/ticket/399  (Add a fast range count method to the REST API)
        - https://sourceforge.net/apps/trac/bigdata/ticket/422  (Support temp triple store wrapped by a BigdataSail)
        - https://sourceforge.net/apps/trac/bigdata/ticket/424  (NQuads support for NanoSparqlServer)
        - https://sourceforge.net/apps/trac/bigdata/ticket/425  (Bug fix to DEFAULT_RDF_FORMAT for bulk data loader in scale-out)
        - https://sourceforge.net/apps/trac/bigdata/ticket/426  (Support either lockfile (procmail) and dotlockfile (liblockfile1) in scale-out)
        
        Show
        bryanthompson bryanthompson added a comment - This is a minor maintenance release. The following changes exist with reference to the 1.0.2 release: - https://sourceforge.net/apps/trac/bigdata/ticket/269 (Refactor performance counters using accessor interface) - https://sourceforge.net/apps/trac/bigdata/ticket/385 (FastRDFValueCoder2: ArrayIndexOutOfBoundsException) - https://sourceforge.net/apps/trac/bigdata/ticket/391 (Release age advanced on WORM mode journal) - https://sourceforge.net/apps/trac/bigdata/ticket/392 (Add a DELETE by access path method to the NanoSparqlServer) - https://sourceforge.net/apps/trac/bigdata/ticket/393 (Add "context-uri" request parameter to specify the default context for INSERT in the REST API) - https://sourceforge.net/apps/trac/bigdata/ticket/394 (log4j configuration error message in WAR deployment) - https://sourceforge.net/apps/trac/bigdata/ticket/399 (Add a fast range count method to the REST API) - https://sourceforge.net/apps/trac/bigdata/ticket/422 (Support temp triple store wrapped by a BigdataSail) - https://sourceforge.net/apps/trac/bigdata/ticket/424 (NQuads support for NanoSparqlServer) - https://sourceforge.net/apps/trac/bigdata/ticket/425 (Bug fix to DEFAULT_RDF_FORMAT for bulk data loader in scale-out) - https://sourceforge.net/apps/trac/bigdata/ticket/426 (Support either lockfile (procmail) and dotlockfile (liblockfile1) in scale-out)
        Hide
        bryanthompson bryanthompson added a comment -

        The following additional issue is resolved against this release


        - http://sourceforge.net/apps/trac/bigdata/ticket/427 (BigdataSail#getReadOnlyConnection() race condition with concurrent commit)

        Show
        bryanthompson bryanthompson added a comment - The following additional issue is resolved against this release - http://sourceforge.net/apps/trac/bigdata/ticket/427 (BigdataSail#getReadOnlyConnection() race condition with concurrent commit)
        Hide
        bryanthompson bryanthompson added a comment -

        Blocking on https://sourceforge.net/apps/trac/bigdata/ticket/436 (TestMROWTransactions)

        BSBM 100M: workstation (16G, standard disk)

        [java] loading: 100000748 stmts added in 4094.391 secs, rate= 24423, commitLatency=0ms
        Data on disk: 23G
        
        QMpH:                   34452.70 query mixes per hour
        QMpH:                   34417.78 query mixes per hour
        QMpH:                   34477.78 query mixes per hour
        QMpH:                   34559.20 query mixes per hour
        QMpH:                   34840.84 query mixes per hour
        QMpH:                   32723.32 query mixes per hour
        QMpH:                   34550.56 query mixes per hour
        QMpH:                   35083.95 query mixes per hour
        QMpH:                   34589.76 query mixes per hour
        QMpH:                   34670.37 query mixes per hour
        QMpH:                   34911.11 query mixes per hour
        
        CPU 52%; IO Wait 1%-2%. 
        
        Show
        bryanthompson bryanthompson added a comment - Blocking on https://sourceforge.net/apps/trac/bigdata/ticket/436 (TestMROWTransactions) BSBM 100M: workstation (16G, standard disk) [java] loading: 100000748 stmts added in 4094.391 secs, rate= 24423, commitLatency=0ms Data on disk: 23G QMpH: 34452.70 query mixes per hour QMpH: 34417.78 query mixes per hour QMpH: 34477.78 query mixes per hour QMpH: 34559.20 query mixes per hour QMpH: 34840.84 query mixes per hour QMpH: 32723.32 query mixes per hour QMpH: 34550.56 query mixes per hour QMpH: 35083.95 query mixes per hour QMpH: 34589.76 query mixes per hour QMpH: 34670.37 query mixes per hour QMpH: 34911.11 query mixes per hour CPU 52%; IO Wait 1%-2%.
        Hide
        bryanthompson bryanthompson added a comment -

        LUBM U50:

        Load: 6890949 stmts added in 191.874 secs, rate= 35913, commitLatency=0ms
        Closure: ClosureStats{mutationCount=1699274, elapsed=107623ms, rate=15789}
        Data on disk: 818M
        
        First trial: immediately after loading the data (warm disk)
             [java] BIGDATA_SPARQL_ENDPOINT     #trials=10      #parallel=1
             [java] query       Time    Result#
             [java] query1      87      4
             [java] query3      56      6
             [java] query4      114     34
             [java] query5      77      719
             [java] query7      36      61
             [java] query8      265     6463
             [java] query10     38      0
             [java] query11     37      0
             [java] query12     39      0
             [java] query13     36      0
             [java] query14     2749    393730
             [java] query6      2673    430114
             [java] query2      771     130
             [java] query9      3548    8627
             [java] Total       10526
        
        Second trial: (warm disk + warm code)
        
             [java] BIGDATA_SPARQL_ENDPOINT     #trials=10      #parallel=1
             [java] query       Time    Result#
             [java] query1      40      4
             [java] query3      28      6
             [java] query4      49      34
             [java] query5      48      719
             [java] query7      32      61
             [java] query8      169     6463
             [java] query10     34      0
             [java] query11     34      0
             [java] query12     38      0
             [java] query13     35      0
             [java] query14     2487    393730
             [java] query6      2692    430114
             [java] query2      583     130
             [java] query9      3601    8627
             [java] Total       9870
        
        Show
        bryanthompson bryanthompson added a comment - LUBM U50: Load: 6890949 stmts added in 191.874 secs, rate= 35913, commitLatency=0ms Closure: ClosureStats{mutationCount=1699274, elapsed=107623ms, rate=15789} Data on disk: 818M First trial: immediately after loading the data (warm disk) [java] BIGDATA_SPARQL_ENDPOINT #trials=10 #parallel=1 [java] query Time Result# [java] query1 87 4 [java] query3 56 6 [java] query4 114 34 [java] query5 77 719 [java] query7 36 61 [java] query8 265 6463 [java] query10 38 0 [java] query11 37 0 [java] query12 39 0 [java] query13 36 0 [java] query14 2749 393730 [java] query6 2673 430114 [java] query2 771 130 [java] query9 3548 8627 [java] Total 10526 Second trial: (warm disk + warm code) [java] BIGDATA_SPARQL_ENDPOINT #trials=10 #parallel=1 [java] query Time Result# [java] query1 40 4 [java] query3 28 6 [java] query4 49 34 [java] query5 48 719 [java] query7 32 61 [java] query8 169 6463 [java] query10 34 0 [java] query11 34 0 [java] query12 38 0 [java] query13 35 0 [java] query14 2487 393730 [java] query6 2692 430114 [java] query2 583 130 [java] query9 3601 8627 [java] Total 9870

          People

          • Assignee:
            bryanthompson bryanthompson
            Reporter:
            bryanthompson bryanthompson
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: