Uploaded image for project: 'Blazegraph (by SYSTAP)'
  1. Blazegraph (by SYSTAP)
  2. BLZG-767

Flush indices in parallel during checkpoint to reduce IO latency

    Details

    • Type: New Feature
    • Status: Done
    • Resolution: Done
    • Affects Version/s: BIGDATA_RELEASE_1_2_2
    • Fix Version/s: None
    • Component/s: Journal

      Description

      The code in Name2Addr, AbstractTask, and Tx checkpoints the dirty indices one at a time. The code should checkpoint the indices in parallel to reduce the IO latency and achieve peak IO throughput for the commit.

        Activity

        Hide
        bryanthompson bryanthompson added a comment -

        Refactored Name2Addr, AbstractTask, and Tx to checkpoint the indices in parallel to reduce latency during commit protocols.

        Committed revision r7126.

        Show
        bryanthompson bryanthompson added a comment - Refactored Name2Addr, AbstractTask, and Tx to checkpoint the indices in parallel to reduce latency during commit protocols. Committed revision r7126.
        Hide
        bryanthompson bryanthompson added a comment -

        CI is clean for this refactor.

        Show
        bryanthompson bryanthompson added a comment - CI is clean for this refactor.
        Hide
        bryanthompson bryanthompson added a comment -

        BSBM 100M load on bigdata11:

        ls/trunk/td_100m/dataset.nt.gz, totalStatementsSoFar=100000000
             [java] loading: 100000748 stmts added in 3312.217 secs, rate= 30191, commitLatency=0ms
             [java] INFO : DataLoader.java:1094: file:: 100000748 stmts added in 3312.217 secs, rate= 30191, commitLatency=0ms; totals:: 100000748 stmts added in 3312.217 secs, rate= 30191, commitLatency=0ms; baseURL=file:/root/workspace/bsbmtools/trunk/td_100m/dataset.nt.gz
             [java] Load: 100000748 stmts added in 3312.217 secs, rate= 30191, commitLatency=0ms
             [java] Wrote: 13304463360 bytes.
             [java] Total elapsed=3315805ms
             [java] INFO : DataLoader.java:1552: Total elapsed=3315805ms
        

        BSBM EXPLORE

        root@bigdata11:~/workspace/bsbmtools/trunk# for a in `seq 120`; do ./testdriver -o mt_16.xml -seed $RANDOM -w 50 -mt 16 -idir td_100m/td_data http://localhost:80/sparql|grep QMpH;done;
        QMpH:                   19147.49 query mixes per hour
        QMpH:                   32343.66 query mixes per hour
        QMpH:                   38629.71 query mixes per hour
        QMpH:                   48576.32 query mixes per hour
        QMpH:                   48811.60 query mixes per hour
        QMpH:                   49082.86 query mixes per hour
        QMpH:                   49624.78 query mixes per hour
        QMpH:                   49156.67 query mixes per hour
        QMpH:                   49144.94 query mixes per hour
        QMpH:                   49417.71 query mixes per hour
        QMpH:                   49631.13 query mixes per hour
        QMpH:                   50955.23 query mixes per hour
        QMpH:                   49278.84 query mixes per hour
        QMpH:                   51042.22 query mixes per hour
        QMpH:                   50262.32 query mixes per hour
        QMpH:                   49430.75 query mixes per hour
        QMpH:                   51090.35 query mixes per hour
        QMpH:                   51176.95 query mixes per hour
        QMpH:                   48863.26 query mixes per hour
        QMpH:                   51536.94 query mixes per hour
        QMpH:                   49087.62 query mixes per hour
        QMpH:                   51319.65 query mixes per hour
        QMpH:                   49566.12 query mixes per hour
        QMpH:                   50835.94 query mixes per hour
        QMpH:                   51610.29 query mixes per hour
        QMpH:                   49154.25 query mixes per hour
        QMpH:                   50686.84 query mixes per hour
        QMpH:                   51542.31 query mixes per hour
        QMpH:                   49423.08 query mixes per hour
        QMpH:                   51256.14 query mixes per hour
        QMpH:                   51480.40 query mixes per hour
        QMpH:                   51746.27 query mixes per hour
        QMpH:                   48533.99 query mixes per hour
        QMpH:                   50893.74 query mixes per hour
        QMpH:                   51768.26 query mixes per hour
        QMpH:                   48629.98 query mixes per hour
        QMpH:                   50546.74 query mixes per hour
        QMpH:                   51485.57 query mixes per hour
        QMpH:                   51379.86 query mixes per hour
        QMpH:                   51977.55 query mixes per hour
        QMpH:                   47959.53 query mixes per hour
        QMpH:                   51621.45 query mixes per hour
        QMpH:                   51700.99 query mixes per hour
        QMpH:                   51990.71 query mixes per hour
        QMpH:                   51540.77 query mixes per hour
        QMpH:                   47690.38 query mixes per hour
        QMpH:                   51176.68 query mixes per hour
        QMpH:                   51491.53 query mixes per hour
        QMpH:                   51769.71 query mixes per hour
        QMpH:                   51862.11 query mixes per hour
        QMpH:                   47965.93 query mixes per hour
        QMpH:                   51275.68 query mixes per hour
        QMpH:                   51696.22 query mixes per hour
        QMpH:                   52057.14 query mixes per hour
        QMpH:                   51793.16 query mixes per hour
        QMpH:                   51856.14 query mixes per hour
        QMpH:                   47591.61 query mixes per hour
        QMpH:                   51447.21 query mixes per hour
        QMpH:                   51634.86 query mixes per hour
        QMpH:                   51500.55 query mixes per hour
        QMpH:                   51775.73 query mixes per hour
        QMpH:                   51632.40 query mixes per hour
        QMpH:                   47658.34 query mixes per hour
        QMpH:                   50731.74 query mixes per hour
        QMpH:                   51685.57 query mixes per hour
        QMpH:                   51315.21 query mixes per hour
        QMpH:                   51836.02 query mixes per hour
        QMpH:                   51686.10 query mixes per hour
        QMpH:                   51540.05 query mixes per hour
        QMpH:                   47276.89 query mixes per hour
        QMpH:                   51112.90 query mixes per hour
        QMpH:                   51342.47 query mixes per hour
        QMpH:                   51406.88 query mixes per hour
        QMpH:                   51334.62 query mixes per hour
        QMpH:                   51804.18 query mixes per hour
        QMpH:                   51486.17 query mixes per hour
        QMpH:                   47829.48 query mixes per hour
        QMpH:                   50962.28 query mixes per hour
        QMpH:                   51935.24 query mixes per hour
        QMpH:                   51581.04 query mixes per hour
        QMpH:                   51861.90 query mixes per hour
        QMpH:                   51698.67 query mixes per hour
        QMpH:                   51637.50 query mixes per hour
        QMpH:                   51482.10 query mixes per hour
        QMpH:                   47394.31 query mixes per hour
        QMpH:                   51033.55 query mixes per hour
        QMpH:                   51330.17 query mixes per hour
        QMpH:                   51474.95 query mixes per hour
        QMpH:                   52066.73 query mixes per hour
        QMpH:                   51772.14 query mixes per hour
        QMpH:                   51426.74 query mixes per hour
        QMpH:                   51260.37 query mixes per hour
        QMpH:                   46898.31 query mixes per hour
        QMpH:                   50903.86 query mixes per hour
        QMpH:                   51787.11 query mixes per hour
        QMpH:                   51470.76 query mixes per hour
        QMpH:                   51586.16 query mixes per hour
        QMpH:                   51482.45 query mixes per hour
        QMpH:                   51264.65 query mixes per hour
        QMpH:                   51913.49 query mixes per hour
        QMpH:                   51117.13 query mixes per hour
        QMpH:                   46600.19 query mixes per hour
        QMpH:                   51082.54 query mixes per hour
        QMpH:                   51640.36 query mixes per hour
        QMpH:                   51543.16 query mixes per hour
        QMpH:                   51404.88 query mixes per hour
        QMpH:                   51569.84 query mixes per hour
        QMpH:                   51859.50 query mixes per hour
        QMpH:                   51942.65 query mixes per hour
        QMpH:                   51915.65 query mixes per hour
        QMpH:                   51568.24 query mixes per hour
        QMpH:                   45826.10 query mixes per hour
        QMpH:                   51333.03 query mixes per hour
        QMpH:                   51447.08 query mixes per hour
        QMpH:                   51958.18 query mixes per hour
        QMpH:                   52069.75 query mixes per hour
        QMpH:                   51745.51 query mixes per hour
        QMpH:                   51578.25 query mixes per hour
        QMpH:                   51462.74 query mixes per hour
        QMpH:                   51850.28 query mixes per hour
        
        Show
        bryanthompson bryanthompson added a comment - BSBM 100M load on bigdata11: ls/trunk/td_100m/dataset.nt.gz, totalStatementsSoFar=100000000 [java] loading: 100000748 stmts added in 3312.217 secs, rate= 30191, commitLatency=0ms [java] INFO : DataLoader.java:1094: file:: 100000748 stmts added in 3312.217 secs, rate= 30191, commitLatency=0ms; totals:: 100000748 stmts added in 3312.217 secs, rate= 30191, commitLatency=0ms; baseURL=file:/root/workspace/bsbmtools/trunk/td_100m/dataset.nt.gz [java] Load: 100000748 stmts added in 3312.217 secs, rate= 30191, commitLatency=0ms [java] Wrote: 13304463360 bytes. [java] Total elapsed=3315805ms [java] INFO : DataLoader.java:1552: Total elapsed=3315805ms BSBM EXPLORE root@bigdata11:~/workspace/bsbmtools/trunk# for a in `seq 120`; do ./testdriver -o mt_16.xml -seed $RANDOM -w 50 -mt 16 -idir td_100m/td_data http://localhost:80/sparql|grep QMpH;done; QMpH: 19147.49 query mixes per hour QMpH: 32343.66 query mixes per hour QMpH: 38629.71 query mixes per hour QMpH: 48576.32 query mixes per hour QMpH: 48811.60 query mixes per hour QMpH: 49082.86 query mixes per hour QMpH: 49624.78 query mixes per hour QMpH: 49156.67 query mixes per hour QMpH: 49144.94 query mixes per hour QMpH: 49417.71 query mixes per hour QMpH: 49631.13 query mixes per hour QMpH: 50955.23 query mixes per hour QMpH: 49278.84 query mixes per hour QMpH: 51042.22 query mixes per hour QMpH: 50262.32 query mixes per hour QMpH: 49430.75 query mixes per hour QMpH: 51090.35 query mixes per hour QMpH: 51176.95 query mixes per hour QMpH: 48863.26 query mixes per hour QMpH: 51536.94 query mixes per hour QMpH: 49087.62 query mixes per hour QMpH: 51319.65 query mixes per hour QMpH: 49566.12 query mixes per hour QMpH: 50835.94 query mixes per hour QMpH: 51610.29 query mixes per hour QMpH: 49154.25 query mixes per hour QMpH: 50686.84 query mixes per hour QMpH: 51542.31 query mixes per hour QMpH: 49423.08 query mixes per hour QMpH: 51256.14 query mixes per hour QMpH: 51480.40 query mixes per hour QMpH: 51746.27 query mixes per hour QMpH: 48533.99 query mixes per hour QMpH: 50893.74 query mixes per hour QMpH: 51768.26 query mixes per hour QMpH: 48629.98 query mixes per hour QMpH: 50546.74 query mixes per hour QMpH: 51485.57 query mixes per hour QMpH: 51379.86 query mixes per hour QMpH: 51977.55 query mixes per hour QMpH: 47959.53 query mixes per hour QMpH: 51621.45 query mixes per hour QMpH: 51700.99 query mixes per hour QMpH: 51990.71 query mixes per hour QMpH: 51540.77 query mixes per hour QMpH: 47690.38 query mixes per hour QMpH: 51176.68 query mixes per hour QMpH: 51491.53 query mixes per hour QMpH: 51769.71 query mixes per hour QMpH: 51862.11 query mixes per hour QMpH: 47965.93 query mixes per hour QMpH: 51275.68 query mixes per hour QMpH: 51696.22 query mixes per hour QMpH: 52057.14 query mixes per hour QMpH: 51793.16 query mixes per hour QMpH: 51856.14 query mixes per hour QMpH: 47591.61 query mixes per hour QMpH: 51447.21 query mixes per hour QMpH: 51634.86 query mixes per hour QMpH: 51500.55 query mixes per hour QMpH: 51775.73 query mixes per hour QMpH: 51632.40 query mixes per hour QMpH: 47658.34 query mixes per hour QMpH: 50731.74 query mixes per hour QMpH: 51685.57 query mixes per hour QMpH: 51315.21 query mixes per hour QMpH: 51836.02 query mixes per hour QMpH: 51686.10 query mixes per hour QMpH: 51540.05 query mixes per hour QMpH: 47276.89 query mixes per hour QMpH: 51112.90 query mixes per hour QMpH: 51342.47 query mixes per hour QMpH: 51406.88 query mixes per hour QMpH: 51334.62 query mixes per hour QMpH: 51804.18 query mixes per hour QMpH: 51486.17 query mixes per hour QMpH: 47829.48 query mixes per hour QMpH: 50962.28 query mixes per hour QMpH: 51935.24 query mixes per hour QMpH: 51581.04 query mixes per hour QMpH: 51861.90 query mixes per hour QMpH: 51698.67 query mixes per hour QMpH: 51637.50 query mixes per hour QMpH: 51482.10 query mixes per hour QMpH: 47394.31 query mixes per hour QMpH: 51033.55 query mixes per hour QMpH: 51330.17 query mixes per hour QMpH: 51474.95 query mixes per hour QMpH: 52066.73 query mixes per hour QMpH: 51772.14 query mixes per hour QMpH: 51426.74 query mixes per hour QMpH: 51260.37 query mixes per hour QMpH: 46898.31 query mixes per hour QMpH: 50903.86 query mixes per hour QMpH: 51787.11 query mixes per hour QMpH: 51470.76 query mixes per hour QMpH: 51586.16 query mixes per hour QMpH: 51482.45 query mixes per hour QMpH: 51264.65 query mixes per hour QMpH: 51913.49 query mixes per hour QMpH: 51117.13 query mixes per hour QMpH: 46600.19 query mixes per hour QMpH: 51082.54 query mixes per hour QMpH: 51640.36 query mixes per hour QMpH: 51543.16 query mixes per hour QMpH: 51404.88 query mixes per hour QMpH: 51569.84 query mixes per hour QMpH: 51859.50 query mixes per hour QMpH: 51942.65 query mixes per hour QMpH: 51915.65 query mixes per hour QMpH: 51568.24 query mixes per hour QMpH: 45826.10 query mixes per hour QMpH: 51333.03 query mixes per hour QMpH: 51447.08 query mixes per hour QMpH: 51958.18 query mixes per hour QMpH: 52069.75 query mixes per hour QMpH: 51745.51 query mixes per hour QMpH: 51578.25 query mixes per hour QMpH: 51462.74 query mixes per hour QMpH: 51850.28 query mixes per hour

          People

          • Assignee:
            bryanthompson bryanthompson
            Reporter:
            bryanthompson bryanthompson
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: