Uploaded image for project: 'Blazegraph (by SYSTAP)'
  1. Blazegraph (by SYSTAP)
  2. BLZG-1101

Feature request: pre-heat the journal on startup

    Details

      Description

      A start of the journal against cold disk will have significant IO latency when compared to hot performance. A solution for this is a warm up procedure.

      Workaround: on startup use the DumpJournal utility (which is also accessible from the REST API) to force a full scan of all index pages: See http://wiki.bigdata.com/wiki/index.php/IOOptimization#Branching_Factors

      Proposed solution: Use a modified version of the logic in DumpJournal to scan only the non-leaf nodes of the committed versions of the indices. This will force them into both the file system and Java heaps.

      Note: the warmup procedure is integrated into web.xml. It can be enabled using the warmupTimeout context-param in web.xml.

        Issue Links

          Activity

          beebs Brad Bebee created issue -
          beebs Brad Bebee made changes -
          Field Original Value New Value
          Workflow Trac Import v2 [ 12937 ] Trac Import v3 [ 14414 ]
          beebs Brad Bebee made changes -
          Workflow Trac Import v3 [ 14414 ] Trac Import v4 [ 15743 ]
          beebs Brad Bebee made changes -
          Workflow Trac Import v4 [ 15743 ] Trac Import v5 [ 17129 ]
          beebs Brad Bebee made changes -
          Labels Issue_patch_20150625
          beebs Brad Bebee made changes -
          Status Closed - Won't Fix [ 6 ] Open [ 1 ]
          beebs Brad Bebee made changes -
          Status Open [ 1 ] Accepted [ 10101 ]
          beebs Brad Bebee made changes -
          Status Accepted [ 10101 ] In Progress [ 3 ]
          beebs Brad Bebee made changes -
          Status In Progress [ 3 ] Resolved [ 5 ]
          beebs Brad Bebee made changes -
          Status Resolved [ 5 ] In Review [ 10100 ]
          beebs Brad Bebee made changes -
          Resolution Fixed [ 1 ] Done [ 10000 ]
          Status In Review [ 10100 ] Done [ 10000 ]
          beebs Brad Bebee made changes -
          Workflow Trac Import v5 [ 17129 ] Trac Import v6 [ 18296 ]
          michaelschmidt michaelschmidt made changes -
          Fix Version/s BLAZEGRAPH_RELEASE_1_5_2 [ 10164 ]
          beebs Brad Bebee made changes -
          Workflow Trac Import v6 [ 18296 ] Trac Import v7 [ 19693 ]
          bryanthompson bryanthompson made changes -
          Link This issue relates to BLZG-1546 [ BLZG-1546 ]
          beebs Brad Bebee made changes -
          Workflow Trac Import v7 [ 19693 ] Trac Import v8 [ 21316 ]

            People

            • Assignee:
              bryanthompson bryanthompson
              Reporter:
              bryanthompson bryanthompson
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: