Uploaded image for project: 'Blazegraph (by SYSTAP)'
  1. Blazegraph (by SYSTAP)
  2. BLZG-251

Distributed tuple cache vs Distributed Hash Tables (DHTs)

    Details

      Description

      Implement and evaluate an optional tuple level cache in front of the B+Tree to support faster point tests for frequently accessed tuples. For example, this could be used to buffer resolution of term identifiers to RDF Values on the ID2TERM index.

      There is already a termCache in the LexiconRelation which plays this role. The questions are (a) whether the term cache can be usefully extracted from the LexiconRelation and made a part of the B+Tree interface itself (which might require indexing by a byte[] key rather than a Long) and (b) whether distributed hash tables (DHTs) might be approach all around for such data. The drawbacks of DHTs are: (1) they are more difficult to rebalance when the size of the cluster changes; (2) this would be an entirely new persistent data structure for bigdata; and (3) cache fabrics already specialize in DHTs.

        Activity

        beebs Brad Bebee created issue -
        beebs Brad Bebee made changes -
        Field Original Value New Value
        Workflow Trac Import v2 [ 12087 ] Trac Import v3 [ 13693 ]
        beebs Brad Bebee made changes -
        Workflow Trac Import v3 [ 13693 ] Trac Import v4 [ 15022 ]
        beebs Brad Bebee made changes -
        Workflow Trac Import v4 [ 15022 ] Trac Import v5 [ 16408 ]
        beebs Brad Bebee made changes -
        Labels Issue_patch_20150625
        beebs Brad Bebee made changes -
        Status Closed - Won't Fix [ 6 ] Open [ 1 ]
        beebs Brad Bebee made changes -
        Status Open [ 1 ] Accepted [ 10101 ]
        beebs Brad Bebee made changes -
        Status Accepted [ 10101 ] In Progress [ 3 ]
        beebs Brad Bebee made changes -
        Status In Progress [ 3 ] Resolved [ 5 ]
        beebs Brad Bebee made changes -
        Status Resolved [ 5 ] In Review [ 10100 ]
        beebs Brad Bebee made changes -
        Resolution Won't Fix [ 2 ] Done [ 10000 ]
        Status In Review [ 10100 ] Done [ 10000 ]
        beebs Brad Bebee made changes -
        Workflow Trac Import v5 [ 16408 ] Trac Import v6 [ 17668 ]
        beebs Brad Bebee made changes -
        Workflow Trac Import v6 [ 17668 ] Trac Import v7 [ 19065 ]
        beebs Brad Bebee made changes -
        Workflow Trac Import v7 [ 19065 ] Trac Import v8 [ 20686 ]

          People

          • Assignee:
            Unassigned
            Reporter:
            bryanthompson bryanthompson
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: