Uploaded image for project: 'Blazegraph (by SYSTAP)'
  1. Blazegraph (by SYSTAP)
  2. BLZG-641 Improve load performance
  3. BLZG-1562

DataLoader.Options.FLUSH does not defer flush of StatementBuffer

    XMLWordPrintable

    Details

    • Type: Sub-task
    • Status: Done
    • Priority: Medium
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: BLAZEGRAPH_2_0_0
    • Component/s: None
    • Labels:
      None

      Description

      The DataLoader.Option.FLUSH option is intended to allow a large number of small files to be written onto a StatementBuffer and the StatementBuffer should only be flushed when it becomes full or when the end of a batch or all inputs has been reached.

      There are two bugs that are defeating this feature.

      1. PresortRioLoader.success() was unconditionally flushing the StatementBuffer.
      2. DataLoader was clearing the StatementBuffer before loading each file into it.

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              bryanthompson bryanthompson
              Reporter:
              bryanthompson bryanthompson
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: