Uploaded image for project: 'Blazegraph (by SYSTAP)'
  1. Blazegraph (by SYSTAP)
  2. BLZG-641 Improve load performance
  3. BLZG-1534

Poor person's durable queues pattern for DataLoader

    XMLWordPrintable

    Details

      Description

      Add a durable queues pattern to the DataLoader. Files are renamed once they have been processed. A file that has been successfully loaded can be renamed by adding a ".ok" suffix. A file that has encountered an error during load can be renamed by adding a ".fail" suffix. The files can stay in the current directory and the file filter will ignore .ok and .fail files.

        Attachments

          Activity

            People

            Assignee:
            bryanthompson bryanthompson
            Reporter:
            bryanthompson bryanthompson
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: