Uploaded image for project: 'Blazegraph (by SYSTAP)'
  1. Blazegraph (by SYSTAP)
  2. BLZG-641 Improve load performance
  3. BLZG-1650

DataLoader should sort files within each directory to establish a stable order for file loading

    XMLWordPrintable

    Details

    • Type: Sub-task
    • Status: Done
    • Priority: Medium
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: BLAZEGRAPH_2_0_0
    • Component/s: None
    • Labels:
      None

      Description

      File.list() is not returning a sorted list. We should modify the code to explicitly sort the files in the current directory by the last component of the File path name. See DataLoader#1249

                  final File[] files = (filter != null ? file.listFiles(filter)
                          : file.listFiles());
      

      Note: Users can still specify a list of files or directories on the command line. My inclination is NOT to sort that list. Only to sort when we call listFiles() from within the DataLoader code.

        Attachments

          Activity

            People

            Assignee:
            michaelschmidt michaelschmidt
            Reporter:
            bryanthompson bryanthompson
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: