Uploaded image for project: 'Blazegraph (by SYSTAP)'
  1. Blazegraph (by SYSTAP)
  2. BLZG-1171

Concurrent modification problem with group commit.

    Details

    • Type: Bug
    • Status: Done
    • Resolution: Done
    • Affects Version/s: BIGDATA_RELEASE_1_5_0
    • Fix Version/s: None
    • Component/s: B+Tree

      Description

      The HA test suite now runs nearly green when group commit is enabled. However a few tests are hitting an NPE. This would appear to be a problem with copy-on-write causing the clear of the data reference inside of a Leaf during SPARQL UPDATE processing.

      To replicate, run the HA test suite after modifying the following line in the HAJournal-[ABCDE].config files. This enables group commit for all HAJournal instances used by the test suite.

            new NV(com.bigdata.journal.Journal.Options.GROUP_COMMIT,System.getProperty("groupCommit","true")),
      
      java.util.concurrent.ExecutionException: com.bigdata.rdf.sail.webapp.client.HttpException: Status Code=500, Status Line=Server Error, Response=SPARQL-UPDATE: updateStr=DROP ALL;
      LOAD <file:/Users/bryan/git/bigdata/bigdata-rdf/src/resources/data/foaf/data-0.nq.gz>;
      LOAD <file:/Users/bryan/git/bigdata/bigdata-rdf/src/resources/data/foaf/data-1.nq.gz>;
      LOAD <file:/Users/bryan/git/bigdata/bigdata-rdf/src/resources/data/foaf/data-2.nq.gz>;
      INSERT {?x rdfs:label ?y . } WHERE {?x foaf:name ?y };
      PREFIX dc: <http://purl.org/dc/elements/1.1/>
      INSERT DATA
      {
        <http://example/book1> dc:title "A new book" ;
          dc:creator "A.N.Other" .
      }
      
      java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.NullPointerException
      	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
      	at java.util.concurrent.FutureTask.get(FutureTask.java:188)
      	at com.bigdata.rdf.sail.webapp.BigdataServlet.submitApiTask(BigdataServlet.java:260)
      	at com.bigdata.rdf.sail.webapp.QueryServlet.doSparqlUpdate(QueryServlet.java:359)
      	at com.bigdata.rdf.sail.webapp.QueryServlet.doPost(QueryServlet.java:165)
      	at com.bigdata.rdf.sail.webapp.RESTServlet.doPost(RESTServlet.java:237)
      	at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
      	at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
      	at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:769)
      	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
      	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
      	at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:577)
      	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223)
      	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1125)
      	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
      	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
      	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1059)
      	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
      	at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
      	at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110)
      	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
      	at org.eclipse.jetty.server.Server.handle(Server.java:497)
      	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311)
      	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:248)
      	at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
      	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:610)
      	at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:539)
      	at java.lang.Thread.run(Thread.java:745)
      Caused by: java.lang.RuntimeException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.NullPointerException
      	at com.bigdata.journal.AbstractTask$InnerWriteServiceCallable.call(AbstractTask.java:2364)
      	at com.bigdata.journal.AbstractTask.doUnisolatedReadWriteTask(AbstractTask.java:2100)
      	at com.bigdata.journal.AbstractTask.call2(AbstractTask.java:2029)
      	at com.bigdata.journal.AbstractTask.call(AbstractTask.java:1895)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      	at com.bigdata.concurrent.FutureTaskMon.run(FutureTaskMon.java:63)
      	at com.bigdata.concurrent.NonBlockingLockManagerWithNewDesign$LockFutureTask.run(NonBlockingLockManagerWithNewDesign.java:1984)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	... 1 more
      Caused by: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.NullPointerException
      	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
      	at java.util.concurrent.FutureTask.get(FutureTask.java:188)
      	at com.bigdata.rdf.sail.webapp.QueryServlet$SparqlUpdateTask.call(QueryServlet.java:460)
      	at com.bigdata.rdf.sail.webapp.QueryServlet$SparqlUpdateTask.call(QueryServlet.java:1)
      	at com.bigdata.rdf.task.ApiTaskForJournal.doTask(ApiTaskForJournal.java:72)
      	at com.bigdata.journal.AbstractTask$InnerWriteServiceCallable.call(AbstractTask.java:2343)
      	... 9 more
      Caused by: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.NullPointerException
      	at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1303)
      	at com.bigdata.rdf.sail.BigdataSailUpdate.execute2(BigdataSailUpdate.java:152)
      	at com.bigdata.rdf.sail.webapp.BigdataRDFContext$UpdateTask.doQuery(BigdataRDFContext.java:1669)
      	at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.innerCall(BigdataRDFContext.java:1309)
      	at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.call(BigdataRDFContext.java:1274)
      	at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.call(BigdataRDFContext.java:1)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      	... 3 more
      Caused by: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.NullPointerException
      	at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.checkFuture(BlockingBuffer.java:1523)
      	at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator._hasNext(BlockingBuffer.java:1710)
      	at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.hasNext(BlockingBuffer.java:1563)
      	at com.bigdata.relation.accesspath.ChunkConsumerIterator.hasNext(ChunkConsumerIterator.java:132)
      	at com.bigdata.rdf.changesets.StatementWriter.nextChunk(StatementWriter.java:183)
      	at com.bigdata.rdf.changesets.StatementWriter.removeStatements(StatementWriter.java:136)
      	at com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.removeStatements(BigdataSail.java:2930)
      	at com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.removeStatements(BigdataSail.java:2828)
      	at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.clearGraph(AST2BOpUpdate.java:1822)
      	at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertClearOrDropGraph(AST2BOpUpdate.java:1668)
      	at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertUpdateSwitch(AST2BOpUpdate.java:406)
      	at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertUpdate(AST2BOpUpdate.java:279)
      	at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1295)
      	... 9 more
      Caused by: java.util.concurrent.ExecutionException: java.lang.NullPointerException
      	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
      	at java.util.concurrent.FutureTask.get(FutureTask.java:188)
      	at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.checkFuture(BlockingBuffer.java:1454)
      	... 21 more
      Caused by: java.lang.NullPointerException
      	at com.bigdata.btree.Leaf.hasDeleteMarkers(Leaf.java:272)
      	at com.bigdata.btree.AbstractTuple.copy(AbstractTuple.java:352)
      	at com.bigdata.btree.LeafTupleIterator.next(LeafTupleIterator.java:222)
      	at com.bigdata.btree.LeafTupleIterator.next(LeafTupleIterator.java:1)
      	at cutthecrap.utils.striterators.Expanderator.getNext(Expanderator.java:42)
      	at cutthecrap.utils.striterators.Prefetch.checkInit(Prefetch.java:27)
      	at cutthecrap.utils.striterators.Prefetch.hasNext(Prefetch.java:35)
      	at cutthecrap.utils.striterators.Striterator.hasNext(Striterator.java:89)
      	at com.bigdata.btree.AbstractNode$PostOrderEntryIterator.hasNext(AbstractNode.java:654)
      	at cutthecrap.utils.striterators.Resolverator.hasNext(Resolverator.java:39)
      	at cutthecrap.utils.striterators.Striterator.hasNext(Striterator.java:89)
      	at com.bigdata.striterator.ChunkedWrappedIterator.nextChunk(ChunkedWrappedIterator.java:250)
      	at com.bigdata.relation.accesspath.AccessPath$ChunkConsumerTask.call(AccessPath.java:1305)
      	at com.bigdata.relation.accesspath.AccessPath$ChunkConsumerTask.call(AccessPath.java:1)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      	... 4 more
      
      	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
      	at java.util.concurrent.FutureTask.get(FutureTask.java:188)
      	at com.bigdata.journal.jini.ha.TestHA3JournalServer.doABCMultiLoadFollowerReads2(TestHA3JournalServer.java:2512)
      	at com.bigdata.journal.jini.ha.TestHA3JournalServer.testABCMultiLoadFollowerReads(TestHA3JournalServer.java:2416)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:606)
      	at junit.framework.TestCase.runTest(TestCase.java:176)
      	at junit.framework.TestCase.runBare(TestCase.java:141)
      	at junit.framework.TestResult$1.protect(TestResult.java:122)
      	at junit.framework.TestResult.runProtected(TestResult.java:142)
      	at junit.framework.TestResult.run(TestResult.java:125)
      	at junit.framework.TestCase.run(TestCase.java:129)
      	at junit.framework.TestSuite.runTest(TestSuite.java:255)
      	at junit.framework.TestSuite.run(TestSuite.java:250)
      	at junit.framework.TestSuite.runTest(TestSuite.java:255)
      	at junit.framework.TestSuite.run(TestSuite.java:250)
      	at org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:84)
      	at org.eclipse.jdt.internal.junit4.runner.JUnit4TestReference.run(JUnit4TestReference.java:50)
      	at org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38)
      	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:467)
      	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:683)
      	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:390)
      	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:197)
      Caused by: com.bigdata.rdf.sail.webapp.client.HttpException: Status Code=500, Status Line=Server Error, Response=SPARQL-UPDATE: updateStr=DROP ALL;
      LOAD <file:/Users/bryan/git/bigdata/bigdata-rdf/src/resources/data/foaf/data-0.nq.gz>;
      LOAD <file:/Users/bryan/git/bigdata/bigdata-rdf/src/resources/data/foaf/data-1.nq.gz>;
      LOAD <file:/Users/bryan/git/bigdata/bigdata-rdf/src/resources/data/foaf/data-2.nq.gz>;
      INSERT {?x rdfs:label ?y . } WHERE {?x foaf:name ?y };
      PREFIX dc: <http://purl.org/dc/elements/1.1/>
      INSERT DATA
      {
        <http://example/book1> dc:title "A new book" ;
          dc:creator "A.N.Other" .
      }
      
      java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.NullPointerException
      	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
      	at java.util.concurrent.FutureTask.get(FutureTask.java:188)
      	at com.bigdata.rdf.sail.webapp.BigdataServlet.submitApiTask(BigdataServlet.java:260)
      	at com.bigdata.rdf.sail.webapp.QueryServlet.doSparqlUpdate(QueryServlet.java:359)
      	at com.bigdata.rdf.sail.webapp.QueryServlet.doPost(QueryServlet.java:165)
      	at com.bigdata.rdf.sail.webapp.RESTServlet.doPost(RESTServlet.java:237)
      	at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
      	at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
      	at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:769)
      	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
      	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
      	at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:577)
      	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223)
      	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1125)
      	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
      	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
      	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1059)
      	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
      	at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
      	at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110)
      	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
      	at org.eclipse.jetty.server.Server.handle(Server.java:497)
      	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311)
      	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:248)
      	at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
      	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:610)
      	at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:539)
      	at java.lang.Thread.run(Thread.java:745)
      Caused by: java.lang.RuntimeException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.NullPointerException
      	at com.bigdata.journal.AbstractTask$InnerWriteServiceCallable.call(AbstractTask.java:2364)
      	at com.bigdata.journal.AbstractTask.doUnisolatedReadWriteTask(AbstractTask.java:2100)
      	at com.bigdata.journal.AbstractTask.call2(AbstractTask.java:2029)
      	at com.bigdata.journal.AbstractTask.call(AbstractTask.java:1895)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      	at com.bigdata.concurrent.FutureTaskMon.run(FutureTaskMon.java:63)
      	at com.bigdata.concurrent.NonBlockingLockManagerWithNewDesign$LockFutureTask.run(NonBlockingLockManagerWithNewDesign.java:1984)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	... 1 more
      Caused by: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.NullPointerException
      	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
      	at java.util.concurrent.FutureTask.get(FutureTask.java:188)
      	at com.bigdata.rdf.sail.webapp.QueryServlet$SparqlUpdateTask.call(QueryServlet.java:460)
      	at com.bigdata.rdf.sail.webapp.QueryServlet$SparqlUpdateTask.call(QueryServlet.java:1)
      	at com.bigdata.rdf.task.ApiTaskForJournal.doTask(ApiTaskForJournal.java:72)
      	at com.bigdata.journal.AbstractTask$InnerWriteServiceCallable.call(AbstractTask.java:2343)
      	... 9 more
      Caused by: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.NullPointerException
      	at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1303)
      	at com.bigdata.rdf.sail.BigdataSailUpdate.execute2(BigdataSailUpdate.java:152)
      	at com.bigdata.rdf.sail.webapp.BigdataRDFContext$UpdateTask.doQuery(BigdataRDFContext.java:1669)
      	at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.innerCall(BigdataRDFContext.java:1309)
      	at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.call(BigdataRDFContext.java:1274)
      	at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.call(BigdataRDFContext.java:1)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      	... 3 more
      Caused by: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.NullPointerException
      	at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.checkFuture(BlockingBuffer.java:1523)
      	at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator._hasNext(BlockingBuffer.java:1710)
      	at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.hasNext(BlockingBuffer.java:1563)
      	at com.bigdata.relation.accesspath.ChunkConsumerIterator.hasNext(ChunkConsumerIterator.java:132)
      	at com.bigdata.rdf.changesets.StatementWriter.nextChunk(StatementWriter.java:183)
      	at com.bigdata.rdf.changesets.StatementWriter.removeStatements(StatementWriter.java:136)
      	at com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.removeStatements(BigdataSail.java:2930)
      	at com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.removeStatements(BigdataSail.java:2828)
      	at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.clearGraph(AST2BOpUpdate.java:1822)
      	at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertClearOrDropGraph(AST2BOpUpdate.java:1668)
      	at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertUpdateSwitch(AST2BOpUpdate.java:406)
      	at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertUpdate(AST2BOpUpdate.java:279)
      	at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1295)
      	... 9 more
      Caused by: java.util.concurrent.ExecutionException: java.lang.NullPointerException
      	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
      	at java.util.concurrent.FutureTask.get(FutureTask.java:188)
      	at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.checkFuture(BlockingBuffer.java:1454)
      	... 21 more
      Caused by: java.lang.NullPointerException
      	at com.bigdata.btree.Leaf.hasDeleteMarkers(Leaf.java:272)
      	at com.bigdata.btree.AbstractTuple.copy(AbstractTuple.java:352)
      	at com.bigdata.btree.LeafTupleIterator.next(LeafTupleIterator.java:222)
      	at com.bigdata.btree.LeafTupleIterator.next(LeafTupleIterator.java:1)
      	at cutthecrap.utils.striterators.Expanderator.getNext(Expanderator.java:42)
      	at cutthecrap.utils.striterators.Prefetch.checkInit(Prefetch.java:27)
      	at cutthecrap.utils.striterators.Prefetch.hasNext(Prefetch.java:35)
      	at cutthecrap.utils.striterators.Striterator.hasNext(Striterator.java:89)
      	at com.bigdata.btree.AbstractNode$PostOrderEntryIterator.hasNext(AbstractNode.java:654)
      	at cutthecrap.utils.striterators.Resolverator.hasNext(Resolverator.java:39)
      	at cutthecrap.utils.striterators.Striterator.hasNext(Striterator.java:89)
      	at com.bigdata.striterator.ChunkedWrappedIterator.nextChunk(ChunkedWrappedIterator.java:250)
      	at com.bigdata.relation.accesspath.AccessPath$ChunkConsumerTask.call(AccessPath.java:1305)
      	at com.bigdata.relation.accesspath.AccessPath$ChunkConsumerTask.call(AccessPath.java:1)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      	... 4 more
      
      	at com.bigdata.rdf.sail.webapp.client.RemoteRepository.checkResponseCode(RemoteRepository.java:1790)
      	at com.bigdata.rdf.sail.webapp.client.RemoteRepository$SparqlUpdate.evaluate(RemoteRepository.java:1375)
      	at com.bigdata.rdf.sail.webapp.client.RemoteRepository$SparqlUpdate.evaluate(RemoteRepository.java:1360)
      	at com.bigdata.journal.jini.ha.AbstractHA3JournalServerTestCase$LargeLoadTask.call(AbstractHA3JournalServerTestCase.java:3068)
      	at com.bigdata.journal.jini.ha.AbstractHA3JournalServerTestCase$LargeLoadTask.call(AbstractHA3JournalServerTestCase.java:1)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	at java.lang.Thread.run(Thread.java:745)
      
      

        Activity

        Hide
        bryanthompson bryanthompson added a comment -

        I have observed this failure in:

        testABCMultiLoadFollowerReadsLargeLoad (while load data with SPARQL UPDATE)
        testABCMultiLoadFollowerReads (while loading data with SPARQL UPDATE)
        testStartAB_C_LiveResync (while running simpleTransaction)
        testABC_LargeLoad (while running DROP ALL)
        
        Show
        bryanthompson bryanthompson added a comment - I have observed this failure in: testABCMultiLoadFollowerReadsLargeLoad (while load data with SPARQL UPDATE) testABCMultiLoadFollowerReads (while loading data with SPARQL UPDATE) testStartAB_C_LiveResync (while running simpleTransaction) testABC_LargeLoad (while running DROP ALL)
        Hide
        bryanthompson bryanthompson added a comment -

        I am able to replicate this problem using the NanoSparqlServer in the standalone mode by enabling group commit in RWStore.properties

        # Enable group commit. See http://wiki.bigdata.com/wiki/index.php/GroupCommit
        com.bigdata.journal.Journal.groupCommit=true
        

        Then run the following SPARQL UPDATE request:

        DROP ALL;
        LOAD <file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-0.nq.gz>;
        LOAD <file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-1.nq.gz>;
        LOAD <file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-2.nq.gz>;
        LOAD <file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-3.nq.gz>;
        
        INSERT {?x rdfs:label ?y . } WHERE {?x foaf:name ?y };
        
        PREFIX dc: <http://purl.org/dc/elements/1.1/>
        INSERT DATA
        {
           <http://example/book1> dc:title "A new book" ;
                                  dc:creator "A.N.Other" .
        }
        

        The same operation is does not error when group commit is disabled.

        Show
        bryanthompson bryanthompson added a comment - I am able to replicate this problem using the NanoSparqlServer in the standalone mode by enabling group commit in RWStore.properties # Enable group commit. See http://wiki.bigdata.com/wiki/index.php/GroupCommit com.bigdata.journal.Journal.groupCommit=true Then run the following SPARQL UPDATE request: DROP ALL; LOAD <file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-0.nq.gz>; LOAD <file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-1.nq.gz>; LOAD <file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-2.nq.gz>; LOAD <file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-3.nq.gz>; INSERT {?x rdfs:label ?y . } WHERE {?x foaf:name ?y }; PREFIX dc: <http://purl.org/dc/elements/1.1/> INSERT DATA { <http://example/book1> dc:title "A new book" ; dc:creator "A.N.Other" . } The same operation is does not error when group commit is disabled.
        Hide
        bryanthompson bryanthompson added a comment -

        Starting with a new journal and group commit, the following operation will fail if executed twice (two commit points). It fails the 2nd time the DROP ALL operation is executed.

        DROP ALL;
        LOAD <file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-1.nq.gz>;
        

        Starting with an empty journal, submitting a single SPARQL UPDATE request with the following sequence of operations will fail during the second DROP ALL request.

        DROP ALL;
        LOAD <file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-1.nq.gz>;
        DROP ALL;
        

        However executing the following SPARQL UPDATE request multiple times does NOT fail the update, but it does produce an AssertionError on the server log:

        LOAD <file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-1.nq.gz>;
        DROP ALL;
        

        The assertion error is:

        ERROR: 59066   com.bigdata.rdf.task.ApiTaskForJournal 0  com.bigdata.rdf.sail.webapp.BigdataRDFContext.queryService7 com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.checkFuture(BlockingBuffer.java:1517): java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.lang.AssertionError: index=637 not in [0:637]
        java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.lang.AssertionError: index=637 not in [0:637]
        	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        	at java.util.concurrent.FutureTask.get(FutureTask.java:188)
        	at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.checkFuture(BlockingBuffer.java:1454)
        	at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator._hasNext(BlockingBuffer.java:1710)
        	at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.hasNext(BlockingBuffer.java:1563)
        	at com.bigdata.relation.accesspath.ChunkConsumerIterator.hasNext(ChunkConsumerIterator.java:132)
        	at com.bigdata.rdf.changesets.StatementWriter.nextChunk(StatementWriter.java:194)
        	at com.bigdata.rdf.changesets.StatementWriter.removeStatements(StatementWriter.java:138)
        	at com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.removeStatements(BigdataSail.java:2930)
        	at com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.removeStatements(BigdataSail.java:2828)
        	at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.clearGraph(AST2BOpUpdate.java:1822)
        	at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertClearOrDropGraph(AST2BOpUpdate.java:1668)
        	at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertUpdateSwitch(AST2BOpUpdate.java:406)
        	at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertUpdate(AST2BOpUpdate.java:279)
        	at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1295)
        	at com.bigdata.rdf.sail.BigdataSailUpdate.execute2(BigdataSailUpdate.java:152)
        	at com.bigdata.rdf.sail.webapp.BigdataRDFContext$UpdateTask.doQuery(BigdataRDFContext.java:1669)
        	at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.innerCall(BigdataRDFContext.java:1309)
        	at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.call(BigdataRDFContext.java:1274)
        	at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.call(BigdataRDFContext.java:1)
        	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        	at java.lang.Thread.run(Thread.java:745)
        Caused by: java.lang.RuntimeException: java.lang.AssertionError: index=637 not in [0:637]
        	at com.bigdata.relation.accesspath.AccessPath$ChunkConsumerTask.call(AccessPath.java:1313)
        	at com.bigdata.relation.accesspath.AccessPath$ChunkConsumerTask.call(AccessPath.java:1)
        	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        	... 4 more
        Caused by: java.lang.AssertionError: index=637 not in [0:637]
        	at com.bigdata.btree.raba.MutableKeyBuffer.copy(MutableKeyBuffer.java:184)
        	at com.bigdata.btree.AbstractTuple.copy(AbstractTuple.java:364)
        	at com.bigdata.btree.LeafTupleIterator.next(LeafTupleIterator.java:222)
        	at com.bigdata.btree.LeafTupleIterator.next(LeafTupleIterator.java:1)
        	at cutthecrap.utils.striterators.Expanderator.getNext(Expanderator.java:42)
        	at cutthecrap.utils.striterators.Prefetch.checkInit(Prefetch.java:27)
        	at cutthecrap.utils.striterators.Prefetch.hasNext(Prefetch.java:35)
        	at cutthecrap.utils.striterators.Striterator.hasNext(Striterator.java:89)
        	at com.bigdata.btree.AbstractNode$PostOrderEntryIterator.hasNext(AbstractNode.java:654)
        	at cutthecrap.utils.striterators.Resolverator.hasNext(Resolverator.java:39)
        	at cutthecrap.utils.striterators.Striterator.hasNext(Striterator.java:89)
        	at com.bigdata.striterator.ChunkedWrappedIterator.nextChunk(ChunkedWrappedIterator.java:250)
        	at com.bigdata.relation.accesspath.AccessPath$ChunkConsumerTask.call(AccessPath.java:1308)
        	... 7 more
        

        This is a bit disturbing since the UPDATE presumably should fail if there is an assertion error!

        Show
        bryanthompson bryanthompson added a comment - Starting with a new journal and group commit, the following operation will fail if executed twice (two commit points). It fails the 2nd time the DROP ALL operation is executed. DROP ALL; LOAD <file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-1.nq.gz>; Starting with an empty journal, submitting a single SPARQL UPDATE request with the following sequence of operations will fail during the second DROP ALL request. DROP ALL; LOAD <file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-1.nq.gz>; DROP ALL; However executing the following SPARQL UPDATE request multiple times does NOT fail the update, but it does produce an AssertionError on the server log: LOAD <file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-1.nq.gz>; DROP ALL; The assertion error is: ERROR: 59066 com.bigdata.rdf.task.ApiTaskForJournal 0 com.bigdata.rdf.sail.webapp.BigdataRDFContext.queryService7 com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.checkFuture(BlockingBuffer.java:1517): java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.lang.AssertionError: index=637 not in [0:637] java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.lang.AssertionError: index=637 not in [0:637] at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.checkFuture(BlockingBuffer.java:1454) at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator._hasNext(BlockingBuffer.java:1710) at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.hasNext(BlockingBuffer.java:1563) at com.bigdata.relation.accesspath.ChunkConsumerIterator.hasNext(ChunkConsumerIterator.java:132) at com.bigdata.rdf.changesets.StatementWriter.nextChunk(StatementWriter.java:194) at com.bigdata.rdf.changesets.StatementWriter.removeStatements(StatementWriter.java:138) at com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.removeStatements(BigdataSail.java:2930) at com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.removeStatements(BigdataSail.java:2828) at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.clearGraph(AST2BOpUpdate.java:1822) at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertClearOrDropGraph(AST2BOpUpdate.java:1668) at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertUpdateSwitch(AST2BOpUpdate.java:406) at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertUpdate(AST2BOpUpdate.java:279) at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1295) at com.bigdata.rdf.sail.BigdataSailUpdate.execute2(BigdataSailUpdate.java:152) at com.bigdata.rdf.sail.webapp.BigdataRDFContext$UpdateTask.doQuery(BigdataRDFContext.java:1669) at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.innerCall(BigdataRDFContext.java:1309) at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.call(BigdataRDFContext.java:1274) at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.call(BigdataRDFContext.java:1) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.RuntimeException: java.lang.AssertionError: index=637 not in [0:637] at com.bigdata.relation.accesspath.AccessPath$ChunkConsumerTask.call(AccessPath.java:1313) at com.bigdata.relation.accesspath.AccessPath$ChunkConsumerTask.call(AccessPath.java:1) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) ... 4 more Caused by: java.lang.AssertionError: index=637 not in [0:637] at com.bigdata.btree.raba.MutableKeyBuffer.copy(MutableKeyBuffer.java:184) at com.bigdata.btree.AbstractTuple.copy(AbstractTuple.java:364) at com.bigdata.btree.LeafTupleIterator.next(LeafTupleIterator.java:222) at com.bigdata.btree.LeafTupleIterator.next(LeafTupleIterator.java:1) at cutthecrap.utils.striterators.Expanderator.getNext(Expanderator.java:42) at cutthecrap.utils.striterators.Prefetch.checkInit(Prefetch.java:27) at cutthecrap.utils.striterators.Prefetch.hasNext(Prefetch.java:35) at cutthecrap.utils.striterators.Striterator.hasNext(Striterator.java:89) at com.bigdata.btree.AbstractNode$PostOrderEntryIterator.hasNext(AbstractNode.java:654) at cutthecrap.utils.striterators.Resolverator.hasNext(Resolverator.java:39) at cutthecrap.utils.striterators.Striterator.hasNext(Striterator.java:89) at com.bigdata.striterator.ChunkedWrappedIterator.nextChunk(ChunkedWrappedIterator.java:250) at com.bigdata.relation.accesspath.AccessPath$ChunkConsumerTask.call(AccessPath.java:1308) ... 7 more This is a bit disturbing since the UPDATE presumably should fail if there is an assertion error!
        Hide
        bryanthompson bryanthompson added a comment -

        The following does not cause a problem against an empty journal, so this seems to be related to the DROP ALL sequence.

        LOAD <file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-0.nq.gz>;
        LOAD <file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-1.nq.gz>;
        LOAD <file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-2.nq.gz>;
        LOAD <file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-3.nq.gz>;
        
        Show
        bryanthompson bryanthompson added a comment - The following does not cause a problem against an empty journal, so this seems to be related to the DROP ALL sequence. LOAD <file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-0.nq.gz>; LOAD <file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-1.nq.gz>; LOAD <file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-2.nq.gz>; LOAD <file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-3.nq.gz>;
        Hide
        bryanthompson bryanthompson added a comment -

        Running this against a new DiskWORM store produces the trace given below. Thus the problem does not appear to be backend specific.

        DROP ALL;
        LOAD <file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-1.nq.gz>;
        DROP ALL;
        
        Drop ALL-GRAPHS ALL-SOLUTIONS
        totalElapsed=58ms, elapsed=8ms
        
        Load OPTIONS=com.bigdata.rdf.rio.RDFParserOptions@551e4eb4{verifyData=false,preserveBNodeIDs=false,stopAtFirstError=false,datatypeHandling=IGNORE}
          source=ConstantNode(TermId(0U)[file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-1.nq.gz])
        
        totalElapsed=340ms, elapsed=261ms, parsed=10000, tps=38314, done=false
        
        totalElapsed=1057ms, elapsed=978ms, parsed=16516, tps=16887, done=true
        ABORT
        
        Drop ALL-GRAPHS ALL-SOLUTIONS
        java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError: index=602 not in [0:602]
        	at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.checkFuture(BlockingBuffer.java:1523)
        	at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator._hasNext(BlockingBuffer.java:1710)
        	at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.hasNext(BlockingBuffer.java:1563)
        	at com.bigdata.relation.accesspath.ChunkConsumerIterator.hasNext(ChunkConsumerIterator.java:132)
        	at com.bigdata.rdf.changesets.StatementWriter.nextChunk(StatementWriter.java:183)
        	at com.bigdata.rdf.changesets.StatementWriter.removeStatements(StatementWriter.java:136)
        	at com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.removeStatements(BigdataSail.java:2930)
        	at com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.removeStatements(BigdataSail.java:2828)
        	at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.clearGraph(AST2BOpUpdate.java:1822)
        	at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertClearOrDropGraph(AST2BOpUpdate.java:1668)
        	at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertUpdateSwitch(AST2BOpUpdate.java:406)
        	at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertUpdate(AST2BOpUpdate.java:279)
        	at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1295)
        	at com.bigdata.rdf.sail.BigdataSailUpdate.execute2(BigdataSailUpdate.java:152)
        	at com.bigdata.rdf.sail.webapp.BigdataRDFContext$UpdateTask.doQuery(BigdataRDFContext.java:1669)
        	at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.innerCall(BigdataRDFContext.java:1309)
        	at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.call(BigdataRDFContext.java:1274)
        	at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.call(BigdataRDFContext.java:1)
        	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        	at java.lang.Thread.run(Thread.java:745)
        Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError: index=602 not in [0:602]
        	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        	at java.util.concurrent.FutureTask.get(FutureTask.java:188)
        	at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.checkFuture(BlockingBuffer.java:1454)
        	... 21 more
        Caused by: java.lang.AssertionError: index=602 not in [0:602]
        	at com.bigdata.btree.raba.MutableKeyBuffer.copy(MutableKeyBuffer.java:184)
        	at com.bigdata.btree.AbstractTuple.copy(AbstractTuple.java:364)
        	at com.bigdata.btree.LeafTupleIterator.next(LeafTupleIterator.java:222)
        	at com.bigdata.btree.LeafTupleIterator.next(LeafTupleIterator.java:1)
        	at cutthecrap.utils.striterators.Expanderator.getNext(Expanderator.java:42)
        	at cutthecrap.utils.striterators.Prefetch.checkInit(Prefetch.java:27)
        	at cutthecrap.utils.striterators.Prefetch.hasNext(Prefetch.java:35)
        	at cutthecrap.utils.striterators.Striterator.hasNext(Striterator.java:89)
        	at com.bigdata.btree.AbstractNode$PostOrderEntryIterator.hasNext(AbstractNode.java:654)
        	at cutthecrap.utils.striterators.Resolverator.hasNext(Resolverator.java:39)
        	at cutthecrap.utils.striterators.Striterator.hasNext(Striterator.java:89)
        	at com.bigdata.striterator.ChunkedWrappedIterator.nextChunk(ChunkedWrappedIterator.java:250)
        	at com.bigdata.relation.accesspath.AccessPath$ChunkConsumerTask.call(AccessPath.java:1305)
        	at com.bigdata.relation.accesspath.AccessPath$ChunkConsumerTask.call(AccessPath.java:1)
        	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        	... 4 more
        totalElapsed=1244ms, elapsed=29ms
        
        SPARQL-UPDATE: updateStr=DROP ALL;LOAD ;DROP ALL; java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError: index=602 not in [0:602] at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at com.bigdata.rdf.sail.webapp.BigdataServlet.submitApiTask(BigdataServlet.java:260) at com.bigdata.rdf.sail.webapp.QueryServlet.doSparqlUpdate(QueryServlet.java:359) at com.bigdata.rdf.sail.webapp.QueryServlet.doPost(QueryServlet.java:165) at com.bigdata.rdf.sail.webapp.RESTServlet.doPost(RESTServlet.java:237) at com.bigdata.rdf.sail.webapp.MultiTenancyServlet.doPost(MultiTenancyServlet.java:136) at javax.servlet.http.HttpServlet.service(HttpServlet.java:707) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:769) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:577) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1125) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1059) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.Server.handle(Server.java:497) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:248) at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:610) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:539) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.RuntimeException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError: index=602 not in [0:602] at com.bigdata.journal.AbstractTask$InnerWriteServiceCallable.call(AbstractTask.java:2365) at com.bigdata.journal.AbstractTask.doUnisolatedReadWriteTask(AbstractTask.java:2101) at com.bigdata.journal.AbstractTask.call2(AbstractTask.java:2030) at com.bigdata.journal.AbstractTask.call(AbstractTask.java:1896) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at com.bigdata.concurrent.FutureTaskMon.run(FutureTaskMon.java:63) at com.bigdata.concurrent.NonBlockingLockManagerWithNewDesign$LockFutureTask.run(NonBlockingLockManagerWithNewDesign.java:1984) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) ... 1 more Caused by: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError: index=602 not in [0:602] at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at com.bigdata.rdf.sail.webapp.QueryServlet$SparqlUpdateTask.call(QueryServlet.java:460) at com.bigdata.rdf.sail.webapp.QueryServlet$SparqlUpdateTask.call(QueryServlet.java:1) at com.bigdata.rdf.task.ApiTaskForJournal.doTask(ApiTaskForJournal.java:72) at com.bigdata.journal.AbstractTask$InnerWriteServiceCallable.call(AbstractTask.java:2344) ... 9 more Caused by: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError: index=602 not in [0:602] at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1303) at com.bigdata.rdf.sail.BigdataSailUpdate.execute2(BigdataSailUpdate.java:152) at com.bigdata.rdf.sail.webapp.BigdataRDFContext$UpdateTask.doQuery(BigdataRDFContext.java:1669) at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.innerCall(BigdataRDFContext.java:1309) at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.call(BigdataRDFContext.java:1274) at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.call(BigdataRDFContext.java:1) at java.util.concurrent.FutureTask.run(FutureTask.java:262) ... 3 more Caused by: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError: index=602 not in [0:602] at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.checkFuture(BlockingBuffer.java:1523) at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator._hasNext(BlockingBuffer.java:1710) at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.hasNext(BlockingBuffer.java:1563) at com.bigdata.relation.accesspath.ChunkConsumerIterator.hasNext(ChunkConsumerIterator.java:132) at com.bigdata.rdf.changesets.StatementWriter.nextChunk(StatementWriter.java:183) at com.bigdata.rdf.changesets.StatementWriter.removeStatements(StatementWriter.java:136) at com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.removeStatements(BigdataSail.java:2930) at com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.removeStatements(BigdataSail.java:2828) at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.clearGraph(AST2BOpUpdate.java:1822) at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertClearOrDropGraph(AST2BOpUpdate.java:1668) at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertUpdateSwitch(AST2BOpUpdate.java:406) at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertUpdate(AST2BOpUpdate.java:279) at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1295) ... 9 more Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError: index=602 not in [0:602] at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.checkFuture(BlockingBuffer.java:1454) ... 21 more Caused by: java.lang.AssertionError: index=602 not in [0:602] at com.bigdata.btree.raba.MutableKeyBuffer.copy(MutableKeyBuffer.java:184) at com.bigdata.btree.AbstractTuple.copy(AbstractTuple.java:364) at com.bigdata.btree.LeafTupleIterator.next(LeafTupleIterator.java:222) at com.bigdata.btree.LeafTupleIterator.next(LeafTupleIterator.java:1) at cutthecrap.utils.striterators.Expanderator.getNext(Expanderator.java:42) at cutthecrap.utils.striterators.Prefetch.checkInit(Prefetch.java:27) at cutthecrap.utils.striterators.Prefetch.hasNext(Prefetch.java:35) at cutthecrap.utils.striterators.Striterator.hasNext(Striterator.java:89) at com.bigdata.btree.AbstractNode$PostOrderEntryIterator.hasNext(AbstractNode.java:654) at cutthecrap.utils.striterators.Resolverator.hasNext(Resolverator.java:39) at cutthecrap.utils.striterators.Striterator.hasNext(Striterator.java:89) at com.bigdata.striterator.ChunkedWrappedIterator.nextChunk(ChunkedWrappedIterator.java:250) at com.bigdata.relation.accesspath.AccessPath$ChunkConsumerTask.call(AccessPath.java:1305) at com.bigdata.relation.accesspath.AccessPath$ChunkConsumerTask.call(AccessPath.java:1) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) ... 4 more
        
        Show
        bryanthompson bryanthompson added a comment - Running this against a new DiskWORM store produces the trace given below. Thus the problem does not appear to be backend specific. DROP ALL; LOAD <file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-1.nq.gz>; DROP ALL; Drop ALL-GRAPHS ALL-SOLUTIONS totalElapsed=58ms, elapsed=8ms Load OPTIONS=com.bigdata.rdf.rio.RDFParserOptions@551e4eb4{verifyData=false,preserveBNodeIDs=false,stopAtFirstError=false,datatypeHandling=IGNORE} source=ConstantNode(TermId(0U)[file:/Users/bryan/Documents/workspace/BIGDATA_RELEASE_1_3_0/bigdata-rdf/src/resources/data/foaf/data-1.nq.gz]) totalElapsed=340ms, elapsed=261ms, parsed=10000, tps=38314, done=false totalElapsed=1057ms, elapsed=978ms, parsed=16516, tps=16887, done=true ABORT Drop ALL-GRAPHS ALL-SOLUTIONS java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError: index=602 not in [0:602] at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.checkFuture(BlockingBuffer.java:1523) at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator._hasNext(BlockingBuffer.java:1710) at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.hasNext(BlockingBuffer.java:1563) at com.bigdata.relation.accesspath.ChunkConsumerIterator.hasNext(ChunkConsumerIterator.java:132) at com.bigdata.rdf.changesets.StatementWriter.nextChunk(StatementWriter.java:183) at com.bigdata.rdf.changesets.StatementWriter.removeStatements(StatementWriter.java:136) at com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.removeStatements(BigdataSail.java:2930) at com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.removeStatements(BigdataSail.java:2828) at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.clearGraph(AST2BOpUpdate.java:1822) at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertClearOrDropGraph(AST2BOpUpdate.java:1668) at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertUpdateSwitch(AST2BOpUpdate.java:406) at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertUpdate(AST2BOpUpdate.java:279) at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1295) at com.bigdata.rdf.sail.BigdataSailUpdate.execute2(BigdataSailUpdate.java:152) at com.bigdata.rdf.sail.webapp.BigdataRDFContext$UpdateTask.doQuery(BigdataRDFContext.java:1669) at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.innerCall(BigdataRDFContext.java:1309) at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.call(BigdataRDFContext.java:1274) at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.call(BigdataRDFContext.java:1) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError: index=602 not in [0:602] at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.checkFuture(BlockingBuffer.java:1454) ... 21 more Caused by: java.lang.AssertionError: index=602 not in [0:602] at com.bigdata.btree.raba.MutableKeyBuffer.copy(MutableKeyBuffer.java:184) at com.bigdata.btree.AbstractTuple.copy(AbstractTuple.java:364) at com.bigdata.btree.LeafTupleIterator.next(LeafTupleIterator.java:222) at com.bigdata.btree.LeafTupleIterator.next(LeafTupleIterator.java:1) at cutthecrap.utils.striterators.Expanderator.getNext(Expanderator.java:42) at cutthecrap.utils.striterators.Prefetch.checkInit(Prefetch.java:27) at cutthecrap.utils.striterators.Prefetch.hasNext(Prefetch.java:35) at cutthecrap.utils.striterators.Striterator.hasNext(Striterator.java:89) at com.bigdata.btree.AbstractNode$PostOrderEntryIterator.hasNext(AbstractNode.java:654) at cutthecrap.utils.striterators.Resolverator.hasNext(Resolverator.java:39) at cutthecrap.utils.striterators.Striterator.hasNext(Striterator.java:89) at com.bigdata.striterator.ChunkedWrappedIterator.nextChunk(ChunkedWrappedIterator.java:250) at com.bigdata.relation.accesspath.AccessPath$ChunkConsumerTask.call(AccessPath.java:1305) at com.bigdata.relation.accesspath.AccessPath$ChunkConsumerTask.call(AccessPath.java:1) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) ... 4 more totalElapsed=1244ms, elapsed=29ms SPARQL-UPDATE: updateStr=DROP ALL;LOAD ;DROP ALL; java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError: index=602 not in [0:602] at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at com.bigdata.rdf.sail.webapp.BigdataServlet.submitApiTask(BigdataServlet.java:260) at com.bigdata.rdf.sail.webapp.QueryServlet.doSparqlUpdate(QueryServlet.java:359) at com.bigdata.rdf.sail.webapp.QueryServlet.doPost(QueryServlet.java:165) at com.bigdata.rdf.sail.webapp.RESTServlet.doPost(RESTServlet.java:237) at com.bigdata.rdf.sail.webapp.MultiTenancyServlet.doPost(MultiTenancyServlet.java:136) at javax.servlet.http.HttpServlet.service(HttpServlet.java:707) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:769) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:577) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1125) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1059) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.Server.handle(Server.java:497) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:248) at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:610) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:539) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.RuntimeException: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError: index=602 not in [0:602] at com.bigdata.journal.AbstractTask$InnerWriteServiceCallable.call(AbstractTask.java:2365) at com.bigdata.journal.AbstractTask.doUnisolatedReadWriteTask(AbstractTask.java:2101) at com.bigdata.journal.AbstractTask.call2(AbstractTask.java:2030) at com.bigdata.journal.AbstractTask.call(AbstractTask.java:1896) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at com.bigdata.concurrent.FutureTaskMon.run(FutureTaskMon.java:63) at com.bigdata.concurrent.NonBlockingLockManagerWithNewDesign$LockFutureTask.run(NonBlockingLockManagerWithNewDesign.java:1984) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) ... 1 more Caused by: java.util.concurrent.ExecutionException: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError: index=602 not in [0:602] at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at com.bigdata.rdf.sail.webapp.QueryServlet$SparqlUpdateTask.call(QueryServlet.java:460) at com.bigdata.rdf.sail.webapp.QueryServlet$SparqlUpdateTask.call(QueryServlet.java:1) at com.bigdata.rdf.task.ApiTaskForJournal.doTask(ApiTaskForJournal.java:72) at com.bigdata.journal.AbstractTask$InnerWriteServiceCallable.call(AbstractTask.java:2344) ... 9 more Caused by: org.openrdf.query.UpdateExecutionException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError: index=602 not in [0:602] at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1303) at com.bigdata.rdf.sail.BigdataSailUpdate.execute2(BigdataSailUpdate.java:152) at com.bigdata.rdf.sail.webapp.BigdataRDFContext$UpdateTask.doQuery(BigdataRDFContext.java:1669) at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.innerCall(BigdataRDFContext.java:1309) at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.call(BigdataRDFContext.java:1274) at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.call(BigdataRDFContext.java:1) at java.util.concurrent.FutureTask.run(FutureTask.java:262) ... 3 more Caused by: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError: index=602 not in [0:602] at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.checkFuture(BlockingBuffer.java:1523) at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator._hasNext(BlockingBuffer.java:1710) at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.hasNext(BlockingBuffer.java:1563) at com.bigdata.relation.accesspath.ChunkConsumerIterator.hasNext(ChunkConsumerIterator.java:132) at com.bigdata.rdf.changesets.StatementWriter.nextChunk(StatementWriter.java:183) at com.bigdata.rdf.changesets.StatementWriter.removeStatements(StatementWriter.java:136) at com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.removeStatements(BigdataSail.java:2930) at com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.removeStatements(BigdataSail.java:2828) at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.clearGraph(AST2BOpUpdate.java:1822) at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertClearOrDropGraph(AST2BOpUpdate.java:1668) at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertUpdateSwitch(AST2BOpUpdate.java:406) at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertUpdate(AST2BOpUpdate.java:279) at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1295) ... 9 more Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError: index=602 not in [0:602] at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.checkFuture(BlockingBuffer.java:1454) ... 21 more Caused by: java.lang.AssertionError: index=602 not in [0:602] at com.bigdata.btree.raba.MutableKeyBuffer.copy(MutableKeyBuffer.java:184) at com.bigdata.btree.AbstractTuple.copy(AbstractTuple.java:364) at com.bigdata.btree.LeafTupleIterator.next(LeafTupleIterator.java:222) at com.bigdata.btree.LeafTupleIterator.next(LeafTupleIterator.java:1) at cutthecrap.utils.striterators.Expanderator.getNext(Expanderator.java:42) at cutthecrap.utils.striterators.Prefetch.checkInit(Prefetch.java:27) at cutthecrap.utils.striterators.Prefetch.hasNext(Prefetch.java:35) at cutthecrap.utils.striterators.Striterator.hasNext(Striterator.java:89) at com.bigdata.btree.AbstractNode$PostOrderEntryIterator.hasNext(AbstractNode.java:654) at cutthecrap.utils.striterators.Resolverator.hasNext(Resolverator.java:39) at cutthecrap.utils.striterators.Striterator.hasNext(Striterator.java:89) at com.bigdata.striterator.ChunkedWrappedIterator.nextChunk(ChunkedWrappedIterator.java:250) at com.bigdata.relation.accesspath.AccessPath$ChunkConsumerTask.call(AccessPath.java:1305) at com.bigdata.relation.accesspath.AccessPath$ChunkConsumerTask.call(AccessPath.java:1) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) ... 4 more
        Hide
        bryanthompson bryanthompson added a comment -

        A similar problem is reported for the MemStore for the same DROP ALL; LOAD ...; DROP ALL operation sequence:

        java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError: index=512 not in [0:512]
        	at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.checkFuture(BlockingBuffer.java:1523)
        	at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator._hasNext(BlockingBuffer.java:1710)
        	at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.hasNext(BlockingBuffer.java:1563)
        	at com.bigdata.relation.accesspath.ChunkConsumerIterator.hasNext(ChunkConsumerIterator.java:132)
        	at com.bigdata.rdf.changesets.StatementWriter.nextChunk(StatementWriter.java:183)
        	at com.bigdata.rdf.changesets.StatementWriter.removeStatements(StatementWriter.java:136)
        	at com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.removeStatements(BigdataSail.java:2930)
        	at com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.removeStatements(BigdataSail.java:2828)
        	at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.clearGraph(AST2BOpUpdate.java:1822)
        	at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertClearOrDropGraph(AST2BOpUpdate.java:1668)
        	at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertUpdateSwitch(AST2BOpUpdate.java:406)
        	at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertUpdate(AST2BOpUpdate.java:279)
        	at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1295)
        	at com.bigdata.rdf.sail.BigdataSailUpdate.execute2(BigdataSailUpdate.java:152)
        	at com.bigdata.rdf.sail.webapp.BigdataRDFContext$UpdateTask.doQuery(BigdataRDFContext.java:1669)
        	at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.innerCall(BigdataRDFContext.java:1309)
        	at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.call(BigdataRDFContext.java:1274)
        	at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.call(BigdataRDFContext.java:1)
        	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        	at java.lang.Thread.run(Thread.java:745)
        Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError: index=512 not in [0:512]
        	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        	at java.util.concurrent.FutureTask.get(FutureTask.java:188)
        	at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.checkFuture(BlockingBuffer.java:1454)
        	... 21 more
        Caused by: java.lang.AssertionError: index=512 not in [0:512]
        	at com.bigdata.btree.raba.MutableKeyBuffer.copy(MutableKeyBuffer.java:184)
        	at com.bigdata.btree.AbstractTuple.copy(AbstractTuple.java:364)
        	at com.bigdata.btree.LeafTupleIterator.next(LeafTupleIterator.java:222)
        	at com.bigdata.btree.LeafTupleIterator.next(LeafTupleIterator.java:1)
        	at cutthecrap.utils.striterators.Expanderator.getNext(Expanderator.java:42)
        	at cutthecrap.utils.striterators.Prefetch.checkInit(Prefetch.java:27)
        	at cutthecrap.utils.striterators.Prefetch.hasNext(Prefetch.java:35)
        	at cutthecrap.utils.striterators.Striterator.hasNext(Striterator.java:89)
        	at com.bigdata.btree.AbstractNode$PostOrderEntryIterator.hasNext(AbstractNode.java:654)
        	at cutthecrap.utils.striterators.Resolverator.hasNext(Resolverator.java:39)
        	at cutthecrap.utils.striterators.Striterator.hasNext(Striterator.java:89)
        	at com.bigdata.striterator.ChunkedWrappedIterator.nextChunk(ChunkedWrappedIterator.java:250)
        	at com.bigdata.relation.accesspath.AccessPath$ChunkConsumerTask.call(AccessPath.java:1305)
        	at com.bigdata.relation.accesspath.AccessPath$ChunkConsumerTask.call(AccessPath.java:1)
        	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        	... 4 more
        totalElapsed=1168ms, elapsed=24ms
        
        Show
        bryanthompson bryanthompson added a comment - A similar problem is reported for the MemStore for the same DROP ALL; LOAD ...; DROP ALL operation sequence: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError: index=512 not in [0:512] at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.checkFuture(BlockingBuffer.java:1523) at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator._hasNext(BlockingBuffer.java:1710) at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.hasNext(BlockingBuffer.java:1563) at com.bigdata.relation.accesspath.ChunkConsumerIterator.hasNext(ChunkConsumerIterator.java:132) at com.bigdata.rdf.changesets.StatementWriter.nextChunk(StatementWriter.java:183) at com.bigdata.rdf.changesets.StatementWriter.removeStatements(StatementWriter.java:136) at com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.removeStatements(BigdataSail.java:2930) at com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.removeStatements(BigdataSail.java:2828) at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.clearGraph(AST2BOpUpdate.java:1822) at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertClearOrDropGraph(AST2BOpUpdate.java:1668) at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertUpdateSwitch(AST2BOpUpdate.java:406) at com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertUpdate(AST2BOpUpdate.java:279) at com.bigdata.rdf.sparql.ast.eval.ASTEvalHelper.executeUpdate(ASTEvalHelper.java:1295) at com.bigdata.rdf.sail.BigdataSailUpdate.execute2(BigdataSailUpdate.java:152) at com.bigdata.rdf.sail.webapp.BigdataRDFContext$UpdateTask.doQuery(BigdataRDFContext.java:1669) at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.innerCall(BigdataRDFContext.java:1309) at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.call(BigdataRDFContext.java:1274) at com.bigdata.rdf.sail.webapp.BigdataRDFContext$AbstractQueryTask.call(BigdataRDFContext.java:1) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError: index=512 not in [0:512] at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at com.bigdata.relation.accesspath.BlockingBuffer$BlockingIterator.checkFuture(BlockingBuffer.java:1454) ... 21 more Caused by: java.lang.AssertionError: index=512 not in [0:512] at com.bigdata.btree.raba.MutableKeyBuffer.copy(MutableKeyBuffer.java:184) at com.bigdata.btree.AbstractTuple.copy(AbstractTuple.java:364) at com.bigdata.btree.LeafTupleIterator.next(LeafTupleIterator.java:222) at com.bigdata.btree.LeafTupleIterator.next(LeafTupleIterator.java:1) at cutthecrap.utils.striterators.Expanderator.getNext(Expanderator.java:42) at cutthecrap.utils.striterators.Prefetch.checkInit(Prefetch.java:27) at cutthecrap.utils.striterators.Prefetch.hasNext(Prefetch.java:35) at cutthecrap.utils.striterators.Striterator.hasNext(Striterator.java:89) at com.bigdata.btree.AbstractNode$PostOrderEntryIterator.hasNext(AbstractNode.java:654) at cutthecrap.utils.striterators.Resolverator.hasNext(Resolverator.java:39) at cutthecrap.utils.striterators.Striterator.hasNext(Striterator.java:89) at com.bigdata.striterator.ChunkedWrappedIterator.nextChunk(ChunkedWrappedIterator.java:250) at com.bigdata.relation.accesspath.AccessPath$ChunkConsumerTask.call(AccessPath.java:1305) at com.bigdata.relation.accesspath.AccessPath$ChunkConsumerTask.call(AccessPath.java:1) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) ... 4 more totalElapsed=1168ms, elapsed=24ms
        Hide
        bryanthompson bryanthompson added a comment -

        Found it. AbstractRelation.getIndex() is responsible for imposing the UnisolatedReadWriteIndex on unisolated index views. It was performing an inheritance test, but the test was on Journal and not IJournal. Therefore it was not wrapping the index as an UnisolatedReadWriteIndex when the AbstractJournal was imposing task isolation using an IsolatedActionJournal.

            static public IIndex getIndex(final IIndexManager indexManager,
                    final String fqn, final long timestamp) {
        
                if (indexManager == null)
                    throw new IllegalArgumentException();
                
                if (fqn == null)
                    throw new IllegalArgumentException();
        
                IIndex ndx = indexManager.getIndex(fqn, timestamp);
        
              /**
               * Note: We need to wrap any unisolated index on the Journal (included the
               * IsolatedActionJournal managed by the AbstractTask).
               * 
               * @see BLZG-1171 (Concurrent modification error with group commit).
               */
                if (ndx != null
                        && timestamp == ITx.UNISOLATED
                        && (indexManager instanceof IJournal || indexManager instanceof TemporaryStore)) {
        
                    if(log.isDebugEnabled()) {
                        
                        log.debug("Imposing read-write concurrency controls on index: name="
                                        + fqn);
                        
                    }
                    
                    ndx = new UnisolatedReadWriteIndex((BTree) ndx);
        
                }
        
                return ndx;
        
            }
        

        Commit 05837ffd5b980dbbd8ba398050404b5f06e1d16e

        Show
        bryanthompson bryanthompson added a comment - Found it. AbstractRelation.getIndex() is responsible for imposing the UnisolatedReadWriteIndex on unisolated index views. It was performing an inheritance test, but the test was on Journal and not IJournal. Therefore it was not wrapping the index as an UnisolatedReadWriteIndex when the AbstractJournal was imposing task isolation using an IsolatedActionJournal. static public IIndex getIndex(final IIndexManager indexManager, final String fqn, final long timestamp) { if (indexManager == null) throw new IllegalArgumentException(); if (fqn == null) throw new IllegalArgumentException(); IIndex ndx = indexManager.getIndex(fqn, timestamp); /** * Note: We need to wrap any unisolated index on the Journal (included the * IsolatedActionJournal managed by the AbstractTask). * * @see BLZG-1171 (Concurrent modification error with group commit). */ if (ndx != null && timestamp == ITx.UNISOLATED && (indexManager instanceof IJournal || indexManager instanceof TemporaryStore)) { if(log.isDebugEnabled()) { log.debug("Imposing read-write concurrency controls on index: name=" + fqn); } ndx = new UnisolatedReadWriteIndex((BTree) ndx); } return ndx; } Commit 05837ffd5b980dbbd8ba398050404b5f06e1d16e

          People

          • Assignee:
            bryanthompson bryanthompson
            Reporter:
            bryanthompson bryanthompson
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: