Uploaded image for project: 'Blazegraph (by SYSTAP)'
  1. Blazegraph (by SYSTAP)
  2. BLZG-1178

Bad Address: length requested greater than allocated slot (RWStore, GROUP COMMIT, HA-only)

    XMLWordPrintable

    Details

      Description

      The UPDATE request was posted to the leader (bigdata15) at the LBS path:

      ./testdriver -idir /root/workspace/bsbmtools/trunk/td_100m/td_data -ucf usecases/exploreAndUpdate/sparql.txt -udataset td_100m/dataset_update.nt -seed $RANDOM -u http://localhost:8090/bigdata/LBS/leader/namespace/kb/sparql http://localhost:8090/bigdata/LBS/read/namespace/kb/sparql
      

      This is the error message on the leader:

      ERROR: 66492152 2015-03-03 09:23:50,392      qtp1193373768-558 com.bigdata.rdf.sail.webapp.BigdataRDFServlet.launderThrowable(BigdataRDFServlet.java:191): cause=java.util.concurrent.ExecutionException: java.lang.RuntimeEx\
      ception: Commit failed: Task{com.bigdata.rdf.task.ApiTaskForJournal,timestamp=unisolated,resource=[kb]}::{delegate=com.bigdata.rdf.sail.webapp.QueryServlet$SparqlUpdateTask{namespace=kb,timestamp=0, updateStr=[DELETE WHER\
      E
      { <http://www4.wiwiss.fu-berlin.de/bizer/bsbm/v01/instances/dataFromVendor2757/Offer5438262> ?p ?o }
      ]}}, query=SPARQL-UPDATE: updateStr=DELETE WHERE
      { <http://www4.wiwiss.fu-berlin.de/bizer/bsbm/v01/instances/dataFromVendor2757/Offer5438262> ?p ?o }
      
      java.util.concurrent.ExecutionException: java.lang.RuntimeException: Commit failed: Task{com.bigdata.rdf.task.ApiTaskForJournal,timestamp=unisolated,resource=[kb]}::{delegate=com.bigdata.rdf.sail.webapp.QueryServlet$Sparq\
      lUpdateTask{namespace=kb,timestamp=0, updateStr=[DELETE WHERE
      { <http://www4.wiwiss.fu-berlin.de/bizer/bsbm/v01/instances/dataFromVendor2757/Offer5438262> ?p ?o }
      ]}}
              at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:252)
              at java.util.concurrent.FutureTask.get(FutureTask.java:111)
              at com.bigdata.rdf.sail.webapp.BigdataServlet.submitApiTask(BigdataServlet.java:260)
              at com.bigdata.rdf.sail.webapp.QueryServlet.doSparqlUpdate(QueryServlet.java:359)
              at com.bigdata.rdf.sail.webapp.QueryServlet.doPost(QueryServlet.java:165)
              at com.bigdata.rdf.sail.webapp.RESTServlet.doPost(RESTServlet.java:237)
              at com.bigdata.rdf.sail.webapp.MultiTenancyServlet.doPost(MultiTenancyServlet.java:136)
              at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
              at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
              at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:769)
              at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
              at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
              at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:595)
              at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223)
              at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1125)
              at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
              at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
              at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1059)
              at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
              at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:191)
              at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:72)
              at com.bigdata.rdf.sail.webapp.HALoadBalancerServlet.forwardToLocalService(HALoadBalancerServlet.java:938)
              at com.bigdata.rdf.sail.webapp.lbs.AbstractLBSPolicy.service(AbstractLBSPolicy.java:245)
              at com.bigdata.rdf.sail.webapp.HALoadBalancerServlet.service(HALoadBalancerServlet.java:832)
              at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
              at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:769)
              at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
              at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
              at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:577)
              at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223)
              at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1125)
              at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
              at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
              at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1059)
              at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
              at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
              at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110)
              at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
              at org.eclipse.jetty.server.Server.handle(Server.java:497)
              at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311)
              at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:248)
              at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
              at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:610)
              at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:539)
              at java.lang.Thread.run(Thread.java:724)
      Caused by: java.lang.RuntimeException: Commit failed: Task{com.bigdata.rdf.task.ApiTaskForJournal,timestamp=unisolated,resource=[kb]}::{delegate=com.bigdata.rdf.sail.webapp.QueryServlet$SparqlUpdateTask{namespace=kb,times\
      tamp=0, updateStr=[DELETE WHERE
      { <http://www4.wiwiss.fu-berlin.de/bizer/bsbm/v01/instances/dataFromVendor2757/Offer5438262> ?p ?o }
      ]}}
              at com.bigdata.journal.WriteExecutorService.afterTask(WriteExecutorService.java:968)
              at com.bigdata.journal.AbstractTask.doUnisolatedReadWriteTask(AbstractTask.java:2139)
              at com.bigdata.journal.AbstractTask.call2(AbstractTask.java:2030)
              at com.bigdata.journal.AbstractTask.call(AbstractTask.java:1896)
      	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
              at java.util.concurrent.FutureTask.run(FutureTask.java:166)
              at com.bigdata.concurrent.FutureTaskMon.run(FutureTaskMon.java:63)
              at com.bigdata.concurrent.NonBlockingLockManagerWithNewDesign$LockFutureTask.run(NonBlockingLockManagerWithNewDesign.java:1984)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
              ... 1 more
      Caused by: com.bigdata.journal.CommitException: Commit failed - will abort:  : java.lang.RuntimeException: Problem with entry at -314689041142382170: lastRootBlock=rootBlock{ rootBlock=1, challisField=219898, version=3, n\
      extOffset=3565067742101510, localTime=1425392630207 [Tuesday, March 3, 2015 9:23:50 AM EST], firstCommitTime=1422285932434 [Monday, January 26, 2015 10:25:32 AM EST], lastCommitTime=1425392630155 [Tuesday, March 3, 2015 9\
      :23:50 AM EST], commitCounter=219898, commitRecordAddr={off=NATIVE:-73269254,len=422}, commitRecordIndexAddr={off=NATIVE:-73244677,len=220}, blockSequence=1, quorumToken=124, metaBitsAddr=3564277797486954, metaStartAddr=8\
      74088, storeType=RW, uuid=f9f6a98e-cc98-4bae-affa-21f6ad2b4a70, offsetBits=42, checksum=1545545063, createTime=1422284759355 [Monday, January 26, 2015 10:05:59 AM EST], closeTime=0}
              at com.bigdata.journal.WriteExecutorService.commit(WriteExecutorService.java:2498)
              at com.bigdata.journal.WriteExecutorService.groupCommit(WriteExecutorService.java:1483)
              at com.bigdata.journal.WriteExecutorService.afterTask(WriteExecutorService.java:947)
              ... 10 more
      Caused by: java.lang.RuntimeException: Problem with entry at -314689041142382170: lastRootBlock=rootBlock{ rootBlock=1, challisField=219898, version=3, nextOffset=3565067742101510, localTime=1425392630207 [Tuesday, March \
      3, 2015 9:23:50 AM EST], firstCommitTime=1422285932434 [Monday, January 26, 2015 10:25:32 AM EST], lastCommitTime=1425392630155 [Tuesday, March 3, 2015 9:23:50 AM EST], commitCounter=219898, commitRecordAddr={off=NATIVE:-\
      73269254,len=422}, commitRecordIndexAddr={off=NATIVE:-73244677,len=220}, blockSequence=1, quorumToken=124, metaBitsAddr=3564277797486954, metaStartAddr=874088, storeType=RW, uuid=f9f6a98e-cc98-4bae-affa-21f6ad2b4a70, offs\
      etBits=42, checksum=1545545063, createTime=1422284759355 [Monday, January 26, 2015 10:05:59 AM EST], closeTime=0}
              at com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3113)
              at com.bigdata.journal.WriteExecutorService.commit(WriteExecutorService.java:2417)
              ... 12 more
      Caused by: java.lang.RuntimeException: Problem with entry at -314689041142382170
              at com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:4967)
              at com.bigdata.rwstore.RWStore.checkDeferredFrees(RWStore.java:3539)
              at com.bigdata.journal.RWStrategy.checkDeferredFrees(RWStrategy.java:781)
              at com.bigdata.journal.AbstractJournal$CommitState.writeCommitRecord(AbstractJournal.java:3476)
              at com.bigdata.journal.AbstractJournal$CommitState.access$2800(AbstractJournal.java:3278)
              at com.bigdata.journal.AbstractJournal.commitNow(AbstractJournal.java:4088)
              at com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3111)
              ... 13 more
      Caused by: java.lang.RuntimeException: addr=-73261059 : cause=java.lang.IllegalStateException: Bad Address: length requested greater than allocated slot
              at com.bigdata.rwstore.RWStore.getData(RWStore.java:2190)
              at com.bigdata.rwstore.RWStore.getData(RWStore.java:1989)
              at com.bigdata.rwstore.RWStore.getData(RWStore.java:2033)
              at com.bigdata.rwstore.RWStore.getData(RWStore.java:1989)
              at com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:4857)
              at com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:4953)
              ... 19 more
      Caused by: java.lang.IllegalStateException: Bad Address: length requested greater than allocated slot
              at com.bigdata.rwstore.RWStore.getData(RWStore.java:2082)
              ... 24 more
      

      Note: We have not been able to replicate this problem on either the standalone or HA1 deployment modes. It appears to be linked to the postCommit() and postHACommit() methods that are only invoked in HA with a replication factor of greater than ONE.

        Attachments

          Activity

            People

            Assignee:
            martyncutcher martyncutcher
            Reporter:
            bryanthompson bryanthompson
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: