Details

      Description

      Prepare the 1.2.0 release. This is a major release.

      Major new features include:

      1. SPARQL 1.1 UPDATE
      2. SPARQL 1.1 Service Description
      3. SPARQL 1.1 Basic Federated Query
      4. New integration point for custom services.
      5. Remote Java client for NanoSparqlServer
      6. Sesame 2.6.3 dependency
      7. Ganglia integration (cluster)
      8. Performance improvements (cluster)

      The following issues are resolved in this major release:

      Against both the 1.0.x and the 1.1.x maintenance branches:
      http://sourceforge.net/apps/trac/bigdata/ticket/476 (Test suite for writeCheckpoint() and recycling for BTree/HTree)
      http://sourceforge.net/apps/trac/bigdata/ticket/480 (Error releasing deferred frees using 1.0.6 against a 1.0.4 journal)
      http://sourceforge.net/apps/trac/bigdata/ticket/481 (PhysicalAddressResolutionException against 1.0.6)
      http://sourceforge.net/apps/trac/bigdata/ticket/482 (RWStore reset() should be thread-safe for concurrent readers)
      
      Against the 1.1.x maintenance branches:
      http://sourceforge.net/apps/trac/bigdata/ticket/92  (Monitoring webapp)
      http://sourceforge.net/apps/trac/bigdata/ticket/267 (Support evaluation of 3rd party operators)
      http://sourceforge.net/apps/trac/bigdata/ticket/337 (Compact and efficient movement of binding sets between nodes.)
      http://sourceforge.net/apps/trac/bigdata/ticket/438 (KeyBeforePartitionException on cluster)
      http://sourceforge.net/apps/trac/bigdata/ticket/439 (Class loader problem)
      http://sourceforge.net/apps/trac/bigdata/ticket/441 (Ganglia integration)
      http://sourceforge.net/apps/trac/bigdata/ticket/444 (SPARQL query can fail to notice when IRunningQuery.isDone() on cluster)
      http://sourceforge.net/apps/trac/bigdata/ticket/448 (SPARQL 1.1 UPDATE)
      http://sourceforge.net/apps/trac/bigdata/ticket/449 (SPARQL 1.1 Federation extension)
      http://sourceforge.net/apps/trac/bigdata/ticket/454 (Global Row Store Read on Cluster uses Tx)
      http://sourceforge.net/apps/trac/bigdata/ticket/456 (IExtension implementations do point lookups on lexicon)
      http://sourceforge.net/apps/trac/bigdata/ticket/457 ("No such index" on cluster under concurrent query workload)
      http://sourceforge.net/apps/trac/bigdata/ticket/458 (Java level deadlock in DS)
      http://sourceforge.net/apps/trac/bigdata/ticket/460 (Uncaught interrupt resolving RDF terms)
      http://sourceforge.net/apps/trac/bigdata/ticket/461 (KeyAfterPartitionException / KeyBeforePartitionException on cluster)
      http://sourceforge.net/apps/trac/bigdata/ticket/463 (NoSuchVocabularyItem with LUBMVocabulary for DerivedNumericsExtension)
      http://sourceforge.net/apps/trac/bigdata/ticket/464 (Query statistics do not update correctly on cluster)
      http://sourceforge.net/apps/trac/bigdata/ticket/465 (Too many GRS reads on cluster)
      http://sourceforge.net/apps/trac/bigdata/ticket/469 (Sail does not flush assertion buffers before query)
      http://sourceforge.net/apps/trac/bigdata/ticket/472 (acceptTaskService pool size on cluster)
      http://sourceforge.net/apps/trac/bigdata/ticket/475 (Optimize serialization for query messages on cluster)
      http://sourceforge.net/apps/trac/bigdata/ticket/478 (Cluster does not map input solution(s) across shards)
      http://sourceforge.net/apps/trac/bigdata/ticket/484 (Java API for NanoSparqlServer REST API)
      http://sourceforge.net/apps/trac/bigdata/ticket/491 (AbstractTripleStore.destroy() does not clear the locator cache)
      http://sourceforge.net/apps/trac/bigdata/ticket/492 (Empty chunk in ThickChunkMessage (cluster))
      http://sourceforge.net/apps/trac/bigdata/ticket/493 (Virtual Graphs)
      http://sourceforge.net/apps/trac/bigdata/ticket/496 (Sesame 2.6.3)
      http://sourceforge.net/apps/trac/bigdata/ticket/497 (Implement STRBEFORE, STRAFTER, and REPLACE)
      http://sourceforge.net/apps/trac/bigdata/ticket/498 (Bring bigdata RDF/XML parser up to openrdf 2.6.3.)
      http://sourceforge.net/apps/trac/bigdata/ticket/500 (SPARQL 1.1 Service Description)
      http://www.openrdf.org/issues/browse/SES-884        (Aggregation with an solution set as input should produce an empty solution as output)
      http://www.openrdf.org/issues/browse/SES-862        (Incorrect error handling for SPARQL aggregation; fix in 2.6.1)
      http://www.openrdf.org/issues/browse/SES-873        (Order the same Blank Nodes together in ORDER BY)
      http://sourceforge.net/apps/trac/bigdata/ticket/501 (SPARQL 1.1 BINDINGS are ignored)
      http://sourceforge.net/apps/trac/bigdata/ticket/503 (Bigdata2Sesame2BindingSetIterator throws QueryEvaluationException were it should throw NoSuchElementException)
      http://sourceforge.net/apps/trac/bigdata/ticket/504 (UNION with Empty Group Pattern)
      http://sourceforge.net/apps/trac/bigdata/ticket/505 (Exception when using SPARQL sort & statement identifiers)
      http://sourceforge.net/apps/trac/bigdata/ticket/506 (Load, closure and query performance in 1.1.x versus 1.0.x)
      http://sourceforge.net/apps/trac/bigdata/ticket/508 (LIMIT causes hash join utility to log errors)
      http://sourceforge.net/apps/trac/bigdata/ticket/513 (Expose the LexiconConfiguration to Function BOPs)
      http://sourceforge.net/apps/trac/bigdata/ticket/515 (Query with two "FILTER NOT EXISTS" expressions returns no results)
      http://sourceforge.net/apps/trac/bigdata/ticket/516 (REGEXBOp should cache the Pattern when it is a constant)
      http://sourceforge.net/apps/trac/bigdata/ticket/517 (Java 7 Compiler Compatibility)
      http://sourceforge.net/apps/trac/bigdata/ticket/518 (Review function bop subclass hierarchy, optimize datatype bop, etc.)
      http://sourceforge.net/apps/trac/bigdata/ticket/520 (CONSTRUCT WHERE shortcut)
      http://sourceforge.net/apps/trac/bigdata/ticket/525 (Modify the IChangeLog interface to support multiple agents)
      http://sourceforge.net/apps/trac/bigdata/ticket/527 (Expose timestamp of LexiconRelation to function bops)
      

      The following issues are pending resolution for this release:

      http://sourceforge.net/apps/trac/bigdata/ticket/521 (Incremental materialization of Tuple and Graph query results)
      http://sourceforge.net/apps/trac/bigdata/ticket/485 (RDFS Plus Profile)
      

        Activity

        Hide
        bryanthompson bryanthompson added a comment -

        The test suite for the cluster is showing errors on the federated query test6 and on several of the SPARQL update tests. I need to look into this further.

        We have three errors on the govtrack queries and two errors in CI which appear to be related to [1]. MikeP will look at these:

        GOVTRACK:
        
        queries/query10.rq
        queries/query40-1.rq
        queries/query41.rq
        
        CI:
        com.bigdata.rdf.sail.tck.BigdataComplexSparqlQueryTest.testGroupConcatDistinct
        com.bigdata.rdf.sail.tck.BigdataComplexSparqlQueryTest.testGroupConcatNonDistinct
        

        [1] https://sourceforge.net/apps/trac/bigdata/ticket/527 (Expose the timestamp of the LexiconRelation to the function bops)

        Show
        bryanthompson bryanthompson added a comment - The test suite for the cluster is showing errors on the federated query test6 and on several of the SPARQL update tests. I need to look into this further. We have three errors on the govtrack queries and two errors in CI which appear to be related to [1] . MikeP will look at these: GOVTRACK: queries/query10.rq queries/query40-1.rq queries/query41.rq CI: com.bigdata.rdf.sail.tck.BigdataComplexSparqlQueryTest.testGroupConcatDistinct com.bigdata.rdf.sail.tck.BigdataComplexSparqlQueryTest.testGroupConcatNonDistinct [1] https://sourceforge.net/apps/trac/bigdata/ticket/527 (Expose the timestamp of the LexiconRelation to the function bops)
        Hide
        bryanthompson bryanthompson added a comment -

        Fixed the SPARQL update issue on the cluster. It just needed a commit() since we are going through the BigdataSailConnection rather than raw shard writes. The cluster test suite is clean.

        Show
        bryanthompson bryanthompson added a comment - Fixed the SPARQL update issue on the cluster. It just needed a commit() since we are going through the BigdataSailConnection rather than raw shard writes. The cluster test suite is clean.
        Hide
        bryanthompson bryanthompson added a comment -

        The only pending issue is the RDFS Plus profile.

        Show
        bryanthompson bryanthompson added a comment - The only pending issue is the RDFS Plus profile.
        Hide
        bryanthompson bryanthompson added a comment -

        We are pushing on the RDFS Plus Profile [1] to a dot release after 1.2.0.

        The FILTER NOT EXISTS issue [2] has been resolved.

        Mike is looking into merging some changes to the full text index into the branch. Assuming this is straightforward, we will do that before cutting the release. It would be nice to do before 1.2.0 since there is a schema change in the full text index (the tuples are now in relevance order in the index and it special cases single token search since sorting is not required). This would also bring in the change set for the subject-centric full text index.

        [1] http://sourceforge.net/apps/trac/bigdata/ticket/485 (RDFS Plus Profile)
        [2] http://sourceforge.net/apps/trac/bigdata/ticket/515 (Query with two "FILTER NOT EXISTS" expressions returns no results)

        Show
        bryanthompson bryanthompson added a comment - We are pushing on the RDFS Plus Profile [1] to a dot release after 1.2.0. The FILTER NOT EXISTS issue [2] has been resolved. Mike is looking into merging some changes to the full text index into the branch. Assuming this is straightforward, we will do that before cutting the release. It would be nice to do before 1.2.0 since there is a schema change in the full text index (the tuples are now in relevance order in the index and it special cases single token search since sorting is not required). This would also bring in the change set for the subject-centric full text index. [1] http://sourceforge.net/apps/trac/bigdata/ticket/485 (RDFS Plus Profile) [2] http://sourceforge.net/apps/trac/bigdata/ticket/515 (Query with two "FILTER NOT EXISTS" expressions returns no results)
        Hide
        bryanthompson bryanthompson added a comment -

        Per [1], the changes to the index schema have been merged into the main development branch. I've fixed some resulting CI errors. I am now looking to verify a clean CI and re-verify the various benchmarks with this change set.

        [1] https://sourceforge.net/apps/trac/bigdata/ticket/447 (Subject-Centric Full Text Index)

        Show
        bryanthompson bryanthompson added a comment - Per [1] , the changes to the index schema have been merged into the main development branch. I've fixed some resulting CI errors. I am now looking to verify a clean CI and re-verify the various benchmarks with this change set. [1] https://sourceforge.net/apps/trac/bigdata/ticket/447 (Subject-Centric Full Text Index)
        Hide
        bryanthompson bryanthompson added a comment -

        LUBM is good (load/query).
        BSBM is good (load/query).
        Cluster CI is good (TCK, NSS).
        GOVTRACK CI is good.
        The data migration page on the wiki has been updated.
        The NanoSparqlServer wiki page has been updated.
        The release notes have been prepared and committed.
        The version has been bumped and committed.
        The WAR artifact has been verified.
        The release has been tagged (https://bigdata.svn.sourceforge.net/svnroot/bigdata/tags/BIGDATA_RELEASE_1_2_0) at r6241.
        A new development branch has been created (https://bigdata.svn.sourceforge.net/svnroot/bigdata/branches/BIGDATA_RELEASE_1_2_0) from the same revision.
        The WAR and release notes have been uploaded to SF into a new 1.2.0 directory.

        Show
        bryanthompson bryanthompson added a comment - LUBM is good (load/query). BSBM is good (load/query). Cluster CI is good (TCK, NSS). GOVTRACK CI is good. The data migration page on the wiki has been updated. The NanoSparqlServer wiki page has been updated. The release notes have been prepared and committed. The version has been bumped and committed. The WAR artifact has been verified. The release has been tagged ( https://bigdata.svn.sourceforge.net/svnroot/bigdata/tags/BIGDATA_RELEASE_1_2_0 ) at r6241. A new development branch has been created ( https://bigdata.svn.sourceforge.net/svnroot/bigdata/branches/BIGDATA_RELEASE_1_2_0 ) from the same revision. The WAR and release notes have been uploaded to SF into a new 1.2.0 directory.
        Hide
        bryanthompson bryanthompson added a comment -

        Javadoc has been published.
        Release has been announced (blog, email, etc).

        Show
        bryanthompson bryanthompson added a comment - Javadoc has been published. Release has been announced (blog, email, etc).

          People

          • Assignee:
            bryanthompson bryanthompson
            Reporter:
            bryanthompson bryanthompson
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: