CouchDB

Thursday Aug 15, 2013

Board Report (August 2013)

CouchDB submits a board report every quarter. Here's a copy of our August board report.

Description

Apache CouchDB is a database that uses JSON for documents, JavaScript for MapReduce queries, and regular HTTP for an API.

Releases

Recent Activity

  • Support added for latest Erlang/OTP releases.
  • Preparation for 1.4.0 release cycle has begun.
  • Work is underway to document an official project vision.
  • Work is underway to release in Cloudant's Fauxton overhaul of the CouchDB admin interface.
  • Work is underway to merge in Cloudant's BigCouch fork which will add clustering capabilities to CouchDB.
  • Work is underway to merge in parts of Benoît Chesneau's rcouch fork which improves the build system, refactored internal applications, and additional user-facing functionality such as bonjour/zeroconf awareness, global db changes feeds, replications and changes feeds across views.
  • Work is underway on a plugin system, with early results already shared with the community.
  • Cloudant announced the BigCouch merge, generating lots of press activity.
  • Cloudant hosted a CouchDB booth and CouchDB party at OSCON.
  • Cloudant are organising 'Apache CouchDB Conf, Vancouver' on November 13th, 2013 (in line with ASF branding and CouchDB PMC cooperation).

Our GitHub comment notifications have not been set up yet, due to lack of progress with necessary infrastructure tasks.

Community

Including the following additions, CouchDB has 28 committers and 9 PMC members.

New committers:

No new PMC members.

Mailing list stats:

  • announce
    • 94 subscribers (+38)
    • 1 message since May (-1)
  • user
    • 1441 subscribers (-15)
    • 496 messages since May (-561)
  • erlang
    • 121 subscribers (+16)
    • 7 messages since May (-7)
  • dev
    • 599 subscribers (-2)
    • 1010 messages since May (-996)
  • commits
    • 107 subscribers (+6)
    • 697 messages since May (-262)

Issues

No issues for the board at this time.

Tuesday Aug 13, 2013

Announcing CouchDB Conf in Vancouver

We’re excited to announce the next Apache CouchDB Conf will be in Vancouver, Canada on November 13, 2013. Big thanks to Cloudant to helping to make this happen!

Sign up to get notified when CouchDB Conf tickets go on sale.

We’re building the schedule with talks from all corners of the CouchDB community and hope to see you there this fall. This is a follow-up to our CouchDB Conf in Berlin, where we laid the groundwork for the BigCouch merge and other exciting features you'll hear about in Vancouver (geospatial data and PouchDB for mobile devices to name two).

We’ll be in Vancouver, BC the day before CascadiaJS 2013, which will be held November 14-15. Sign up to get notified when the next batch of CascadiaJS tickets go on sale. The Early Bird tickets sold out in 20 minutes!

There's lots of crossover between the JavaScript and CouchDB communities. Data-driven web apps and CouchDB makes it a natural fit. So we hope you'll be able to stick around and experience what both conferences have to offer.

We’ll plan to keep running these Apache CouchDB Confs. Got suggestions? Feedback? Wanna help us with our next one? Get in touch publicly, or privately. You can also tweet us at @CouchDB. Whatever suits!

Thursday Jul 25, 2013

Welcome BigCouch

Good news! Cloudant has announced the completion of the BigCouch merge. This is a huge step forward for CouchDB. So thank you to Cloudant, and thank you to the committers (particularly Robert Newson and Paul Davis) who slogged (and travelled the world to pair with each other) to make this happen.

What does this mean? Well, right now, the code is merged, but not released. So hold your clicks just a moment! Once the code has been tested, we will include it in one of our regular releases. (If you want to help us test, hop on to the dev@ mailing list!)

What’s new? The key accomplishment of the merged code is that BigCouch’s clustering capability, along with the rest of Cloudant’s other enhancements to CouchDB’s code base, will now be available in Apache CouchDB. This also includes improvements in compaction and replication speed, as well as boosts for high-concurrency access performance.

Painless replication has always been CouchDB's biggest feature. Now we get to take advantage of Cloudant’s experience running large distributed clusters in production for four years. With BigCouch merged in, CouchDB will be able to replicate data at a much larger scale.

But wait! That’s not all! Cloudant has decided to terminate their BigCouch fork of CouchDB, and instead focus future development on Apache CouchDB. This is excellent news for CouchDB, even more excellent news for the CouchDB community.

Here’s the original press release:

Cloudant Contributes Database Scalability and Fault-Tolerance Framework to Apache CouchDB™

And here are some highlights from the press:

Sofa, so good ... BigCouch relaxes into comfy Apache CouchDB (The Register)

Cloudant pitches one CouchDB for all (GigaOM)

Cloudant Merges BigCouch Into Apache CouchDB (eWeek)

Cloudant Breathes Life Into CouchDB - Merges BigCouch into Apache Project (CMSwire)

CouchDB Gets Cloudant's 'Super-Size Me' Scaling (InformationWeek)

Cloudant Merges BigCouch Code into Apache Open Source Database (The WHIR)

Cloudant Merges BigCouch Database into Open Source Apache CouchDB (The VAR Guy)

Cloudant merges distributed BigCouch code with Apache CouchDB (JAXenter)

Cloudant contributes database scalability and fault-tolerance framework to Apache CouchDB (SD Times)

P.S. Cloudant is also hosting a party at OSCON on July 25 to celebrate the news. (They’re booth #305 if you’re at the show.) And if all that wasn’t enough, stay tuned for news about a CouchDB conference that we should be announcing shortly…

Thursday Jun 27, 2013

Apache CouchDB 1.3.1 Released

Apache CouchDB 1.3.1 has been released and is available for download.

CouchDB is a database that completely embraces the web. Store your data with JSON documents. Access your documents with your web browser, via HTTP. Query, combine, and transform your documents with JavaScript. CouchDB works well with modern web and mobile apps. You can even serve web apps directly out of CouchDB. And you can distribute your data, or your apps, efficiently using CouchDB’s incremental replication. CouchDB supports master-master setups with automatic conflict detection.

Grab your copy here:

http://couchdb.apache.org/

Pre-built packages for Windows and OS X are available.

CouchDB 1.3.1 is a bugfix release, and was originally published on 2013-06-27.

These release notes are based on the CHANGES file.

Replicator

  • Tolerate missing source and target fields in _replicator docs (COUCHDB-1788).

Log System

  • Don't log about missing .compact files.

  • Fix bug in WARN level logging from 1.3.0 (COUCHDB-1794).

View Server

  • Fix the -S option to couchjs to increase memory limits (COUCHDB-1792).

Misc

  • Improve documentation: better structure, improve language, less duplication.

  • Improvements to test suite and VPATH build system.

Friday Apr 26, 2013

Apache CouchDB is supporting the Google Summer of Code

The Apache Software Foundation is participating in GSoC again this year, and CouchDB is on the project list of course!

By the end of the summer, we hope you've above all, had fun, and we've enabled you to make a valued contribution, and ideally help you continue in your involvement with the CouchDB project.

I'm a student, how do I start?

Check out some of the ideas or suggest your own ones. Please subscribe to our developer mailing list and join us on IRC at #couchdb-dev on irc.freenode.net to talk about what you're interested in. Don't forget to read the ASF GsOC guide.

You'll need to pick your projects and submit proposals from 22nd April to 3rd May.

I'm interested in being a mentor for the CouchDB project!

Thanks! Please read up on being a mentor and contact dev@couchdb.apache.org for more details. Previous mentors suggest the effort is around 5h per week on average. Please review the topics list and feel free to make any adjustments.

Please pass this on to your local user groups, universities, etc. Thanks!

For more information on Google Summer of Code itself, timelines and proposals, visit the Melange website.

For more information on the Apache Software Foundation, visit our ASF site.

Tuesday Apr 09, 2013

Apache CouchDB 1.3.0 Released

Apache CouchDB 1.3.0 has been released and is available for download.

CouchDB is a database that completely embraces the web. Store your data with JSON documents. Access your documents with your web browser, via HTTP. Query, combine, and transform your documents with JavaScript. CouchDB works well with modern web and mobile apps. You can even serve web apps directly out of CouchDB. And you can distribute your data, or your apps, efficiently using CouchDB’s incremental replication. CouchDB supports master-master setups with automatic conflict detection.

Grab your copy here:

http://couchdb.apache.org/

Pre-built packages for Windows and OS X are available.

This release comes with a CouchDB manual, hosted directly out of Futon. A PDF version of the manual is also distributed.

This is a feature release.

These release notes are based on the CHANGES file.

HTTP Interface

  • No longer rewrites the X-CouchDB-Requested-Path during recursive calls to the rewriter.

  • Limit recursion depth in the URL rewriter.

    Defaults to a maximum of 100 invocations but is configurable.

  • Fix _session for IE7.

  • Added Server-Sent Events protocol to db changes API.

    See http://www.w3.org/TR/eventsource/ for details.

  • Make password hashing synchronous when using the /_config/admins API.

  • Include user name in show/list ETags.

  • Experimental support for Cross-Origin Resource Sharing (CORS).

    See http://www.w3.org/TR/cors/ for details.

Replicator

  • The replicator will use a new server-wide UUID in checkpoint IDs to improve the chances of an efficient resume.

Storage System

  • Fixed unnecessary conflict when deleting and creating a document in the same batch.

View Server

  • Additional response headers may be varied prior to send().

  • GetRow() is now side-effect free.

Futon

  • Disabled the link to the Futon test suite.

    These tests were causing problems when run from a browser, and are now available via the CLI instead.

  • Added view request duration to Futon.

  • Disable buttons for actions that the user doesn't have permissions to.

Security

  • Passwords are now hashed using the PBKDF2 algorithm with a configurable work factor.

Test Suite

  • Moved the JS test suite to the CLI.

  • Improved tracebacks printed by the JS CLI tests.

  • Improved the reliability of a number of tests.

UUID Algorithms

  • Added the utc_id algorithm.

URL Rewriter & Vhosts

  • Database name is encoded during rewriting (allowing embedded /'s, etc).

  • Reset rewrite counter on new request, avoiding unnecessary request failures due to bogus rewrite limit reports.

Build System

  • C/C++ compiler detection has been improved.

  • Autoconf v2.63 is now required if building from Git checkout directly.

    See DEVELOPERS file for more details.

  • Fixed issue in couchdb script where stopped status returns before process exits.

Tuesday Apr 02, 2013

Apache CouchDB 1.2.2 Released

Apache CouchDB 1.2.2 has been released and is available for download.

CouchDB is a database that completely embraces the web. Store your data with JSON documents. Access your documents with your web browser, via HTTP. Query, combine, and transform your documents with JavaScript. CouchDB works well with modern web and mobile apps. You can even serve web apps directly out of CouchDB. And you can distribute your data, or your apps, efficiently using CouchDB’s incremental replication. CouchDB supports master-master setups with automatic conflict detection.

Grab your copy here:

http://couchdb.apache.org/

Pre-built packages for Windows and OS X are available.

This is a bugfix release

These release notes are based on the CHANGES file.

HTTP Interface

  • Reset rewrite counter on new request, avoiding unnecessary request failures due to bogus rewrite limit reports.

Build System

  • Fixed issue in couchdb script where stopped status returns before process exits.

Thursday Jan 10, 2013

Apache CouchDB 1.2.1 Released

Apache CouchDB 1.2.1 has been released and is available for download.

Grab your copy here:

http://www.apache.org/dyn/closer.cgi?path=/couchdb/1.2.1/apache-couchdb-1.2.1.tar.gz

These release notes are based on the NEWS file.

HTTP Interface

  • Fix various bugs in the URL rewriter when recursion is involved.

Platform Integration

  • Fix couchdb start script.

Futon User Interface

  • Disable buttons that aren't available for the logged-in user.

Replicator

  • Fix potential replication timeouts.

View Server

  • Change use of signals to avoid broken view groups.

More Information

See the CHANGES file and the Git commit log for more information.

Apache CouchDB 1.1.2 Released

Apache CouchDB 1.1.2 has been released and is available for download.

Grab your copy here:

http://www.apache.org/dyn/closer.cgi?path=/couchdb/1.1.2/apache-couchdb-1.1.2.tar.gz

These release notes are based on the NEWS file.

HTTP Interface

  • ETag of attachment changes only when the attachment changes, not the document.
  • Fix retrieval of headers larger than 4k.
  • Allow OPTIONS HTTP method for list requests.
  • Don't attempt to encode invalid json.

Replicator

  • Fix pull replication of documents with many revisions.
  • Fix replication from an HTTP source to an HTTP target.

View Server

  • Avoid invalidating view indexes when running out of file descriptors.

Log System

  • Improvements to log messages for file-related errors.

Build System

  • Windows: don't ln the couchjs install target.
  • Windows: remove icu version dependency.
  • Improve SpiderMonkey version detection.

More Information

See the CHANGES file and the Git commit log for more information.

Apache CouchDB 1.0.4 Released

Apache CouchDB 1.0.4 has been released and is available for download.

Grab your copy here:

http://www.apache.org/dyn/closer.cgi?path=/couchdb/1.0.4/apache-couchdb-1.0.4.tar.gz

These release notes are based on the NEWS file.

Log System

  • Fix file descriptor leak in _log.

HTTP Interface

  • Fix missing revisions in _changes?style=all_docs.
  • Fix validation of attachment names.

View Server

  • Avoid invalidating view indexes when running out of file descriptors.

Replicator

  • Fix a race condition where replications can go stale.

More Information

See the CHANGES file and the Git commit log for more information.

Friday Apr 06, 2012

Apache CouchDB 1.2.0 Released

Apache CouchDB 1.2.0 has been released and is available for download.

Grab your copy here:

http://couchdb.apache.org/

Windows packages are now available. Grab them at the same download link.

This release also coincides with a revamped project homepage!

This is a big release with lots of updates. Please also note that this release contains breaking changes.

These release notes are based on the NEWS file.

Performance

  • Added a native JSON parser

    Performance critical portions of the JSON parser are now implemented in C. This improves latency and throughput for all database and view operations. We are using the fabulous yajl library.

  • Optional file compression (database and view index files)

    This feature is enabled by default.

    All storage operations for databases and views are now passed through Google's snappy compressor. The result is simple: since less data has to be transferred from and to disk and through the CPU & RAM, all database and view accesses are now faster and on-disk files are smaller. Compression can be changed to gzip compression with options that specify the compression ratio or it can be fully disabled as well.

  • Several performance improvements, especially regarding database writes and view indexing

    Combined with the two preceding improvements, we made some less obvious algorithmic improvements that take the Erlang runtime system into account when writing data to databases and view index files. The net result is much improved performance for most common operations including building views.

    The JIRA ticket (COUCHDB-976) has more information.

  • Performance improvements for the built-in changes feed filters _doc_ids and _design

Security

The security system got a major overhaul making it way more secure to run CouchDB as a public database server for CouchApps. Unfortunately we had to break a bit of backwards compatibility with this, but we think it is well worth the trouble.

  • Documents in the _users database can no longer be read by everyone

    Documents in the _users databases can now only be read by the respective authenticated user and administrators. Before, all docs were world-readable including their password hashes and salts.

  • Confidential information in the _replication database can no longer be read by everyone

    Similar to documents in the _users database, documents in the _replicator database now get passwords and OAuth tokens stripped when read by a user that is not the creator of the replication or an administrator.

  • Password hashes are now calculated by CouchDB instead of the client

    Previously, CouchDB relied on the client to hash and salt the user's password. Now, it accepts plain text passwords and hashes them before they are committed to disk, following traditional best practices.

  • Allow persistent authentication cookies

    Cookie based authentication can now keep a user logged in over a browser restart.

  • OAuth secrets can now be stored in the users system database

    This is better for managing large numbers of users and tokens than the old, clumsy way of storing OAuth tokens in the configuration system and configuration system.

  • Updated bundled erlang_oauth library to the latest version

    The Erlang library that handles OAuth authentication has been updated to the latest version.

Build System

  • cURL is no longer required to build CouchDB as it is only required by the command line JavaScript test runner

    This makes building CouchDB on certain platforms easier.

HTTP API

  • Added a data_size property to database and view group information URIs

    With this you can now calculate how much actual data is stored in a database file or view index file and compare it with the file size that is already being reported. The difference is CouchDB-specific overhead most of which can be reclaimed during compaction. This is used to power the automatic compaction feature (see below).

  • Added optional field since_seq to replication objects/documents

    This allows you to start a replication from a certain database update sequence instead from the start.

  • The _active_tasks API now exposes more granular fields for each task type

    The replication and compaction tasks, e.g. report their progress in the task info.

  • Added built-in changes feed filter _view

    With this you can use a view's map function as a changes filter instead of duplicating.

Core Storage

  • Added support for automatic compaction

    This feature is disabled by default, but it can be enabled in the configuration page in Futon or the .ini files.

    Compaction is a regular maintenance task for CouchDB. This can now be automated based on multiple variables:

    • A threshold for the file_size to disk_size ratio (say 70%)
    • A time window specified in hours and minutes (e.g 01:00-05:00)

    Compaction can be cancelled if it exceeds the closing time. Compaction for views and databases can be set to run in parallel, but that is only useful for setups where the database directory and view directory are on different disks.

    In addition, if there's not enough space (2 × data_size) on the disk to complete a compaction, an error is logged and the compaction is not started.

Replicator

  • A new replicator implementation that offers more performance and configuration options

    The replicator has been rewritten from scratch. The new implementation is more reliable, faster and has more configuration than the previous implementation. If you have had any issues with replication in previous releases, we strongly recommend giving 1.2.0 a spin.

    Configuration options include:

    • Number of worker processes
    • Batch size per worker
    • Maximum number of HTTP connections
    • Number of connection retries

    See default.ini for the full list of options and their default values.

    This allows you to fine-tune replication behaviour tailored to your environment. A spotty mobile network connection can benefit from a single worker process and small batch sizes to reliably, albeit slowly, synchronise data. A full-duplex 10GigE server-to-server connection on a LAN can benefit from more workers and higher batch sizes. The exact values depend on your particular setup and we recommend some experimentation before settling on a set of values.

Futon

  • Futon's Status screen (active tasks) now displays two new task status fields: Started on and Updated on

  • Simpler replication cancellation

    Running replications can now be cancelled with a single click.

Log System

  • Log correct stack trace in all cases

    In certain error cases, CouchDB would return a stack trace from the log system itself and hide the real error. Now CouchDB always returns the correct error.

  • Improvements to log messages for file-related errors

    CouchDB requires correct permissions for a number of files. Error messages related to file permission errors were not always obvious and are now improved.

Various Bugfixes

  • Fixed old index file descriptor leaks after a view cleanup
  • Fixes to the _changes feed heartbeat option when combined with a filter. It affected continuous pull replications with a filter
  • Fix use of OAuth with VHosts and URL rewriting
  • The requested_path property of query server request objects now has the path requested by clients before VHosts and rewriting
  • Fixed incorrect reduce query results when using pagination parameters
  • Made icu_driver work with Erlang R15B and later
  • Improvements to the build system and etap test suite
  • Avoid invalidating view indexes when running out of file descriptors

Breaking Changes

This release contains breaking changes:

http://wiki.apache.org/couchdb/Breaking_changes

It is very important that you understand these changes before you upgrade.

More Information

See the CHANGES file and the Git commit log for more information.

Calendar

Search

Hot Blogs (today's hits)

Tag Cloud

Categories

Feeds

Links

Navigation