ref/changelog/4.4.16.html

<!--$Id: 4.4.16.html,v 1.24 2007/05/17 18:17:18 bostic Exp $-->
<html>
<head>
<title>The Berkeley DB Package: DB 4.4.16 Change Log</title>
<meta name="description" content="Berkeley DB: A database programmatic toolkit.">
<meta name="keywords" content="embedded,database,programmatic,toolkit,b+tree,btree,hash,hashing,transaction,transactions,locking,logging,access method,access methods">
</head>
<body bgcolor=white>

<h3 align=center>Berkeley DB 4.4.16 Change Log</h3>

<h3>Database or Log File On-Disk Format Changes:</h3>
<ol>

<li>The on-disk log format has changed.

</ol>
<h3>New Features:</h3>
<ol>

<li>Add support to compact an existing Btree database. [#6750]
<li>Add support for named in-memory databases. [#9927]
<li>Add support for database environment recovery serialization.  This
simplifies multiprocess application architectures. Add DB_REGISTER flag
to DB_ENV-&gt;open(). [#11511]
<li>Add utility for performing hot backups of a database environment.
[#11536]
<li>Add replication configuration API. [#12110]
<li>Add replication support to return error instead of waiting for
client sync to complete. [#12110]
<li>Add replication support for delayed client synchronization. [#12110]
<li>Add replication support for client-to-client synchronization.
[#12110]
<li>Add replication support for bulk transfer. [#12110]
<li>Add new flags DB_DSYNC_DB and DB_DSYNC_LOG [12941]
<li>Add DbEnv.log_printf, a new DbEnv method which logs printf style
formatted strings into the Berkeley DB database environment log.
[#13241]

</ol>
<h3>Database Environment Changes:</h3>
<ol>

<li>Add a feature to support arbitrary alignment of mutexes in order to
minimize cache line collisions. [#9580]
<li>Change cache regions on 64-bit machines to allow regions larger than
4GB. [#10668]
<li>Fix a bug where a loop could occur if the application or system
failed during modification of the linked list of shared regions.
[#11532]
<li>Fix mutex alignment on Linux/PA-RISC, add test-and-set mutexes for
MIPS and x86_64. [#11575]
<li>Fix a bug where private database environments (DB_PRIVATE) on 64-bit
machines would core dump because of 64-bit address truncation. [#11983]
<li>Fix a bug where freed memory is accessed when DB_PRIVATE
environments are closed.  This can happen on systems where the operating
system holds mutex resources that must be freed when the mutex is
destroyed. [#12591]
<li>Fix a bug where the DbEnv.stat_print method could self-deadlock and
hang.  The DbEnv.stat_print method no longer displays statistics for any
of the database environments databases. [#12039]
<li>Fix a bug where Berkeley DB could create fragmented
filesystem-backed shared region files. [#12125]
<li>Fix a bug where Berkeley DB stat calls could report a cache size of
0 after the statistics were cleared. [#12307]
<li>Threads of control joining database environments are now configured
for all of the subsystems (lock, log, cache, or transaction) for which
the environment was originally configured, it is now an error to attempt
configuration of additional subsystems after an environment is created.
[#12422]
<li>Fix a bug where negative percentages could be displayed in
statistics output. [#12673]
<li>Fix a bug that could cause a panic if the cache is filled with
non-logging updated pages. [#12763]
<li>Fix a bug that could cause an unreported deadlock if the application
was using the DB_DIRTY_READ flag and the record was an off page
duplicate record. [#12893]
<li>Fix a bug where a handle lock could be incorrectly retained during
a delete or rename operation. [#12906]

</ol>
<h3>Concurrent Data Store Changes:</h3>
<ol>

<li>Lock upgrades and downgrades are now accounted for separately from
lock requests and releases. [#11155]
<li>Fix a bug where a second process joining a Concurrent Data Store
environment, with the DB_CDB_ALLDB flag set, would fail.  This would
happen if the first thread were not entirely finished with
initialization. [#12277]

</ol>
<h3>General Access Method Changes:</h3>
<ol>

<li>Fix a bug where filesystem operations are improperly synchronized.
[#10564]
<li>Add support for database files larger than 2GB on Windows. [#11839]
<li>Rename DB_DEGREE_2 (and all related flags) to DB_READ_COMMITTED.
Rename DB_DIRTY (and all related flags) to DB_READ_UNCOMMITTED. [#11776]
<li>Fix a bug where wrapping of sequences was incorrect when the cache
size is smaller than the range of the maximum value minus the minimum
value.  [#11997]
<li>Fix a bug that could result in a hot backup having a page missing
from a database file if a file truncation was in progress during the
backup but was then aborted. [#12017]
<li>Fix a bug where a long filename could cause one too few bytes to
be allocated when opening a file. [#12085]
<li>Fix a bug in secondary cursor code if a write lock is not granted.
[#12109]
<li>Fix a bug in secondary cursors where the current record would change
on error. [#12141]
<li>Fix a bug in Db-&gt;truncate where the method was not checking to see
if the handle was opened read-only. [#12179]
<li>Fix a bug in sequences so that they are now platform independent,
taking into account little-endian and big-endian architectures. They
will be automatically upgraded in 4.4. [#12202]
<li>Fix a bug with non-wrapping sequences when initial value was
INT64_MIN. [#12390]
<li>Add a retry for operating system operations that return EIO (IO
Error) to better support NFS mounted filesystems. [#12426]
<li>Fix sequence wrapping at INT64 limits. [#12520]
<li>Fix a bug where errors during DB-&gt;associate could leave secondaries
half associated. [#13173]
<li>Fix a bug so that we no longer will update in CDS and DS if the file
size limit will be exceeded. [#13222]

</ol>
<h3>Btree Access Method Changes:</h3>
<ol>

<li>Remove maxkey configuration. [#8904]
<li>Fix a memory leak in operations on large Btrees. [#12000]

</ol>
<h3>Hash Access Method Changes:</h3>
<ol>

<li>Fix a bug where access to HASH or encrypted database pages might be
blocked during a checkpoint. [#11031]
<li>Fix a bug where recovery would fail when a database has a hash page
on the free list and that hash page was freed without using transactions
and later allocated and aborted within a transaction. [#11214]
<li>Fix a bug in hash duplicates where if the caller left garbage in the
partial length field, we were using it.  Fix a bug where a replacement
of a hash item that should have gone on an overflow page, did not.
[#11966]
<li>Fix a bug where free space was miscalculated when adding the first
duplicate to an existing item and the existing item plus the new item
does not fit on a page. [#12270]
<li>Fix a bug where allocations of hash buckets are not recovered
correctly. [#12846]

</ol>
<h3>Queue Access Method Changes:</h3>
<ol>

<li>Improve performance of deletes from a QUEUE database that does not
have a secondary index. [#11538]
<li>Fix a bug where updates that do not use transactions, but do enable
locking,  failed to release locks. [#11669]
<li>Fix a bug where a transaction might not be rolled forward if the
site was performing hot backups and an application aborted a prepared
but not committed transaction. [#12181]
<li>Fix a bug with queue extents not being reclaimed. [#12249]
<li>Fix a bug where a record being inserted before the head of the queue
could appear missing if DB_CONSUME is not specified. [#12919]
<li>Fix a bug that might cause recovery to move the head or tail of the
queue to exclude a record that was deleted but whose transaction did not
commit. [#13256]
<li>Fix a bug that could cause recovery to move the head or tail pointer
beyond a record that was aborted but was rolled backward by recovery.
[#13318]

</ol>
<h3>Recno Access Method Changes</h3>

None.

<h3>C++-specific API Changes:</h3>
<ol>

<li>Fix a bug so that a DbMemoryException will be raised during a
DB_BUFFER_SMALL error. [#13273]

</ol>
<h3>Java-specific API Changes:</h3>
<ol>

<li>Add VersionMismatchException to map the DB_VERSION_MISMATCH error.
[#11429]
<li>Fix a bug in Environment.getConfiguration() method in non-crypto
builds. [#11752]
<li>Fix a bug that caused a NullPointerException when using the
MultipleDataEntry default constructor. [#11753]
<li>Fix handling of replication errors. [#11822]
<li>Remove EnvironmentConfig.setReadOnly() method. [#11882]
<li>Fix a bug where prefix strings in the error handler may be
corrupted. [#11967]
<li>Fix a bug so that nested exceptions will appear in stack traces.
[#11992]
<li>Fix a bug on LogSequenceNumber objects in the Java API. [#12223]
<li>Fix a bug when no files are returned from a call to
DB_ENV-&gt;log_archive.  [#12383]
<li>Fix a bug when multiple verbose flags are set. [#12383]
<li>Fix a bug so that an OutOfMemoryError is thrown when allocation
fails in the JNI layer. [#13434]

</ol>
<h3>Java collections and bind API Changes:</h3>
<ol>

<li>Binding performance has been improved by using System.arraycopy in
the FastOutputStream and FastInputStream utility classes. [#12002]
<li>The objectToEntry method is now implemented in all TupleBinding
subclasses (IntegerBinding, etc) so that tuple bindings are fully
nestable. An example of this usage is a custom binding that dynamically
discovers the data types of each of the properties of a Java bean class.
For each property, it calls TupleBinding.getPrimitiveBinding using the
property's type (class). When the custom binding's objectToEntry method
is called, it in turn calls the objectToEntry method of the nested
bindings for each property. [#12124]
<li>The getCause method for IOExceptionWrapper and
RuntimeExceptionWrapper is now defined so that nested exceptions appear
in stack traces for exceptions thrown by the collections API. [#11992]
<li>TupleBinding.getPrimitiveBinding can now be passed a primitive type
class as well as a primitive wrapper class. The return value for
Integer.TYPE and Integer.class, for example, will be the same binding.
[#12035]
<li>Improvements have been made to prevent the buffer used in serial and
tuple bindings from growing inefficiently, and to provide more
alternatives for the application to specify the desired size. For
details see com.sleepycat.bind.serial.SerialBase and
com.sleepycat.bind.tuple.TupleBase. [#12398]
<li>Add StoredContainer.getCursorConfig, deprecate isDirtyRead.
Deprecate StoredCollections.dirtyReadMap (dirtyReadSet, etc) which is
replaced by configuredMap (configuredSet, etc). Deprecated
StoredContainer.isDirtyReadAllowed with no replacement (please use
DatabaseConfig.getDirtyRead). Also note that
StoredCollections.configuredMap (configuredSet, etc) can be used to
configure read committed and write lock containers, as well as read
uncommitted containers, since all CursorConfig properties are supported.
[#11776]
<li>Add the protected method SerialBinding.getClassLoader so that
subclasses may return a specific or dynamically determined class loader.
Useful for applications which use multiple class loaders, including
applications that serialize Groovy-defined classes. [#12764] [#12749]

</ol>
<h3>Tcl-specific API Changes:</h3>
<ol>

<li>Fix a bug that could cause a memory leak in the replication test
code. [#13436]

</ol>
<h3>RPC-specific Client/Server Changes:</h3>
<ol>

<li>Fix double-free in RPC server when handling an out-of-memory error.
[#11852]

</ol>
<h3>Replication Changes:</h3>
<ol>

<li>Fix race condition (introduced in 4.3) in rep_start function.
[#11030]
<li>Changed internal initialization to no longer store records. [#11090]
<li>Add support for replication bulk transfer. [#11099]
<li>Berkeley DB now calls check_doreq function for MASTER_REQ messages.
[#11207]
<li>Fix a bug where transactions could be counted incorrectly during
txn_recover. [#11257]
<li>Add DB_REP_IGNORE flag so that old messages (especially PERM
messages) can be ignored by applications. [#11585]
<li>Fix a bug where op_timestamp was not initialized. [#11795]
<li>Fix a bug in db_refresh where a client would write a log record on
closing a file. [#11892]
<li>Fix backward arguments in C++ rep_elect API. [#11906]
<li>Fix a bug where a race condition could happen between downgrading a
master and a database update operation. [#11955]
<li>Fix a bug on VERIFY_REQ. We now honor wait recs/rcvd. [#12097]
<li>Fix a bug in rebroadcast of verify_req by initializing lp-&gt;wait_recs
when finding a new master. [#12097]
<li>Fix a bug by adding lockout checking to __env_rep_enter since
rename/remove now call it. [#12192]
<li>Fix a bug so that we now skip __db_chk_meta if we are a rep client.
[#12316]
<li>Fix a replication failure on Windows. [#12331]
<li>Remove master discovery phase from rep_elect as a performance
improvement to speed up elections. [#12551]
<li>Fix a bug to avoid multiple data streams when issuing al ALL_REQ.
[#12595]
<li>Fix a bug to request the remaining gap again if the gap record is
dropped after we receive the singleton. [#12974]
<li>Fix a bug in internal initialization when master changes in the
middle of initializing. [#13074]
<li>Fix a bug in replication/archiving with internal init. [#13110]
<li>Fix pp handling of db_truncate. [#13115]
<li>Fix a bug where rep_timestamp could be updated when it should not
be updated. [#13331]
<li>Fix a bug with bulk transfer when toggling during updates. [#13339]
<li>Change EINVAL error return to DB_REP_JOIN_FAILURE. [#12110]
<li>Add C++ exception for DB_REP_HANDLE_DEAD. [#13361]
<li>Fix a bug where starting an election concurrently with processing a
NEWMASTER message could cause the send function to be called with an
invalid eid. [#13403]

</ol>
<h3>XA Resource Manager Changes:</h3>

None.

<h3>Locking Subsystem Changes:</h3>

None.

<h3>Logging Subsystem Changes:</h3>
<ol>

<li>Add set_log_filemode for applications that need to set an absolute
file mode on log files. [#8747]
<li>Fix a bug that caused Not Found to be returned if a log file exists
but is not readable. [#11185]
<li>Removed checksum of records with an in-memory log buffer. [#11280]
<li>Fix a bug so that the DB_LOG_INMEMORY flag can no longer be set
after calling DB_ENV-&gt;open. [#11436]
<li>Fix a bug introduced after release 4.0 where two simultaneous
checkpoints could cause ckp_lsn values to be out of order. [#12094]
<li>Fix a bug when in debug mode and using the DEBUG_ROP which will now
log read operations in __dbc_logging. [#12303]
<li>Fix a bug where failing to write a log record on a file close would
result in a core dump later. [#12460]
<li>Fix a bug where automatic log file removal, or the return of log
files using an absolute path, could fail silently if the applications
current working directory could not be reached using the systems getcwd
library call. [#12505]
<li>Avoid locking the log region if we are not going to flush the log.
This can improve performance for some write-intensive application
workloads. [#13090]
<li>Fix a bug with a possible segment fault when memp_stat_print is
called on a temporary database. [#13315]
<li>Fix a bug where log_stat_print could deadlock with threads during a
checkpoint. [#13315]

</ol>
<h3>Memory Pool Subsystem Changes:</h3>
<ol>

<li>Fix a bug where modified database pages might not be flushed if
recovery were run and all pages from a database were found in the system
cache and up to date, followed by a system crash. [#11654]

</ol>
<h3>Transaction Subsystem Changes:</h3>
<ol>

<li>Add new DbTxn class methods allowing applications to set/get a
descriptive name associated with a transaction.  The descriptive name
is also displayed by the db_stat utility. [#0382]
<li>Fix a bug where aborting a transaction with a large number of nested
transactions could take a long time. [#10972]
<li>Add support to allow the TXN_WRITE_NOSYNC flag to be specified on
the transaction handle. [#11151]
<li>Fix a bug that could cause a page to be on the free list twice if
it was originally put on the free list by a non-transactional update and
then reallocated in a transaction that aborts. [#11159]
<li>Remove the requirement for the DB_AUTO_COMMIT flag to make database
operations transactional. Specifying the database environment as
transactional or opening the database handle transactionally is
sufficient. [#11302]
<li>Fix a bug so that environments created from errant programs that
called dbp-&gt;close while transactions were still active can now be
recovered. [#11384]
<li>Fix a bug that caused free pages at the end of a file to be
truncated during recovery rather than placed on the free page list.
[#11643]
<li>Fix a bug that caused a page to have the wrong type if the truncate
of a BREE or RECNO database needed to be rolled forward. [#11670]
<li>Fix a bug when manually undoing a subdb create, dont try to free a
root page that has not been allocated. [#11925]
<li>Add a check on database open to see if log files were incorrectly
removed by system administration mistakes. [#12178]
<li>Fix a bug when calling DB-&gt;pget and then specifying the
DB_READ_COMMITTED (DB_DEGREE_2) on a cursor.  If followed by a
DBC-&gt;c_pget, the primary database would incorrectly remain locked.
[#12410]
<li>Fix a bug where the abort of a transaction in which a sub database
was opened with the DB_TXN_NOT_DURABLE flag could fail. [#12420]
<li>Fix a bug that could cause an abort transaction that allocated new
pages to a file that were not flushed to disk prior to the abort
transaction to report out of disk space. [#12743]
<li>Fix a bug that could prevent multiple creates and destroys of the
same file to be recovered correctly. [#13026]
<li>Fix a bug when recovery previously handled a section of the log that
did not contain any transactions. [#13139]
<li>Fix a bug that could result in the loss of durability in
Transactional Environments on Mac OS X. [#13149]
<li>Fix a bug that could cause the improper reuse of a transaction id
when recovery restores prepared transactions. [#13256]

</ol>
<h3>Utility Changes:</h3>
<ol>

<li>Add utility for performing hot backups of a database environment.
[#11536]
<li>Change the Verify utility to now identify any nodes that have
incorrect record counts. [#11934]
<li>Fix a bug in the 1.85 compatibility code supporting per-application
Btree comparison and prefix compression functions.  The functions would
not work on big-endian 64-bit hardware. [#13316]

</ol>
<h3>Configuration, Documentation, Portability and Build Changes:</h3>
<ol>

<li>Change the ex_tpcb sample application to no longer displays
intermediate results.  It displays results at the end of the run.
[#11259]
<li>Change the Visual Studio projects on Windows so that each is in an
intermediate directory. [#11441]
<li>Fix errors in test subdb011. [#11799]
<li>Fix a bug that could cause applications using gcc on Power PC
platforms to hang. [#12233]
<li>Fix a bug where installation will fail if a true program cannot be
found. [#12278]
<li>Fix a bug that prevented C++ applications from configuring XA
[#12300].
<li>Fix a race condition in the Windows mutex implementation found on
8-way Itanium systems.  [#12417]
<li>Add pthread mutex support for IBM OS/390 platform (z/OS or MVS).
[#12639]
<li>Fix a bug where the Tcl API did not configure on OS X 10.4. [#12699]
<li>Fix portability issues with queue or recno primary databases.
[#12872]
<li>Fix a bug where utility attempted to send replication message.
[#13446]

</ol>

</body>
</html>