dcrd/blockchain
Dave Collins fce24223cd
multi: Separate tx serialization type from version.
Decred's serialized format for transactions split the 32-bit version
field into two 16-bit components such that the upper bits are used to
encode a serialization type and the lower 16 bits are the actual
transaction version.

Unfortunately, when this was done, the in-memory transaction struct was
not also updated to hide this complexity, which means that callers
currently have to understand and take special care when dealing with the
version field of the transaction.

Since the main purpose of the wire package is precisely to hide these
details, this remedies the situation by introducing a new field on the
in-memory transaction struct named SerType which houses the
serialization type and changes the Version field back to having the
desired semantics of actually being the real transaction version.  Also,
since the maximum version can only be a 16-bit value, the Version field
has been changed to a uint16 to properly reflect this.

The serialization and deserialization functions now deal with properly
converting to and from these fields to the actual serialized format as
intended.

Finally, these changes also include a fairly significant amount of
related code cleanup and optimization along with some bug fixes in order
to allow the transaction version to be bumped as intended.

The following is an overview of all changes:
- Introduce new SerType field to MsgTx to specify the serialization type
- Change MsgTx.Version to a uint16 to properly reflect its maximum
  allowed value
- Change the semantics of MsgTx.Version to be the actual transaction
  version as intended
- Update all callers that had special code to deal with the previous
  Version field semantics to use the new semantics
- Switch all of the code that deals with encoding and decoding the
  serialized version field to use more efficient masks and shifts
  instead of binary writes into buffers which cause allocations
- Correct several issues that would prevent producing expected
  serializations for transactions with actual transaction versions that
  are not 1
- Simplify the various serialize functions to use a single func which
  accepts the serialization type to reduce code duplication
- Make serialization type switch usage more consistent with the rest of
  the code base
- Update the utxoview and related code to use uint16s for the
  transaction version as well since it should not care about the
  serialization type due to using its own
- Make code more consistent in how it uses bytes.Buffer
- Clean up several of the comments regarding hashes and add some new
  comments to better describe the serialization types
2017-08-07 14:10:27 -05:00
..
chaingen fullblocktests: Add more consensus tests. 2017-07-29 14:17:40 -05:00
fullblocktests multi: Separate tx serialization type from version. 2017-08-07 14:10:27 -05:00
indexers chain/indexers: Allow reorg of block one. 2017-07-17 13:13:53 -05:00
internal blockchain: LogBlockHeight only needs a wire.MsgBlock.. (#471) 2016-11-16 15:57:45 -06:00
stake multi: Separate tx serialization type from version. 2017-08-07 14:10:27 -05:00
testdata Replace the ticket database with an efficient, atomic implementation 2016-10-04 13:40:19 -04:00
accept.go blockchain: Sync main chain flag on ProcessBlock. 2017-07-26 14:16:13 -05:00
bench_test.go blockchain: Rework to use new db interface. 2016-08-18 15:42:18 -04:00
blocklocator.go Replace the ticket database with an efficient, atomic implementation 2016-10-04 13:40:19 -04:00
chain_test.go multi: Replace DecodeNetworkAddress with DecodeAddress 2017-07-21 23:41:24 -05:00
chain.go multi: Optimize by removing defers 2017-08-02 10:35:21 -05:00
chainio_test.go multi: Separate tx serialization type from version. 2017-08-07 14:10:27 -05:00
chainio.go multi: Separate tx serialization type from version. 2017-08-07 14:10:27 -05:00
checkpoints.go remove deadcode 2017-07-17 15:06:47 -05:00
common_test.go fullblocktests: Sync upstream block validation. 2017-07-29 17:14:47 -05:00
compress_test.go blockchain: Rework to use new db interface. 2016-08-18 15:42:18 -04:00
compress.go blockchain: Rework to use new db interface. 2016-08-18 15:42:18 -04:00
difficulty_test.go blockchain: drop height param from newBlockNode() 2017-05-24 14:10:54 -05:00
difficulty.go multi: Implement stake difficulty change and vote. 2017-04-26 13:00:28 -05:00
doc.go Initial Decred Commit. 2016-02-07 14:00:12 -05:00
error_test.go blockchain: Rework to use new db interface. 2016-08-18 15:42:18 -04:00
error.go blockchain: add missing error code entries 2017-07-25 11:43:14 -04:00
example_test.go blockchain: Sync main chain flag on ProcessBlock. 2017-07-26 14:16:13 -05:00
fullblocks_test.go fullblocktests: Add more consensus tests. 2017-07-29 14:17:40 -05:00
fullblocksstakeversion_test.go blockchain: Always run fullblock tests. 2017-02-21 15:49:22 -06:00
internal_test.go blockchain: drop height param from newBlockNode() 2017-05-24 14:10:54 -05:00
log.go all: Remove seelog logger. 2017-06-20 10:58:10 -04:00
mediantime_test.go blockchain: Rework to use new db interface. 2016-08-18 15:42:18 -04:00
mediantime.go Initial Decred Commit. 2016-02-07 14:00:12 -05:00
merkle_test.go blockchain: Rework to use new db interface. 2016-08-18 15:42:18 -04:00
merkle.go multi: Upstream chainhash abstraction sync 2016-11-16 12:48:40 -06:00
notifications.go Replace the ticket database with an efficient, atomic implementation 2016-10-04 13:40:19 -04:00
process.go blockchain: Sync main chain flag on ProcessBlock. 2017-07-26 14:16:13 -05:00
prune.go Add a block pruner that only prunes occassionally 2016-10-12 14:07:27 -04:00
README.md multi: Update markdown in README files to match change in github parser. 2017-05-26 12:06:19 -04:00
reorganization_test.go blockchain: check errors and remove ineffectual assignments. 2017-07-17 13:52:06 -05:00
scriptval_test.go rpctest: Use ports based on the process id. 2017-07-21 22:28:59 -05:00
scriptval.go travis: enable gometalinter (#603) 2017-03-08 15:44:15 -05:00
stakeext.go rpcserver: Add existsmissedtickets RPC. 2017-05-17 10:24:56 -04:00
stakenode.go blockchain: various code cleanups 2017-03-24 15:58:52 -04:00
stakeversion_test.go blockchain: check errors and remove ineffectual assignments. 2017-07-17 13:52:06 -05:00
stakeversion.go blockchain: Optimize stake and vote lookups. 2017-02-27 14:15:13 -06:00
subsidy_test.go multi: Upstream parameter abstraction sync 2016-11-16 19:34:01 -06:00
subsidy.go multi: Update DecodeAddress function signature 2017-07-21 23:41:24 -05:00
thresholdstate_test.go multi: Rename vote choice IsIgnore to IsAbstain. 2017-04-24 16:17:27 -05:00
thresholdstate.go multi: Rename vote choice IsIgnore to IsAbstain. 2017-04-24 16:17:27 -05:00
timesorter_test.go blockchain: Rework to use new db interface. 2016-08-18 15:42:18 -04:00
timesorter.go blockchain: Rework to use new db interface. 2016-08-18 15:42:18 -04:00
upgrade.go travis: enable gometalinter (#603) 2017-03-08 15:44:15 -05:00
utxoviewpoint.go multi: Separate tx serialization type from version. 2017-08-07 14:10:27 -05:00
validate_test.go multi: Separate tx serialization type from version. 2017-08-07 14:10:27 -05:00
validate.go blockchain: check for error 2017-07-28 10:15:57 -04:00
votebits_test.go blockchain: drop height param from newBlockNode() 2017-05-24 14:10:54 -05:00
votebits.go multi: Rename vote choice IsIgnore to IsAbstain. 2017-04-24 16:17:27 -05:00

blockchain

Build Status ISC License GoDoc

Package blockchain implements decred block handling and chain selection rules. The test coverage is currently only around 60%, but will be increasing over time. See test_coverage.txt for the gocov coverage report. Alternatively, if you are running a POSIX OS, you can run the cov_report.sh script for a real-time report. Package blockchain is licensed under the liberal ISC license.

There is an associated blog post about the release of this package here.

This package has intentionally been designed so it can be used as a standalone package for any projects needing to handle processing of blocks into the decred block chain.

Installation and Updating

$ go get -u github.com/decred/dcrd/blockchain

Decred Chain Processing Overview

Before a block is allowed into the block chain, it must go through an intensive series of validation rules. The following list serves as a general outline of those rules to provide some intuition into what is going on under the hood, but is by no means exhaustive:

  • Reject duplicate blocks
  • Perform a series of sanity checks on the block and its transactions such as verifying proof of work, timestamps, number and character of transactions, transaction amounts, script complexity, and merkle root calculations
  • Compare the block against predetermined checkpoints for expected timestamps and difficulty based on elapsed time since the checkpoint
  • Save the most recent orphan blocks for a limited time in case their parent blocks become available
  • Stop processing if the block is an orphan as the rest of the processing depends on the block's position within the block chain
  • Perform a series of more thorough checks that depend on the block's position within the block chain such as verifying block difficulties adhere to difficulty retarget rules, timestamps are after the median of the last several blocks, all transactions are finalized, checkpoint blocks match, and block versions are in line with the previous blocks
  • Determine how the block fits into the chain and perform different actions accordingly in order to ensure any side chains which have higher difficulty than the main chain become the new main chain
  • When a block is being connected to the main chain (either through reorganization of a side chain to the main chain or just extending the main chain), perform further checks on the block's transactions such as verifying transaction duplicates, script complexity for the combination of connected scripts, coinbase maturity, double spends, and connected transaction values
  • Run the transaction scripts to verify the spender is allowed to spend the coins
  • Insert the block into the block database

Examples

  • ProcessBlock Example
    Demonstrates how to create a new chain instance and use ProcessBlock to attempt to attempt add a block to the chain. This example intentionally attempts to insert a duplicate genesis block to illustrate how an invalid block is handled.

  • CompactToBig Example
    Demonstrates how to convert the compact "bits" in a block header which represent the target difficulty to a big integer and display it using the typical hex notation.

  • BigToCompact Example
    Demonstrates how to convert how to convert a target difficulty into the compact "bits" in a block header which represent that target difficulty.

License

Package blockchain is licensed under the copyfree ISC License.