📅 Original date posted:2016-02-29
📝 Original message:-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256
Hi
I’ve been thinking around a solution to reduce nodes bootstrap time
(IBD) as well as a way to reduce the amount of bandwidth/network usage
per node.
Not sure if this idea was/is already discussed, haven’t found anything
in a quick research.
==Title==
Fast bootstrapping with a pre-generated UTXO-set database.
==Abstract==
This documents describes a way how bitcoin nodes can bootstrap faster
by loading a pre-generated UTXO-set datafile with moderate reduction
of the security model.
==Specification==
Bitcoin-core or any other full node client will need to provide a
feature to "freeze" the UTXO-set at a specified height (will require a
reindex). The frozen UTXO-set – at a specific height – will be
deterministic linearized in a currently not specified
data-serializing-format.
Additionally, a serialized form of the current chain-index (chain
containing all block-headers) up to the specified height will be
appended to the pre-generated UTXO-set-datafile.
The datafile will be hashed with a double SHA256.
The corresponding hash will be produced/reproduced and signed (ECDSA)
by a group of developers, ideally the same group of developers who are
also signing deterministic builds (binary distribution).
Full node client implementations that supports bootstrapping from a
pre-generated UTXO-set, need to include...
1.) a set of pubkeys from trusted developers
2.) the hash (or hashes) of the pre-generated UTXO-set-datafile(s)
3.) n signatures of the hash(es) from 2) from a subset of developers
defined in 1)
To guarantee the integrity of developers pubkeys & signatures, methods
like the current gitian build, used in bitcoin-core, must be used.
New nodes could download a copy of the pre-generated UTXO-set, hash
it, verify the hash against the allowed UTXO-sets, verify the ECDSA
signatures from various developers, and continue bootstrapping from
the specified height if the users accepts the amount of valid signatures
.
Sharing of the pre-generated UTXO-set can be done over CDNs,
bit-torrent or any other file hosting solution. It would also be
possible to extend the bitcoin p2p layer with features to
distribute/share a such pre-generated UTXO-set, in chunks and with the
according hashes to detect invalidity before downloading the whole
content (but would probably end up in something very similar to
bit-torrent).
- ----------------------
</jonas>
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2
iQIcBAEBCAAGBQJW1B1wAAoJECnUvLZBb1PsqzsP/iSdvyhUzy+BZVSZbKXNjk5P
2vrtirI6NvKQd8hHbrcFeLfyswzYc2JWRnX8sATlauIS0pYdr97JriwUGlvxvNrY
iVTDdf8MIVu8zScLQtJbMatpMvsewtqQEidn/yxWIhiCg4G2T5DZmlBU6O4XIKR6
5aPHElGOKZ15EWGHBG7z4owj3MiOaxhD9q5erBbfLPpcm08o6XAv5miqmGnnn3zh
gocg4Gxs6iDygh3b2dCJFwWIVPxF6UVJhyjv2kLZUmEHT2Y2QvdGcLIIewcWHDze
kgoZYmOEowujCbmeJ+LBwgOI0c1N6L/ciomPBne7ILmK4LyUEzyMLJKNYf/sZ8vI
sVlmwZwZZLfILC7mzMAM0pfj99IOW680WHch9v31lWFlxW/bLvLqAO7n3acQuD6s
xCZN2nAhmWC8FnMFxqB3EUz0lX8giV3qRJZjbQMS+ZrngYkAmVv2bAsoLndqf6MO
l9W8B+ICg1KZLGIOF2pUrInpkB6gUALDFnypV4CeIVdeqtk5l4LnCHK6c4++Hl5n
Bv5HQ/wTgKKNFtHBEJpWyYWvAjfFtgUZUKblR+Bh+D7/Gte1ehiYd02KYD4ds9Y4
3gfO8YbAz/I14Yuh2bIlvVKPWnLQBwL5BBioBfvmhV/r6rEpzWvB7H6Fmi1c759l
VlL0GiUV8ar2LlFhEmWk
=lZSy
-----END PGP SIGNATURE-----
Jonas Schnelli [ARCHIVE] /
npub1nf…3dtxs
2023-06-07 17:49:22
in reply to nevent1q…sahq
Author Public Key
npub1nfrrurat393mqymf3s26pujyn5vujlem3pzcukr5p9d4qpklngxq43dtxsPublished at
2023-06-07 17:49:22Event JSON
{
"id": "a5d25b57c2371ea96494c1e39a8b068dd2670fea6086c848c063a2475a3ffdde",
"pubkey": "9a463e0fab8963b013698c15a0f2449d19c97f3b88458e5874095b5006df9a0c",
"created_at": 1686160162,
"kind": 1,
"tags": [
[
"e",
"14dc27fece119e1e47b0c2ec8ad44392e4e7803f7a1c11ab1be3df3c4e5a75ad",
"",
"reply"
],
[
"p",
"a23dbf6c6cc83e14cc3df4e56cc71845f611908084cfe620e83e40c06ccdd3d0"
]
],
"content": "📅 Original date posted:2016-02-29\n📝 Original message:-----BEGIN PGP SIGNED MESSAGE-----\nHash: SHA256\n\nHi\n\nI’ve been thinking around a solution to reduce nodes bootstrap time\n(IBD) as well as a way to reduce the amount of bandwidth/network usage\nper node.\nNot sure if this idea was/is already discussed, haven’t found anything\nin a quick research.\n\n\n==Title==\nFast bootstrapping with a pre-generated UTXO-set database.\n\n==Abstract==\nThis documents describes a way how bitcoin nodes can bootstrap faster\nby loading a pre-generated UTXO-set datafile with moderate reduction\nof the security model.\n\n==Specification==\nBitcoin-core or any other full node client will need to provide a\nfeature to \"freeze\" the UTXO-set at a specified height (will require a\nreindex). The frozen UTXO-set – at a specific height – will be\ndeterministic linearized in a currently not specified\ndata-serializing-format.\nAdditionally, a serialized form of the current chain-index (chain\ncontaining all block-headers) up to the specified height will be\nappended to the pre-generated UTXO-set-datafile.\nThe datafile will be hashed with a double SHA256.\n\nThe corresponding hash will be produced/reproduced and signed (ECDSA)\nby a group of developers, ideally the same group of developers who are\nalso signing deterministic builds (binary distribution).\n\nFull node client implementations that supports bootstrapping from a\npre-generated UTXO-set, need to include...\n1.) a set of pubkeys from trusted developers\n2.) the hash (or hashes) of the pre-generated UTXO-set-datafile(s)\n3.) n signatures of the hash(es) from 2) from a subset of developers\ndefined in 1)\n\nTo guarantee the integrity of developers pubkeys \u0026 signatures, methods\nlike the current gitian build, used in bitcoin-core, must be used.\n\nNew nodes could download a copy of the pre-generated UTXO-set, hash\nit, verify the hash against the allowed UTXO-sets, verify the ECDSA\nsignatures from various developers, and continue bootstrapping from\nthe specified height if the users accepts the amount of valid signatures\n.\n\nSharing of the pre-generated UTXO-set can be done over CDNs,\nbit-torrent or any other file hosting solution. It would also be\npossible to extend the bitcoin p2p layer with features to\ndistribute/share a such pre-generated UTXO-set, in chunks and with the\naccording hashes to detect invalidity before downloading the whole\ncontent (but would probably end up in something very similar to\nbit-torrent).\n\n\n- ----------------------\n\u003c/jonas\u003e\n-----BEGIN PGP SIGNATURE-----\nVersion: GnuPG v2\n\niQIcBAEBCAAGBQJW1B1wAAoJECnUvLZBb1PsqzsP/iSdvyhUzy+BZVSZbKXNjk5P\n2vrtirI6NvKQd8hHbrcFeLfyswzYc2JWRnX8sATlauIS0pYdr97JriwUGlvxvNrY\niVTDdf8MIVu8zScLQtJbMatpMvsewtqQEidn/yxWIhiCg4G2T5DZmlBU6O4XIKR6\n5aPHElGOKZ15EWGHBG7z4owj3MiOaxhD9q5erBbfLPpcm08o6XAv5miqmGnnn3zh\ngocg4Gxs6iDygh3b2dCJFwWIVPxF6UVJhyjv2kLZUmEHT2Y2QvdGcLIIewcWHDze\nkgoZYmOEowujCbmeJ+LBwgOI0c1N6L/ciomPBne7ILmK4LyUEzyMLJKNYf/sZ8vI\nsVlmwZwZZLfILC7mzMAM0pfj99IOW680WHch9v31lWFlxW/bLvLqAO7n3acQuD6s\nxCZN2nAhmWC8FnMFxqB3EUz0lX8giV3qRJZjbQMS+ZrngYkAmVv2bAsoLndqf6MO\nl9W8B+ICg1KZLGIOF2pUrInpkB6gUALDFnypV4CeIVdeqtk5l4LnCHK6c4++Hl5n\nBv5HQ/wTgKKNFtHBEJpWyYWvAjfFtgUZUKblR+Bh+D7/Gte1ehiYd02KYD4ds9Y4\n3gfO8YbAz/I14Yuh2bIlvVKPWnLQBwL5BBioBfvmhV/r6rEpzWvB7H6Fmi1c759l\nVlL0GiUV8ar2LlFhEmWk\n=lZSy\n-----END PGP SIGNATURE-----",
"sig": "f5ef3ca314dd3f08ab9ae7e6010113d112c533efea3a3561777391d5e001d64c98093119e1e79fec7275551e68b6e0e9ab685738506bd22ea05bbed4dbba2e50"
}