📅 Original date posted:2022-05-09
📝 Original message:Thanks for taking the time to write up about the implementation of output descriptors on signing devices, and
for proposing a method to overcome encountered difficulties for the following implementers.
I have some questions with regard to the modifications to the descriptor language required to make the
registration flow reasonable on a signing device.
To sum up, starting from the currently spec'd output descriptors [0] you need:
1. The `<NUM;NUM>` optimization for the common usecase of using 2 descriptors at different derivation indices
for receive and change. [1]
2. The `/**` optimization for the common usecase of `/<0;1>` for point 1).
3. A new key expression `@i` referring to an index in a list of keys.
The first point was already discussed at great length [2]. Whether or not we agree using the derivation path
for change detection is a sane thing to do, most signing devices need to support this to not break
compatibility. I think the advantage boils down to not make the user write two almost-similar descriptors on
its backup, since it doesn't necessarily help readibility for human verification.
I'm not so sure about the second point. Is another deviation from the standard worth it just for saving 3
characters?
Disgressing, if we are to have a carve-out in the descriptor language for the common usecase of change/receive
keychains maybe your `/**` applies better than the proposed `/<NUM;NUM>` as the latter can open the door to
further carve-out requests.
For the third point, it does indeed seem unrealistic to check both the keys and the descriptor at the same
time. Even just because of the screen size (if the width an xpub is, what, 3 times the width of your screen,
by the time you finished verifying it you have forgotten the descriptor context in which this key was!). It
becomes harder as you get larger descriptors with Miniscript or Taproot, as you mentioned. Even the Miniscript
compiler at [3] supports key aliasing to workaround the inconvenience of long keys.
However, why does it need to be a change to the descriptor language? It looks a lot like something that needs
to be handled at the application level with key aliasing. The flow would be first to register known keys, and
then when registering a descriptor the keys would be replaced by their aliases for smoother verification. For
stateless devices, the registration of keys could use the same flow you described for descriptors.
In the end it's just replacing the vector and indices with a mapping and label, which make it a *much* better
UX (checking aliases vs looking up indices in a vector). For instance:
Key registration:
Alice: xpub6FLhTbeNidZkyC729yW6K6a5zuDxKUL8Q6oZm4XG2ov9PdxAyyDNEUm3jet8ENnvYsy6nCgsofN6FeVxakLDTdWGoxtmoYcu2exhqh9HjtV
Bob: xpub6CoUua86qHYdDmnQL7imGN3zUMpVjRT4uDtRxYvfFj2v8JRvsaaGtf9ggv9NiL8sx3rFh6po92WBChwb37gDGuuU2Qo7zi3ZKC9cLjAsdQw
Notary: xpub6DjUwtKmK7uqsd5p9w3eoJ4cjuML51nW85BTWuBaHEoxfmDGD3uPf6ZghsVeyuZUSuYEL4ajkVrfXzmotHHPtf6oBNYUQDSSBD4zUEiDoap
Descriptor registration (policy language for simpl.):
tr(NUMS,{
multi(2,Alice,Bob),
and(older(52560),and(Notary,Alice)),
and(older(52560),and(Notary,Bob))
})
In conclusion, if we were to have an optimization in the descriptor language for the common receive/change
usecase, i don't think you need another "wallet policy language" than the existing output descriptors language
with key aliasing/registration?
Unrelated question, since you mentioned `musig2` descriptors in this context. I thought Musig2 wasn't really
feasible for hardware signing devices, especially stateless ones. Do you think/know whether it is actually
possible for a HW to take part in a Musig2?
Thanks,
Antoine
[0] https://github.com/bitcoin/bips/blob/master/bip-0380.mediawiki
[1] https://github.com/bitcoin/bitcoin/pull/22838
[2] https://github.com/bitcoin/bitcoin/issues/17190
[3] https://bitcoin.sipa.be/miniscript/
------- Original Message -------
Le jeudi 5 mai 2022 à 4:32 PM, Salvatore Ingala via bitcoin-dev <bitcoin-dev at lists.linuxfoundation.org> a écrit :
> In the implementation work to implement descriptors and miniscript support in hardware wallets [a][b], I encountered a number of challenges. Some of them are technical in nature (e.g. due to constraints of embedded development). Others are related to the attempts of shaping a good user experience; with bitcoin reaching more people who are not tech-savvy, self-custody is only as secure as what those newcomers can use easily enough.
>
> The main tool that I am using to address some of these challenges is a layer that sits _on top_ of descriptors/miniscript, while staying very close to it. Since there is nothing that is vendor-specific in the vast majority of the approach I'm currently using, I tried to distill it here for your comments, and will propose a BIP if this is deemed valuable.
>
> I called the language "wallet policies" (suggestions for a better name are welcome). I believe an approach based on wallet policies can benefit all hardware wallets (stateless or not) that want to securely support complex scripts; moreover, wallet policies are close enough to descriptors that their integration should be extremely easy for any software wallet that is currently using descriptors.
>
> [a]: https://blog.ledger.com/bitcoin-2 - early demo[b]: https://blog.ledger.com/miniscript-is-coming - miniscript example
>
> Salvatore Ingala
>
> ======================================================
>
> This document starts with a discussion on the motivation for wallet policies, followed by their formal definition, and some recommendations for implementations.
> == Rationale ==
> Output script descriptors [1] were introduced in bitcoin-core as a way to represent collections of output scripts. It is a very general and flexible language, designed to catch all the possible use-cases of bitcoin wallets (that is, if you know the script and you have the necessary keys, it will be possible to sign transactions with bitcoin-core's descriptor-based wallets).
>
> Unfortunately, descriptors are not a perfect match for the typical usage of hardware wallets. Most hardware wallets have the following limitations compared to a general-purpose machine running bitcoin-core:
>
> - they are embedded devices with limited RAM and computational power;
> - they might not be able to import additional private keys (all the keys are generated from a single seed via [BIP-32](https://github.com/bitcoin/bips/blob/master/bip-0032.mediawiki));
> - they might not have permanent storage (*stateless* hardware wallet design).
>
> Moreover, other limitations like the limited size of the screen might affect what design choices are available in practice. Therefore, minimizing the size of the information shown on-screen is important for a good user experience.
>
> A more native, compact representation of the wallet receive/change would also benefit the UX of software wallets using descriptors to represent software wallets using descriptors/miniscript for multisignature or other complex locking conditions.
>
> === Security and UX concerns of scripts in hardware wallets ===
> For a hardware wallet, allowing the usage of complex scripts presents challenges in terms of both security and user experience.
>
> ==== Security issues ====
> One of the security properties that hardware wallets strive to guarantee is the following: **as long as the user correctly verifies the information that is shown on the hardware wallet's screen before approving, no action can be performed without the user's consent**.
> This must hold even in scenarios where the attacker has full control of the machine that is connected to the hardware wallet, and can execute arbitrary requests or tamper with the legitimate user's requests.
>
> Therefore, it is not at all trivial to allow complex scripts, especially if they contain keys that belong to third parties.
> The hardware wallet must guarantee that the user knows precisely *what* "policy" is being used to spend the funds, and that the "unspent" funds (if any) will be protected by the same policy. This makes it impossible for an attacker to surreptitiously modify the policy, therefore stealing or burning user's funds.
>
> ==== UX issues ====
> With miniscript (and taproot trees) allowing substantially more complex spending policies to be used, it becomes more challenging to make sure that the user is able _in practice_ to verify the information on the screen. Therefore, there are two fundamental design goals to strive for:
> - Minimize the amount of information that is shown on screen - so that the user can actually validate it.
> - Minimize the number of times the user has to validate such information.
>
> Designing a secure protocol for the coordination of a descriptor wallet among distant parties is also a challenging problem that is out of scope in this document. See BIP-129 [2] for an approach designed for multisignature wallets.
>
> === Policy registration as a solution ===
> A solution to address the security concerns, and part of the UX concerns, is to have a *registration* flow for the wallet policy in the hardware wallet. The "wallet policy" must contain enough information to generate all the relevant addresses/scripts, and for the hardware wallet to identify the keys that it controls and that are needed to spend the funds sent to those addresses.
>
> Before a new policy is used for the first time, the user will register a `wallet policy` into the hardware wallet. While the details of the process are out of scope in this document, the flow should be something similar to the following:
>
> 1) The software wallet initiates a _wallet policy registration_ on the hardware wallet; the information should include the wallet policy, but also a unique *name* that identifies the policy.
> 2) The hardware wallet shows the wallet policy to the user using the secure screen.
> 3) After inspecting the policy and comparing it with a trusted source (for example a printed backup), the user approves the policy.
> 4) If stateful, the hardware wallet persists the policy in its permanent memory; if stateless, it returns a "proof of registration".
>
> The details of how to create a proof of registration are out of scope for this document; using a *message authentication codes* on a hash committing to the wallet policy, its name and any additional metadata is an effective solution if correctly executed.
>
> Once a policy is registered, the hardware wallet can perform the usual operations securely:
> - generating receive and change addresses;
> - showing addresses on the secure screen;
> - sign transactions spending from a wallet, while correctly identifying change addresses and computing the transaction fees.
>
> Before any of the actions mentioned above, the hardware wallet will retrieve the policy from its permanent storage if stateful; if stateless it will validate the _proof of registration_ before using the wallet policy provided by the client.
> Once the previously registered policy is correctly identified and approved by the user (for example by its name), and *as long as the policy registration was executed securely*, hardware wallets can provide a user experience similar to the usual one for single-signature transactions.
>
> === Avoiding blowup in descriptor size ===
> While reusing a pubkey in different branches of a miniscript is explicitly forbidden by miniscript (as it has certain negative security implications), it is still reasonable to reuse the same *xpub* in multiple places, albeit with different final steps of derivation (so that the actual pubkeys that are used in the script are indeed different).
>
> For example, using Taproot, a *3*-of-*5* multisignature wallet could use:
> - a key path with a 5-of-5 MuSig
> - a script tree with a tree of 10 different 3-of-3 MuSig2 scripts, that are generated, plus a leaf with a fallback *3*-of-*5* multisignature using plain multisignature (with `OP_CHECKSIGADD`).
>
> This could look similar to:
>
> ```
> tr(musig2(xpubA,xpubB,xpubC,xpubD,xpubE)/<0;1>/*), {
> {
> {
> pk(musig2(xpubA,xpubB,xpubC)/<2;3>/*),
> {
> pk(musig2(xpubA,xpubB,xpubD)/<4;5>/*)
> pk(musig2(xpubA,xpubB,xpubE)/<6;7>/*),
> }
> },
> {
> pk(musig2(xpubA,xpubC,xpubD)/<8;9>/*),
> {
> pk(musig2(xpubA,xpubC,xpubE)/<10;11>/*),
> pk(musig2(xpubA,xpubD,xpubE)/<12;13>/*)
> }
> }
> },
> {
> {
> pk(musig2(xpubB,xpubC,xpubD)/<14;15>/*),
> pk(musig2(xpubB,xpubC,xpubE)/<16;17>/*)
> },
> {
> pk(musig2(xpubB,xpubD,xpubE)/<18;19>/*),
> {
> pk(musig2(xpubC,xpubD,xpubE)/<20;21>/*),
> sortedmulti_a(3,
> xpubA/<22;23>/*,
> xpubB/<22;23>/*,
> xpubC/<22;23>/*,
> xpubD/<22;23>/*,
> xpubE/<22;23>/*)
> }
> }
> }
> })
> ```
>
> Note that each root xpub appears 8 times. With xpubs being up to 118 bytes long, the length of the full descriptor can get extremely long (the problem gets *exponentially* worse with larger multisignature schemes).
>
> Replacing the common part of the key with a short key placeholder and moving the key expression separately helps to keep the size of the wallet policy small, which is crucial to allow human inspection in the registration flow.
>
> === Restrictions on the supported descriptors ====
>
> The policy language proposed in this document purposely targets only a stricter subset of the output descriptors language, and it attempts to generalize in the most natural way the approach that is already used for single-signature *accounts* (as described in BIP-44 [3], BIP-49 [4], BIP-84 [5], or BIP-86 [6]), or in multisignature setups (see for example BIP-48 [7] and BIP-87 [8]).
> Unlike the BIPs mentioned above, it is not tied to any specific script template, as it applies to arbitrary scripts that can be represented with descriptors and miniscript.
>
> Supporting only a reduced feature set when compared to output descriptors helps in implementations (especially on hardware wallets), while attempting to capture all the common use cases. More features can be added in the future if motivated by real world necessity.
>
> By keeping the structure of the wallet policy language very close to that of descriptors, it should be straightforward to:
> - write wallet policy parsers;
> - extract the descriptors defined by a wallet policy;
> - convert a pair of descriptors describing a wallet "account" used in current implementations into the corresponding wallet policy.
>
>
> == Wallet policies ==
> This section formally defines wallet policies, and how they relate to output script descriptors.
> === Formal definition ===
> A wallet policy is composed by a wallet descriptor template, together with a vector of key information items.
>
> ==== Wallet descriptor template ====
>
> A wallet descriptor template is a `SCRIPT` expression.
>
> `SCRIPT` expressions:
> - `sh(SCRIPT)` (top level only): P2SH embed the argument.
> - `wsh(SCRIPT)` (top level or inside `sh` only): P2WSH embed the argument.
> - `pkh(KP)` (not inside `tr`): P2PKH output for the given public key (use `addr` if you only know the pubkey hash).
> - `wpkh(KP)` (top level or inside `sh` only): P2WPKH output for the given compressed pubkey.
> - `multi(k,KP_1,KP_2,...,KP_n)`: k-of-n multisig script.
> - `sortedmulti(k,KP_1,KP_2,...,KP_n)`: k-of-n multisig script with keys sorted lexicographically in the resulting script.
> - `tr(KP)` or `tr(KP,TREE)` (top level only): P2TR output with the specified key as internal key, and optionally a tree of script paths.- any valid miniscript template (inside `wsh` or `tr` only).
> `TREE` expressions:
> - any `SCRIPT` expression
> - An open brace `{`, a `TREE` expression, a comma `,`, a `TREE` expression, and a closing brace `}`
>
> Note: "miniscript templates" are not formally defined in this version of the document, but it is straightforward to adapt this approach.
>
> `KP` expressions (key placeholders) consist of
> - a single character `@`
> - followed by a non-negative decimal number, with no leading zeros (except for `@0`).
> - possibly followed by either:
> - the string `/**`, or
> - a string of the form `/<NUM;NUM>/*`, for two distinct decimal numbers `NUM` representing unhardened derivations
>
> The `/**` in the placeholder template represents commonly used paths for receive/change addresses, and is equivalent to `<0;1>`.
>
> The placeholder `@i` for some number *i* represents the *i*-th key in the vector of key origin information (which must be of size at least *i* + 1, or the wallet policy is invalid).
>
> ==== Key informations vector ====
>
> Each element of the key origin information vector is a `KEY` expression.
>
> - Optionally, key origin information, consisting of:
> - An open bracket `[`
> - Exactly 8 hex characters for the fingerprint of the master key from which this key is derived from (see [BIP32](https://github.com/bitcoin/bips/blob/master/bip-0032.mediawiki) for details)
> - Followed by zero or more `/NUM'` path elements to indicate hardened derivation steps between the fingerprint and the xpub that follows
> - A closing bracket `]`
> - Followed by the actual key, which is either
> - a hex-encoded pubkey, which is either
> - inside `wpkh` and `wsh`, only compressed public keys are permitted (exactly 66 hex characters starting with `02` or `03`.
> - inside `tr`, x-only pubkeys are also permitted (exactly 64 hex characters).
> - a serialized extended public key (`xpub`) (as defined in [BIP 32](https://github.com/bitcoin/bips/blob/master/bip-0032.mediawiki))
>
> The placeholder `@i` for some number *i* represents the *i*-th key in the vector of key orIgin information (which must be of size at least *i* + 1, or the wallet policy is invalid).
>
> The policy template is invalid if any placeholder `@i` has derivation steps while the corresponding `(i+1)`-th element of the keys vector is not an xpub.
>
> ==== Additional rules ====
> The wallet policy is invalid if any placeholder expression with additional derivation steps is used when the corresponding key information is not an xpub.
>
> The key information vector *should* be ordered so that placeholder `@i` never appear for the first time before an occurrence of `@j` for some `j < i`; for example, the first placeholder is always `@0`, the next one is `@1`, etc.
>
> === Descriptor derivation ===
> From a wallet descriptor template (and the associated vector of key informations), one can therefore obtain the 1-dimensional descriptor for receive and change addresses by:
>
> - replacing each key placeholder with the corresponding key origin information;
> - replacing every `/**` with `/0/*` for the receive descriptor, and `/1/*` for the change descriptor;
> - replacing every `/<M,N>` with `/M` for the receive descriptor, and `/N` for the change descriptor.
>
> For example, the wallet descriptor `pkh(@0/**)` with key information `["[d34db33f/44'/0'/0']xpub6ERApfZwUNrhLCkDtcHTcxd75RbzS1ed54G1LkBUHQVHQKqhMkhgbmJbZRkrgZw4koxb5JaHWkY4ALHY2grBGRjaDMzQLcgJvLJuZZvRcEL"]` produces the following two descriptors:
>
> - Receive descriptor: `pkh([d34db33f/44'/0'/0']xpub6ERApfZwUNrhLCkDtcHTcxd75RbzS1ed54G1LkBUHQVHQKqhMkhgbmJbZRkrgZw4koxb5JaHWkY4ALHY2grBGRjaDMzQLcgJvLJuZZvRcEL/0/*)`
>
> - Change descriptor: `pkh([d34db33f/44'/0'/0']xpub6ERApfZwUNrhLCkDtcHTcxd75RbzS1ed54G1LkBUHQVHQKqhMkhgbmJbZRkrgZw4koxb5JaHWkY4ALHY2grBGRjaDMzQLcgJvLJuZZvRcEL/1/*)`
>
> === Implementation guidelines ===
> Implementations must not necessarily implement all of the possible wallet policies defined by this standard, but it is recommended to clearly document any limitation.
>
> Implementations can add additional metadata that is stored together with the wallet policy for the purpose of wallet policy registration and later usage. Metadata can be vendor-specific and is out of the scope of this document.
>
> Any implementation in a general-purpose software wallet allowing arbitrary scripts (or any scripts that involve external cosigners) should put great care into a process for backing up a wallet policy. In fact, unlike typical single-signature scenarios, the seed alone is no longer enough to discover wallet policies with existing funds, and the loss of the backup is likely to lead to permanent loss of funds.
>
> Avoiding key reuse among different wallet accounts is also extremely important, but out of scope for this document.
>
> == Examples ==
>
> Some examples of wallet descriptor templates (vectors of keys omitted for simplicity):- Template for a native segwit account:wpkh(@0/**)
> - Template for a taproot BIP86 account:tr(@0/**)
> - Template for a native segwit 2-of-3:wsh(sortedmulti(2, at 0/**, at 1/**, at 2/**))- Template with miniscript for "1 of 2 equally likely keys":wsh(or_b(pk(@0/**),s:pk(@1/**)))
> More examples (esp. targeting miniscript on taproot) will be added in the future.
> == References ==
>
> * [1] - Output Script Descriptors: https://github.com/bitcoin/bitcoin/blob/master/doc/descriptors.md* [2] - BIP-129 (Bitcoin Secure Multisig Setup): https://github.com/bitcoin/bips/blob/master/bip-0129.mediawiki
> * [3] - BIP-44: https://github.com/bitcoin/bips/blob/master/bip-0044.mediawiki* [4] - BIP-49: https://github.com/bitcoin/bips/blob/master/bip-0049.mediawiki* [5] - BIP-84: https://github.com/bitcoin/bips/blob/master/bip-0084.mediawiki* [6] - BIP-86: https://github.com/bitcoin/bips/blob/master/bip-0086.mediawiki* [7] - BIP-48: https://github.com/bitcoin/bips/blob/master/bip-0048.mediawiki* [8] - BIP-87: https://github.com/bitcoin/bips/blob/master/bip-0087.mediawiki
darosior [ARCHIVE] /
npub1pj…x22xp
2023-06-07 23:09:11
in reply to nevent1q…35v6
Author Public Key
npub1pj9022f74rzq7d5x7gnxje6wpsgk4r5jgeck8y5awd423ydhan3q7x22xpPublished at
2023-06-07 23:09:11Event JSON
{
"id": "71a535725f179afd8aa4427bad13abebba45b6a31fe9bf8d9f46fc53b69469ff",
"pubkey": "0c8af5293ea8c40f3686f22669674e0c116a8e92467163929d736aa891b7ece2",
"created_at": 1686179351,
"kind": 1,
"tags": [
[
"e",
"db7ccea543dd977868d151bef46063e17bb777435bd25b8f376e5267b6025893",
"",
"root"
],
[
"e",
"6a4f98ca37acc99b7e107c4a332ee14548a59c4788dd46b14936281d229183f3",
"",
"reply"
],
[
"p",
"3030ec2d70259fdd55ba8e063740c139c3daaa618f86e3fae34cebcb73c742ba"
]
],
"content": "📅 Original date posted:2022-05-09\n📝 Original message:Thanks for taking the time to write up about the implementation of output descriptors on signing devices, and\nfor proposing a method to overcome encountered difficulties for the following implementers.\n\nI have some questions with regard to the modifications to the descriptor language required to make the\nregistration flow reasonable on a signing device.\n\nTo sum up, starting from the currently spec'd output descriptors [0] you need:\n1. The `\u003cNUM;NUM\u003e` optimization for the common usecase of using 2 descriptors at different derivation indices\n for receive and change. [1]\n2. The `/**` optimization for the common usecase of `/\u003c0;1\u003e` for point 1).\n3. A new key expression `@i` referring to an index in a list of keys.\n\nThe first point was already discussed at great length [2]. Whether or not we agree using the derivation path\nfor change detection is a sane thing to do, most signing devices need to support this to not break\ncompatibility. I think the advantage boils down to not make the user write two almost-similar descriptors on\nits backup, since it doesn't necessarily help readibility for human verification.\n\nI'm not so sure about the second point. Is another deviation from the standard worth it just for saving 3\ncharacters?\nDisgressing, if we are to have a carve-out in the descriptor language for the common usecase of change/receive\nkeychains maybe your `/**` applies better than the proposed `/\u003cNUM;NUM\u003e` as the latter can open the door to\nfurther carve-out requests.\n\nFor the third point, it does indeed seem unrealistic to check both the keys and the descriptor at the same\ntime. Even just because of the screen size (if the width an xpub is, what, 3 times the width of your screen,\nby the time you finished verifying it you have forgotten the descriptor context in which this key was!). It\nbecomes harder as you get larger descriptors with Miniscript or Taproot, as you mentioned. Even the Miniscript\ncompiler at [3] supports key aliasing to workaround the inconvenience of long keys.\nHowever, why does it need to be a change to the descriptor language? It looks a lot like something that needs\nto be handled at the application level with key aliasing. The flow would be first to register known keys, and\nthen when registering a descriptor the keys would be replaced by their aliases for smoother verification. For\nstateless devices, the registration of keys could use the same flow you described for descriptors.\nIn the end it's just replacing the vector and indices with a mapping and label, which make it a *much* better\nUX (checking aliases vs looking up indices in a vector). For instance:\n Key registration:\n Alice: xpub6FLhTbeNidZkyC729yW6K6a5zuDxKUL8Q6oZm4XG2ov9PdxAyyDNEUm3jet8ENnvYsy6nCgsofN6FeVxakLDTdWGoxtmoYcu2exhqh9HjtV\n Bob: xpub6CoUua86qHYdDmnQL7imGN3zUMpVjRT4uDtRxYvfFj2v8JRvsaaGtf9ggv9NiL8sx3rFh6po92WBChwb37gDGuuU2Qo7zi3ZKC9cLjAsdQw\n Notary: xpub6DjUwtKmK7uqsd5p9w3eoJ4cjuML51nW85BTWuBaHEoxfmDGD3uPf6ZghsVeyuZUSuYEL4ajkVrfXzmotHHPtf6oBNYUQDSSBD4zUEiDoap\n\n Descriptor registration (policy language for simpl.):\n tr(NUMS,{\n multi(2,Alice,Bob),\n and(older(52560),and(Notary,Alice)),\n and(older(52560),and(Notary,Bob))\n })\n\nIn conclusion, if we were to have an optimization in the descriptor language for the common receive/change\nusecase, i don't think you need another \"wallet policy language\" than the existing output descriptors language\nwith key aliasing/registration?\n\n\nUnrelated question, since you mentioned `musig2` descriptors in this context. I thought Musig2 wasn't really\nfeasible for hardware signing devices, especially stateless ones. Do you think/know whether it is actually\npossible for a HW to take part in a Musig2?\n\n\nThanks,\nAntoine\n\n[0] https://github.com/bitcoin/bips/blob/master/bip-0380.mediawiki\n[1] https://github.com/bitcoin/bitcoin/pull/22838\n[2] https://github.com/bitcoin/bitcoin/issues/17190\n[3] https://bitcoin.sipa.be/miniscript/\n\n\n------- Original Message -------\nLe jeudi 5 mai 2022 à 4:32 PM, Salvatore Ingala via bitcoin-dev \u003cbitcoin-dev at lists.linuxfoundation.org\u003e a écrit :\n\n\n\u003e In the implementation work to implement descriptors and miniscript support in hardware wallets [a][b], I encountered a number of challenges. Some of them are technical in nature (e.g. due to constraints of embedded development). Others are related to the attempts of shaping a good user experience; with bitcoin reaching more people who are not tech-savvy, self-custody is only as secure as what those newcomers can use easily enough.\n\u003e\n\u003e The main tool that I am using to address some of these challenges is a layer that sits _on top_ of descriptors/miniscript, while staying very close to it. Since there is nothing that is vendor-specific in the vast majority of the approach I'm currently using, I tried to distill it here for your comments, and will propose a BIP if this is deemed valuable.\n\u003e\n\u003e I called the language \"wallet policies\" (suggestions for a better name are welcome). I believe an approach based on wallet policies can benefit all hardware wallets (stateless or not) that want to securely support complex scripts; moreover, wallet policies are close enough to descriptors that their integration should be extremely easy for any software wallet that is currently using descriptors.\n\u003e\n\u003e [a]: https://blog.ledger.com/bitcoin-2 - early demo[b]: https://blog.ledger.com/miniscript-is-coming - miniscript example\n\u003e\n\u003e Salvatore Ingala\n\u003e\n\u003e ======================================================\n\u003e\n\u003e This document starts with a discussion on the motivation for wallet policies, followed by their formal definition, and some recommendations for implementations.\n\u003e == Rationale ==\n\u003e Output script descriptors [1] were introduced in bitcoin-core as a way to represent collections of output scripts. It is a very general and flexible language, designed to catch all the possible use-cases of bitcoin wallets (that is, if you know the script and you have the necessary keys, it will be possible to sign transactions with bitcoin-core's descriptor-based wallets).\n\u003e\n\u003e Unfortunately, descriptors are not a perfect match for the typical usage of hardware wallets. Most hardware wallets have the following limitations compared to a general-purpose machine running bitcoin-core:\n\u003e\n\u003e - they are embedded devices with limited RAM and computational power;\n\u003e - they might not be able to import additional private keys (all the keys are generated from a single seed via [BIP-32](https://github.com/bitcoin/bips/blob/master/bip-0032.mediawiki));\n\u003e - they might not have permanent storage (*stateless* hardware wallet design).\n\u003e\n\u003e Moreover, other limitations like the limited size of the screen might affect what design choices are available in practice. Therefore, minimizing the size of the information shown on-screen is important for a good user experience.\n\u003e\n\u003e A more native, compact representation of the wallet receive/change would also benefit the UX of software wallets using descriptors to represent software wallets using descriptors/miniscript for multisignature or other complex locking conditions.\n\u003e\n\u003e === Security and UX concerns of scripts in hardware wallets ===\n\u003e For a hardware wallet, allowing the usage of complex scripts presents challenges in terms of both security and user experience.\n\u003e\n\u003e ==== Security issues ====\n\u003e One of the security properties that hardware wallets strive to guarantee is the following: **as long as the user correctly verifies the information that is shown on the hardware wallet's screen before approving, no action can be performed without the user's consent**.\n\u003e This must hold even in scenarios where the attacker has full control of the machine that is connected to the hardware wallet, and can execute arbitrary requests or tamper with the legitimate user's requests.\n\u003e\n\u003e Therefore, it is not at all trivial to allow complex scripts, especially if they contain keys that belong to third parties.\n\u003e The hardware wallet must guarantee that the user knows precisely *what* \"policy\" is being used to spend the funds, and that the \"unspent\" funds (if any) will be protected by the same policy. This makes it impossible for an attacker to surreptitiously modify the policy, therefore stealing or burning user's funds.\n\u003e\n\u003e ==== UX issues ====\n\u003e With miniscript (and taproot trees) allowing substantially more complex spending policies to be used, it becomes more challenging to make sure that the user is able _in practice_ to verify the information on the screen. Therefore, there are two fundamental design goals to strive for:\n\u003e - Minimize the amount of information that is shown on screen - so that the user can actually validate it.\n\u003e - Minimize the number of times the user has to validate such information.\n\u003e\n\u003e Designing a secure protocol for the coordination of a descriptor wallet among distant parties is also a challenging problem that is out of scope in this document. See BIP-129 [2] for an approach designed for multisignature wallets.\n\u003e\n\u003e === Policy registration as a solution ===\n\u003e A solution to address the security concerns, and part of the UX concerns, is to have a *registration* flow for the wallet policy in the hardware wallet. The \"wallet policy\" must contain enough information to generate all the relevant addresses/scripts, and for the hardware wallet to identify the keys that it controls and that are needed to spend the funds sent to those addresses.\n\u003e\n\u003e Before a new policy is used for the first time, the user will register a `wallet policy` into the hardware wallet. While the details of the process are out of scope in this document, the flow should be something similar to the following:\n\u003e\n\u003e 1) The software wallet initiates a _wallet policy registration_ on the hardware wallet; the information should include the wallet policy, but also a unique *name* that identifies the policy.\n\u003e 2) The hardware wallet shows the wallet policy to the user using the secure screen.\n\u003e 3) After inspecting the policy and comparing it with a trusted source (for example a printed backup), the user approves the policy.\n\u003e 4) If stateful, the hardware wallet persists the policy in its permanent memory; if stateless, it returns a \"proof of registration\".\n\u003e\n\u003e The details of how to create a proof of registration are out of scope for this document; using a *message authentication codes* on a hash committing to the wallet policy, its name and any additional metadata is an effective solution if correctly executed.\n\u003e\n\u003e Once a policy is registered, the hardware wallet can perform the usual operations securely:\n\u003e - generating receive and change addresses;\n\u003e - showing addresses on the secure screen;\n\u003e - sign transactions spending from a wallet, while correctly identifying change addresses and computing the transaction fees.\n\u003e\n\u003e Before any of the actions mentioned above, the hardware wallet will retrieve the policy from its permanent storage if stateful; if stateless it will validate the _proof of registration_ before using the wallet policy provided by the client.\n\u003e Once the previously registered policy is correctly identified and approved by the user (for example by its name), and *as long as the policy registration was executed securely*, hardware wallets can provide a user experience similar to the usual one for single-signature transactions.\n\u003e\n\u003e === Avoiding blowup in descriptor size ===\n\u003e While reusing a pubkey in different branches of a miniscript is explicitly forbidden by miniscript (as it has certain negative security implications), it is still reasonable to reuse the same *xpub* in multiple places, albeit with different final steps of derivation (so that the actual pubkeys that are used in the script are indeed different).\n\u003e\n\u003e For example, using Taproot, a *3*-of-*5* multisignature wallet could use:\n\u003e - a key path with a 5-of-5 MuSig\n\u003e - a script tree with a tree of 10 different 3-of-3 MuSig2 scripts, that are generated, plus a leaf with a fallback *3*-of-*5* multisignature using plain multisignature (with `OP_CHECKSIGADD`).\n\u003e\n\u003e This could look similar to:\n\u003e\n\u003e ```\n\u003e tr(musig2(xpubA,xpubB,xpubC,xpubD,xpubE)/\u003c0;1\u003e/*), {\n\u003e {\n\u003e {\n\u003e pk(musig2(xpubA,xpubB,xpubC)/\u003c2;3\u003e/*),\n\u003e {\n\u003e pk(musig2(xpubA,xpubB,xpubD)/\u003c4;5\u003e/*)\n\u003e pk(musig2(xpubA,xpubB,xpubE)/\u003c6;7\u003e/*),\n\u003e }\n\u003e },\n\u003e {\n\u003e pk(musig2(xpubA,xpubC,xpubD)/\u003c8;9\u003e/*),\n\u003e {\n\u003e pk(musig2(xpubA,xpubC,xpubE)/\u003c10;11\u003e/*),\n\u003e pk(musig2(xpubA,xpubD,xpubE)/\u003c12;13\u003e/*)\n\u003e }\n\u003e }\n\u003e },\n\u003e {\n\u003e {\n\u003e pk(musig2(xpubB,xpubC,xpubD)/\u003c14;15\u003e/*),\n\u003e pk(musig2(xpubB,xpubC,xpubE)/\u003c16;17\u003e/*)\n\u003e },\n\u003e {\n\u003e pk(musig2(xpubB,xpubD,xpubE)/\u003c18;19\u003e/*),\n\u003e {\n\u003e pk(musig2(xpubC,xpubD,xpubE)/\u003c20;21\u003e/*),\n\u003e sortedmulti_a(3,\n\u003e xpubA/\u003c22;23\u003e/*,\n\u003e xpubB/\u003c22;23\u003e/*,\n\u003e xpubC/\u003c22;23\u003e/*,\n\u003e xpubD/\u003c22;23\u003e/*,\n\u003e xpubE/\u003c22;23\u003e/*)\n\u003e }\n\u003e }\n\u003e }\n\u003e })\n\u003e ```\n\u003e\n\u003e Note that each root xpub appears 8 times. With xpubs being up to 118 bytes long, the length of the full descriptor can get extremely long (the problem gets *exponentially* worse with larger multisignature schemes).\n\u003e\n\u003e Replacing the common part of the key with a short key placeholder and moving the key expression separately helps to keep the size of the wallet policy small, which is crucial to allow human inspection in the registration flow.\n\u003e\n\u003e === Restrictions on the supported descriptors ====\n\u003e\n\u003e The policy language proposed in this document purposely targets only a stricter subset of the output descriptors language, and it attempts to generalize in the most natural way the approach that is already used for single-signature *accounts* (as described in BIP-44 [3], BIP-49 [4], BIP-84 [5], or BIP-86 [6]), or in multisignature setups (see for example BIP-48 [7] and BIP-87 [8]).\n\u003e Unlike the BIPs mentioned above, it is not tied to any specific script template, as it applies to arbitrary scripts that can be represented with descriptors and miniscript.\n\u003e\n\u003e Supporting only a reduced feature set when compared to output descriptors helps in implementations (especially on hardware wallets), while attempting to capture all the common use cases. More features can be added in the future if motivated by real world necessity.\n\u003e\n\u003e By keeping the structure of the wallet policy language very close to that of descriptors, it should be straightforward to:\n\u003e - write wallet policy parsers;\n\u003e - extract the descriptors defined by a wallet policy;\n\u003e - convert a pair of descriptors describing a wallet \"account\" used in current implementations into the corresponding wallet policy.\n\u003e\n\u003e\n\u003e == Wallet policies ==\n\u003e This section formally defines wallet policies, and how they relate to output script descriptors.\n\u003e === Formal definition ===\n\u003e A wallet policy is composed by a wallet descriptor template, together with a vector of key information items.\n\u003e\n\u003e ==== Wallet descriptor template ====\n\u003e\n\u003e A wallet descriptor template is a `SCRIPT` expression.\n\u003e\n\u003e `SCRIPT` expressions:\n\u003e - `sh(SCRIPT)` (top level only): P2SH embed the argument.\n\u003e - `wsh(SCRIPT)` (top level or inside `sh` only): P2WSH embed the argument.\n\u003e - `pkh(KP)` (not inside `tr`): P2PKH output for the given public key (use `addr` if you only know the pubkey hash).\n\u003e - `wpkh(KP)` (top level or inside `sh` only): P2WPKH output for the given compressed pubkey.\n\u003e - `multi(k,KP_1,KP_2,...,KP_n)`: k-of-n multisig script.\n\u003e - `sortedmulti(k,KP_1,KP_2,...,KP_n)`: k-of-n multisig script with keys sorted lexicographically in the resulting script.\n\u003e - `tr(KP)` or `tr(KP,TREE)` (top level only): P2TR output with the specified key as internal key, and optionally a tree of script paths.- any valid miniscript template (inside `wsh` or `tr` only).\n\u003e `TREE` expressions:\n\u003e - any `SCRIPT` expression\n\u003e - An open brace `{`, a `TREE` expression, a comma `,`, a `TREE` expression, and a closing brace `}`\n\u003e\n\u003e Note: \"miniscript templates\" are not formally defined in this version of the document, but it is straightforward to adapt this approach.\n\u003e\n\u003e `KP` expressions (key placeholders) consist of\n\u003e - a single character `@`\n\u003e - followed by a non-negative decimal number, with no leading zeros (except for `@0`).\n\u003e - possibly followed by either:\n\u003e - the string `/**`, or\n\u003e - a string of the form `/\u003cNUM;NUM\u003e/*`, for two distinct decimal numbers `NUM` representing unhardened derivations\n\u003e\n\u003e The `/**` in the placeholder template represents commonly used paths for receive/change addresses, and is equivalent to `\u003c0;1\u003e`.\n\u003e\n\u003e The placeholder `@i` for some number *i* represents the *i*-th key in the vector of key origin information (which must be of size at least *i* + 1, or the wallet policy is invalid).\n\u003e\n\u003e ==== Key informations vector ====\n\u003e\n\u003e Each element of the key origin information vector is a `KEY` expression.\n\u003e\n\u003e - Optionally, key origin information, consisting of:\n\u003e - An open bracket `[`\n\u003e - Exactly 8 hex characters for the fingerprint of the master key from which this key is derived from (see [BIP32](https://github.com/bitcoin/bips/blob/master/bip-0032.mediawiki) for details)\n\u003e - Followed by zero or more `/NUM'` path elements to indicate hardened derivation steps between the fingerprint and the xpub that follows\n\u003e - A closing bracket `]`\n\u003e - Followed by the actual key, which is either\n\u003e - a hex-encoded pubkey, which is either\n\u003e - inside `wpkh` and `wsh`, only compressed public keys are permitted (exactly 66 hex characters starting with `02` or `03`.\n\u003e - inside `tr`, x-only pubkeys are also permitted (exactly 64 hex characters).\n\u003e - a serialized extended public key (`xpub`) (as defined in [BIP 32](https://github.com/bitcoin/bips/blob/master/bip-0032.mediawiki))\n\u003e\n\u003e The placeholder `@i` for some number *i* represents the *i*-th key in the vector of key orIgin information (which must be of size at least *i* + 1, or the wallet policy is invalid).\n\u003e\n\u003e The policy template is invalid if any placeholder `@i` has derivation steps while the corresponding `(i+1)`-th element of the keys vector is not an xpub.\n\u003e\n\u003e ==== Additional rules ====\n\u003e The wallet policy is invalid if any placeholder expression with additional derivation steps is used when the corresponding key information is not an xpub.\n\u003e\n\u003e The key information vector *should* be ordered so that placeholder `@i` never appear for the first time before an occurrence of `@j` for some `j \u003c i`; for example, the first placeholder is always `@0`, the next one is `@1`, etc.\n\u003e\n\u003e === Descriptor derivation ===\n\u003e From a wallet descriptor template (and the associated vector of key informations), one can therefore obtain the 1-dimensional descriptor for receive and change addresses by:\n\u003e\n\u003e - replacing each key placeholder with the corresponding key origin information;\n\u003e - replacing every `/**` with `/0/*` for the receive descriptor, and `/1/*` for the change descriptor;\n\u003e - replacing every `/\u003cM,N\u003e` with `/M` for the receive descriptor, and `/N` for the change descriptor.\n\u003e\n\u003e For example, the wallet descriptor `pkh(@0/**)` with key information `[\"[d34db33f/44'/0'/0']xpub6ERApfZwUNrhLCkDtcHTcxd75RbzS1ed54G1LkBUHQVHQKqhMkhgbmJbZRkrgZw4koxb5JaHWkY4ALHY2grBGRjaDMzQLcgJvLJuZZvRcEL\"]` produces the following two descriptors:\n\u003e\n\u003e - Receive descriptor: `pkh([d34db33f/44'/0'/0']xpub6ERApfZwUNrhLCkDtcHTcxd75RbzS1ed54G1LkBUHQVHQKqhMkhgbmJbZRkrgZw4koxb5JaHWkY4ALHY2grBGRjaDMzQLcgJvLJuZZvRcEL/0/*)`\n\u003e\n\u003e - Change descriptor: `pkh([d34db33f/44'/0'/0']xpub6ERApfZwUNrhLCkDtcHTcxd75RbzS1ed54G1LkBUHQVHQKqhMkhgbmJbZRkrgZw4koxb5JaHWkY4ALHY2grBGRjaDMzQLcgJvLJuZZvRcEL/1/*)`\n\u003e\n\u003e === Implementation guidelines ===\n\u003e Implementations must not necessarily implement all of the possible wallet policies defined by this standard, but it is recommended to clearly document any limitation.\n\u003e\n\u003e Implementations can add additional metadata that is stored together with the wallet policy for the purpose of wallet policy registration and later usage. Metadata can be vendor-specific and is out of the scope of this document.\n\u003e\n\u003e Any implementation in a general-purpose software wallet allowing arbitrary scripts (or any scripts that involve external cosigners) should put great care into a process for backing up a wallet policy. In fact, unlike typical single-signature scenarios, the seed alone is no longer enough to discover wallet policies with existing funds, and the loss of the backup is likely to lead to permanent loss of funds.\n\u003e\n\u003e Avoiding key reuse among different wallet accounts is also extremely important, but out of scope for this document.\n\u003e\n\u003e == Examples ==\n\u003e\n\u003e Some examples of wallet descriptor templates (vectors of keys omitted for simplicity):- Template for a native segwit account:wpkh(@0/**)\n\u003e - Template for a taproot BIP86 account:tr(@0/**)\n\u003e - Template for a native segwit 2-of-3:wsh(sortedmulti(2, at 0/**, at 1/**, at 2/**))- Template with miniscript for \"1 of 2 equally likely keys\":wsh(or_b(pk(@0/**),s:pk(@1/**)))\n\u003e More examples (esp. targeting miniscript on taproot) will be added in the future.\n\u003e == References ==\n\u003e\n\u003e * [1] - Output Script Descriptors: https://github.com/bitcoin/bitcoin/blob/master/doc/descriptors.md* [2] - BIP-129 (Bitcoin Secure Multisig Setup): https://github.com/bitcoin/bips/blob/master/bip-0129.mediawiki\n\u003e * [3] - BIP-44: https://github.com/bitcoin/bips/blob/master/bip-0044.mediawiki* [4] - BIP-49: https://github.com/bitcoin/bips/blob/master/bip-0049.mediawiki* [5] - BIP-84: https://github.com/bitcoin/bips/blob/master/bip-0084.mediawiki* [6] - BIP-86: https://github.com/bitcoin/bips/blob/master/bip-0086.mediawiki* [7] - BIP-48: https://github.com/bitcoin/bips/blob/master/bip-0048.mediawiki* [8] - BIP-87: https://github.com/bitcoin/bips/blob/master/bip-0087.mediawiki",
"sig": "e2bfeb8412d36d36f920dc83dbc6eb4e7b42cc8e75a58378ce1bb9e63baacbe252e46028c0acba6f11bca51ef491b70a3a3c3a9bf3285a07698646e2b35ccb29"
}