Demystifying Aggregatable Distributed Key Generation
A novel component of Anoma is a Distributed Key Generation (DKG) scheme. George Gkitsas describes the concepts in DKG, starting with simple constructions, building up to the aggregatable DKG.
Many cryptographic applications currently require a trusted third party to generate and/or hold secrets. This party constitutes a single point of failure - it can be DoS-ed, breached or not operate in an honest manner. Removing the need for a trusted third party results in a more robust and trustworthy system.
Let's first specify the problem in more technical terms. We consider a node of a system a 'single point of failure' (SPOF) when at least one of the following is true:
- the operation of the whole system fails if that node becomes unavailable (caused either internally or by an adversary)
- the node has full access to the secret even for a single point in time
- misbehaving of the node can make the system deliver incorrect results
Distributed Key Generation (DKG) allows a group of parties to generate and store a shared key, while preventing any single party from having access to that key at any point in time. Instead, each party holds a piece of information called a ‘key share’. The common secret might be used in either symmetric or asymmetric encryption, and in the latter case it has a public key counterpart.
In order to execute a cryptographic operation such as decryption or signing, a quorum of a minimum size above a threshold must be assembled and each party of the quorum must participate in the process using their key share. More specifically, each party of the quorum uses their share to produce a partial result of the cryptographic operation. The partial results are then sent to a node that combines them to produce the final result of the operation. Note that this node doesn't acquire any knowledge of the key shares or the secret. Cryptographic algorithms that work in such a setup belong to the domain of threshold cryptography.
For example, assume a sender and a receiver, with the sender wishing to send encrypted data to the receiver and the receiver not to be trusted with the secret key. A group of parties that share the secret is used on the receiver's side. The sender will use the group's public key to encrypt the data and send it over to the receiver. Upon receipt, the receiver will send the encrypted data to the group's parties requesting a decryption. Each party (decryption server) will perform an operation on the encrypted data using its share and the result (decryption share) will be sent back to the receiver. The receiver will check the validity of each received decryption share in turn. The receiver can fully decrypt the encrypted data when it collects a number of valid decryption shares that exceeds the threshold value.
The above works similarly for signing. The parties will be the signing servers and each one will produce a signature share that will be sent to a server for validation. Once that server collects an amount of valid signature shares that exceeds the threshold, it is able to compile the group signature on the data. The signature can be verified by any third party using the group's public key.
This post starts by explaining simpler constructions and builds up to the Aggregatable DKG construction.
― George Orwell, 1984
We start with the problem of storing a common secret without having a SPOF. The secret needs to be held by the parties in the form of shares and it shouldn't be possible to disclose the secret unless a quorum is assembled. Secret sharing schemes offer exactly that and are the basis of DKG constructions. We will focus on Shamir’s Secret Sharing (SSS).
SSS makes use of the property that a polynomial of degree can be uniquely reconstructed by any set of points using the Lagrange interpolation. SSS works as follows. Assume there exist parties and the threshold is set at :
- A ‘dealer’ generates a secret and constructs a random polynomial in , of degree and with its constant term set to the secret value .
- The dealer then calculates shares .
- The shares are privately ‘dealt’ to the parties (sharing phase).
- From this point and after, any parties (and no less) can use their shares to reconstruct the polynomial and thus reveal the secret (reconstruction phase).
SSS is depicted in the following figure.
In SSS, we trust the dealer to be honest. A dealer is honest when it deals shares that are consistent, ie. shares that are generated using the same polynomial. If the shares are not generated by the same polynomial, then different quorums composed of different parties will reconstruct different secret values. Here the dealer is able to force the system to operate in an inconsistent manner and thus poses a SPOF. Omitting our trust that the dealer is honest forces us to use a share validation mechanism.
A Verifiable Secret Sharing (VSS) scheme protects against such a malicious dealer by enabling parties to verify the shares’ consistency and thus ensuring that the shared secret can be correctly reconstructed. For example, Feldman’s VSS (Fel-VSS) extends SSS to a VSS by making the dealer broadcast homomorphic commitments to each of the polynomial’s coefficients . Alternatively we can view these commitments as one commitment to the polynomial:
The parties can use these commitments to verify that their share belongs to the polynomial by checking if
Distributed Key Generation
Up to this point, we have removed the need of trusting the dealer to be honest by using a VSS, but we still bear the risk of the dealer becoming non-operational or leaking the secret. In order to avoid the above in a DKG, the secret needs to be generated in a distributed manner as opposed to being centrally generated by one dealer. We will now present how Pedersen’s DKG works.
In Pedersen’s DKG (Ped-DKG), all parties are dealers following Fel-VSS. This technique of making all parties dealers following a VSS is how many DKGs are constructed. The protocol works as follows:
- Each party generates a secret , a random polynomial with degree and a Feldman commitment to it .
- It then calculates its public key share and broadcasts a commitment to it .
- When all finished broadcasting, each opens and the shared pubic key is set to with the corresponding secret being .
- Finally, broadcasts the commitment to the polynomial and distributes shares of its secret to all other parties (sharing phase).
Ped-DKG features a complaint round inside the sharing phase to remove invalid shares. When the verification of a share fails, broadcasts a complaint against . If the complaints against are more than , then is disqualified. If they are less than but not , then publishes all that had a complaint, and if any of those shares fails verification, then is disqualified. Disqualified parties are excluded from contributing to the secret by setting their shares to .
The state of the system after the sharing phase is completed is such that each participating party holds shares and their own secret. For reconstructing the shared secret we need to obtain all secrets by reconstructing each polynomial . For that we need points for each polynomial. Since each party has a point of each polynomial, any parties suffice to reconstruct all secrets and thus reveal the common secret.
Ped-DKG assumes a fully synchronous communication model according to which all messages are delivered within a strict time bound. This assumption provides assurance that this protocol will always terminate successfully.
Ped-DKG can tolerate dishonest parties that don't form a majority:
Ped-DKG performance can be reviewed by the following metrics:
- Verification complexity: operations since every party needs to verify shares from all others
- Broadcast messages: broadcast messages of size
Different DKG algorithms can provide performance improvements as well as other benefits. Here, we will focus on the recently released Aggregatable DKG protocol.
Modified Scrape PVSS (Scrape)
Scrape is a Publicly Verifiable Secret Sharing protocol based on Fel-VSS, that provides the ability for any party, internal or 3rd, to verify the dealt shares. Scrape doesn't need a complaint round since all parties will agree on the set of valid shares based on the common public information. Since the shares need to be publicly verifiable, they are published encrypted, with each party being able to decrypt only its corresponding share. Additionally, it has properties that allow the usage of aggregation of different shared secrets. In the following subsections we describe the operations that Scrape provides.
All parties share a Common Reference String (CRS) that includes:
- a bilinear group
- encryption keys of each party with corresponding decryption keys ( keeps secret).
The dealer chooses a secret value and sets the secret key . The result of the sharing phase is the PVSS transcript that is publicly accessible and comprises of:
- commitments to the polynomial's factors ()
- commitments to all the dealt shares ()
- encryptions of all dealt shares ().
Verification starts with checking the shares' commitments against the polynomial commitment and then checks if the encrypted shares correspond to the shares of those commitments:
with being the corresponding Lagrange polynomial, a nd is a Type III bilinear map. We are certain that the shares that pass the above checks belong to the committed polynomial and they are the same shares with the committed ones.
To reconstruct the secret a quorum of parties first needs to decrypt their shares and check if their bilinear mapping check holds . The secret key is reconstructed using the Lagrange interpolation in the exponent at point :
Aggregation of PVSS transcripts can be achieved due to the homomorphicity of the commitment and encryption schemes used. Given two polynomials, with corresponding transcripts:
we calculate the transcript that corresponds to by:
Agg-DKG is constructed as per Ped-DKG by making all parties Scrape dealers. Each dealer generates its own secret and its PVSS transcript ( PVSS transcripts are generated in total). The group's public key is and the secret key is , where and .
Each dealer deals a secret and . is the set of honest dealers and is uniquely determined by all parties based on the same public data.
Each dealer will need to provide a signed proof of knowledge for its secret. In Agg-DKG this is achieved by issuing a Signature-of-Knowledge (SoK). Each dealer is equiped with a signing key pair . To produce the SoK it first commits to its secret and then signs it:
The simplest way to verify shares would be that all parties verify all PVSS transcripts. But since the PVSS transcripts can be aggregated, it becomes possible for verifiers to verify aggregations of transcripts. Agg-DKG uses gossiping of aggregated transcripts instead of an all-to-all approach to reduce the total verification complexity from to . Since gossiping is random, the aggregation might include the same transcript several times. To reflect that, share weights are included in the calculation of the final secret, which becomes .
To incorporate all the above, Agg-DKG augments the PVSS transcript described previously to the DKG transcript:
where is an aggregated PVSS transcript.
A transcript is called full transcript if it is valid and includes contributions. A valid transcript is a transcript that passes verification (see below). Clearly, more than one full transcripts exist.
Aggregation of DKG transcripts is performed by aggregating the , merging the and vectors and element-wise summing the vectors. The resulting transcript will refer to the combined polynomial that corresponds to the weighted shares.
Verification of a DKG transcript starts with verifying first. Then, for every contribution , gets verified. Finally, verification that all the corresponding commitments are consistent to the combined polynomial commitment in takes place.
Agg-DKG works under the fully synchronous communication assumption. That means that there is a strict time bound between rounds and all messages (honest and adversarial) within a round will be seen by all parties by the end of the round. The protocol is as follows:
- each dealer starts by constructing its own DKG transcript:
- it deals Scrape shares and sets to the resulting PVSS transcript.
- it then generates its commitment and SoK and setting its weight to .
- the rest of commitments and SoKs are set to and their weights to .
- These initial DKG transcripts are gossiped and a process of verify aggregate gossip rounds starts in the network.
At any point the transcripts in circulation will be aggregations of some of the initial transcripts.
The following take place in each round of this phase:
- each party verifies incoming transcripts and aggregates the ones that pass verification
- each party broadcasts their newly aggregated non-full transcript to randomly selected parties ( chosen as a small number )
- each party that generates a full transcript after aggregation will broadcast it to all nodes with a probability of . If the decision was to broadcast, the party will terminate any further communication
- all parties decide to keep the full transcript for which the corresponding public key has the smallest bit-count in binary representation.
We notice that the protocol's termination relies on constructing a full transcript. This is bound to happen after enough rounds take place in the synchronous setup. The first round that a full transcript was broadcasted is agreed to be the last round of the protocol. There is a chance that more than one full transcripts were broadcasted during the last round. The last point in the protocol description deals with this case.
The above result in a communication complexity of broadcasts.
Agg-DKG can handle crashed nodes and can tolerate corrupted parties by a byzantine adversary. The threshold upper bound can be computed by:
Agg-DKG has a performance advantage over other schemes that makes it scale better for real-world applications. Additionally, the usual complaint rounds during sharing are replaced by a gossiping protocol, which likely requires comparable effort to implement. Also, an indirect benefit of being publicly verifiable is that crashed nodes are able to obtain their secret shares as long as they come back online without being excluded and without losing their decryption key.
On the other hand, Agg-DKG is based on a synchronous communication model that assumes that all messages are delivered in bound time. This assumption might not be accurate when using real-world communication means such as the Internet. Finally, the secret key and secret shares are group elements instead of field elements. This prevents the usage of Agg-DKG with many well-known cryptosystems that operate on shares that are field elements.
In a future post, we will describe the work we do on DKGs as part of the Anoma protocol, presenting the decisions taken and explaining the reasoning behind them.
Written by George Gkitsas, zero-knowledge cryptography researcher & protocol developer at Heliax, the team building the Anoma Network. If you're interested in zero-knowledge cryptography and cutting-edge cryptographic protocols engineering positions in Rust, check out the open positions at Heliax.