Skip to main content

Module folding_trunk

Module folding_trunk 

Source
Expand description

Folding trunk: 24-layer Pairformer transformer.

Weight layout:

folding_trunk.pair_init.*            โ€” pair representation initializer
folding_trunk.blocks.{0..23}.*       โ€” Pairformer layers
folding_trunk.norm.*                 โ€” final single-repr LayerNorm (TODO)

Structsยง

FoldingTrunk
24-layer Pairformer trunk that jointly refines single and pair representations.