Expand description
ESM3 layer implementations.
Modulesยง
- blocks
- ESM3 UnifiedTransformerBlock: plain MHA + geometric attention + SwiGLU FFN.
- encode_
inputs - ESM3 multi-track input embedding (EncodeInputs).
- output_
heads - ESM3 output projection heads (OutputHeads).
- relative_
position - Relative position embeddings for the ESM3 structure encoder (ferritin-100.22).
- transformer_
stack - ESM3 TransformerStack: stacked UnifiedTransformerBlocks with geometric attention.