Skip to main content

Module output_heads

Module output_heads 

Source
Expand description

ESM3 output projection heads (OutputHeads).

Projects the transformer hidden state to per-track logit distributions.

Structsยง

ESM3Output
Output of an ESM3 forward pass.
OutputHeads
RegressionHead
Linear(d_in) โ†’ GELU โ†’ LayerNorm โ†’ Linear(d_out).