Expand description
ESM3 output projection heads (OutputHeads).
Projects the transformer hidden state to per-track logit distributions.
Structsยง
- ESM3
Output - Output of an ESM3 forward pass.
- Output
Heads - Regression
Head - Linear(d_in) โ GELU โ LayerNorm โ Linear(d_out).