Skip to main content

Module pretrained

Module pretrained 

Source
Expand description

ESM3 pretrained weight loading.

Downloads weights from EvolutionaryScale/esm3-sm-open-v1 on HuggingFace (gated access — the user must accept the Cambrian Non-Commercial license and run huggingface-cli login).

§Weight layout

The .pth file is a plain PyTorch state dict saved via torch.save(model.state_dict(), ...). No wrapping key is used; PthTensors::new(path, None) loads it directly.

Note the repo path: the checkpoints live under data/weights/, not at the repo root. Requesting the bare filename returns “Entry not found: esm3_sm_open_v1.pth” (ferritin-100.21).

Model attribute (Python)VarBuilder prefix
encoder.*encoder.*
transformer.*transformer.*
output_heads.*output_heads.*

The structure encoder uses a separate checkpoint (data/weights/esm3_structure_encoder_v0.pth):

Python attributeVarBuilder prefix
encoder.* (blocks)encoder.*
pre_vq_proj.weightpre_vq_proj.*
codebook.embeddingscodebook.*

Structs§

ESM3Runner
Wraps a loaded ESM3 model for sequence embedding and multi-track inference.
StructureEncoderRunner
Wraps the ESM3 structure token encoder for converting backbone coordinates to tokens.

Enums§

ESM3Models
Available ESM3 model variants.

Constants§

STRUCTURE_ENCODER_ID
The structure encoder’s registry id.