pub fn tokenize_sequence(sequence: &str, add_special_tokens: bool) -> Vec<u32>Expand description
Encode an amino-acid string to ESM3 sequence token IDs.
Unknown characters map to <unk> (index 3).
When add_special_tokens is true, prepends BOS and appends EOS.