Skip to main content
get_model_tokenizers
ferritin_
plms
0.3.3-dev
In ferritin_
plms::
esmc::
tokenization
ferritin_plms
::
esmc
::
tokenization
Function
get_
model_
tokenizers
Copy item path
Source
pub fn get_model_tokenizers(model: &
str
) ->
Result
<
TokenizerCollection
>