get_model_tokenizers

ferritin_plms::esm::tokenization

Function get_model_tokenizers 

Source 
pub fn get_model_tokenizers(model: &str) -> Result<TokenizerCollection>