Skip to main content

UNK_ID

ferritin_plms::t5::tokenizer

Constant UNK_ID 

Source 
pub const UNK_ID: u32 = 2;
Expand description

<unk> — id 2. Any character outside the table below.