Why did you pick that vocabulary size, and how did you...

Choosing a vocabulary size is a foundational decision that impacts both model performance and parameter efficiency. You must evaluate the compression ratio across your target languages to ensure the tokenizer is efficient. Additionally, you must account for the impact on the embedding layer size, as this is a permanent architectural choice that cannot be easily changed after training begins.