Agent skill · nousresearch

huggingface-tokenizers

Fast BPE/WordPiece tokenization and custom vocab training.

Reference it in any coding agent with:

@skills nousresearch/huggingface-tokenizers

Browse the @skills marketplace