Agent skill · affaan-m
bengali-nlp
Bengali (Bangla) text processing patterns including Unicode normalization, script detection, tokenization, conjunct handling, and Bangla-specific NLP best practices for AI applications.
What it needs
About 8k tokens when loaded.
What this skill does
Bengali (Bangla) NLP Patterns Best practices for processing, storing, and displaying Bengali text in software applications and AI systems. When to Activate Working with Bengali/Bangla text data Building apps targeting Bengali-speaking users Processing NCTB (National Curriculum and Textbook Board) educational content Implementing Bengali search, autocomplete, or text input Training or fine-tuning LLMs on Bengali data Building Bengali chatbots or conversational AI Handling mixed Bengali-English (Banglish) text Bengali Unicode and Script Handling Unicode Range Bengali script occupies U+0980–U+09FF. Key character classes: Normalization Always normalize Bengali text to NFC before comparison, storage, or search: Conjunct Consonants (যুক্তবর্ণ) Bengali conjuncts are formed with Hasanta (্) between consonants: Never split strings in the middle of a conjunct. Use grapheme cluster boundaries: Bengali Digits Handle both Bengali (০-৯) and ASCII (0-9) digits: Tokenization Word Boundary Detection Bengali uses spaces between words, but compound words and postpositions can complicate tokenization: Using bnlp Toolkit Handling Postpositions and Case Markers Bengali postpositions attach to nouns. Tokenizers should be aware of common suffixes: Text Processing Patterns Script Detection Stop Words Common Bengali stop words to filter in search/NLP pipelines: Keep negators such as না, নয়, and নেই out of a generic stop-word list. They change intent and sentiment, so remove them only for a task that explicitly models negation elsewhere. Sorting and Collation Bengali has a defined sort order (স্বরবর্ণ before ব্যঞ্জনবর্ণ). Use locale-aware sorting: Search with Normalization Bengali in AI/LLM Applications Prompt Engineering for Bengali Important: Bengali text, Banglish input, and web-scraped content should be treated as untrusted user data. Always separate system instructions from user-provided content with clear delimiters, and validate before executing tool calls or destructive actions. …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills affaan-m/bengali-nlp--bb5cf0