Arabic diacritization is the task of adding diacritical marks to Arabic text to aid correct articulation, resolve lexical ambiguity, and support downstream natural language processing tasks. This study proposes a hybrid deep learning architecture that augments a pre-trained transformer encoder (AraBERTv02) with a sequential prediction head built on either a Bidirectional Long Short-Term Memory …
Few-shot text classification is a challenging problem in natural language processing. Models have to generalize from a small number of labeled examples. This paper investigates the effectiveness of data augmentation methods (back-translation, paraphrasing, and noise injection) on overfitting prevention and generalization enhancement in few-shot scenario for small transformer models such as Dist…