Home / Archives / Vol. 4 No. 2 / Articles
A Transformer-Based Hybrid Framework for Context-Aware Text Summarization in Low-Resource Languages
Varsha Negi
Assistant Professor, Department of Computer Science, Shyam Lal College Evening, Shahdara, Delhi University, India.
K Ruth Isabels
Associate Professor, Department of Mathematics, Saveetha Engineering College (Autonomous), India.
Keywords:
Transformer models, hybrid framework, context-aware summarization, low-resource languages, abstractive text summarization, multilingual NLP, semantic attention, knowledge-enhanced summarization, domain adaptation, deep learning.
Abstract
The rapid advancement of neural text summarization has largely benefited resource-rich languages, leaving low-resource languages underrepresented due to data scarcity and linguistic complexity. This paper proposes a Transformer-based hybrid framework that effectively generates context-aware abstractive summaries for low-resource languages by integrating the strengths of pre-trained multilingual transformer models with domain-specific hybrid enhancements. The framework leverages semantic attention mechanisms, extractive cues, and knowledge-guided rules to improve content relevance, coherence, and fluency in summaries. To address the limitations of existing approaches such as lack of contextual depth, poor generalizability, and over-reliance on large-scale datasets the proposed system introduces an adaptive learning pipeline tailored to low-resource environments. Experimental evaluations across multiple low-resource language datasets demonstrate significant improvements in ROUGE, BLEU, and METEOR scores compared to state-of-the-art baselines, while also maintaining low computational overhead. Furthermore, qualitative analysis reveals enhanced interpretability and domain adaptability. This research contributes a scalable, efficient, and linguistically inclusive solution to the growing need for automated summarization in underserved linguistic communities.
Details
Published
2025-06-25
Pages
1-12
Issue
Vol. 4 No. 2 (2025):
IJRTTE - 04 - 02
Section
Articles