Text Summarization using Natural Language Processing
This thesis explores text summarization techniques using Natural Language Processing (NLP). The focus is on leveraging advanced neural network architectures, including LSTM, BiLSTM, and attention mechanisms with GloVe embeddings, to generate concise summaries of text.
-
LSTM (Long Short-Term Memory) π§
- Utilizes memory cells to capture long-range dependencies in sequences.
-
BiLSTM (Bidirectional LSTM) π
- Processes input data in both forward and backward directions, improving context understanding.
-
LSTM with GloVe Attention π
- Integrates GloVe embeddings with attention mechanisms to enhance summary quality.
-
BiLSTM with GloVe Attention β¨
- Combines BiLSTM architecture with attention and GloVe embeddings for better performance.
To evaluate the performance of the summarization models, we employed the ROUGE Score (Recall-Oriented Understudy for Gisting Evaluation) π, which measures the quality of summaries by comparing them to reference summaries.
To run the code, please make sure you have the following libraries installed:
pip install numpy pandas nltk tensorflow keras scikit-learn