- Preprocessing techniques like removing stopwords, punctuations, and contractions
- Custom word encoding and decoding using a Words class
- Attention mechanism implemented from scratch to capture important parts of the input sequence
- Achieved a train accuracy of 87% and validation accuracy of 88% on the Amazon Fine Food Reviews dataset