TRANSFORMERS AND THEIR APPLICATIONS IN NATURAL LANGUAGE PROCESSING
natural language processing
The goal of my thesis is to investigate the most influential transformer architectures and to apply them for real-world NLP tasks. I have learned about transformers through reading related research papers in order to understand how are they working under the hood. Further, I have fine-tuned some of architectures on well-known publicly-available datasets for essential NLP tasks with various training parameters and then compared with each other to figure out their pros and cons.