Meno: | Tomáą |
---|---|
Priezvisko: | Vician |
Názov: | Towards Explainable Neural Language Models |
Vedúci: | Mgr. Endre Hamerlik |
Rok: | 2022 |
Kµúčové slová: | Explainable AI, xAI, Natural Language Processing, NLP, Transformer, probing |
Abstrakt: | Natural language processing has been rapidly advancing in recent years. The used neural models in this domain are more and more complex. Different techniques have been developed to understand their inner representations. Inspired by these techniques, we tried to extract some linguistic features from the inner representations of a chosen model, more precisely the BERT model. We conducted an ad hoc syntactic dependency analysis and used the so-called probing technique to predict parts of speech. We also present our results and discuss possible further work. |
Súbory diplomovej práce:
dipl_vician.zip |
dipl_vician22.pdf |
Súbory prezentácie na obhajobe: