About

I am a Computer Science undergraduate at Ionian University and an AI/ML research assistant working across machine learning, deep learning, explainable AI, natural language processing, and retrieval-augmented generation.

At the Humanistic and Social Informatics Lab (HILab), Ionian University, I work on transformer-based NLP, interpretable machine learning, and scientific AI — including a legal-domain BERT model for named-entity recognition and anonymization, a layer-wise study of transformer explainability, an efficient-attention approach to protein-structure prediction, and an investigation of expressivity, trainability, and gradient scaling in variational quantum classifiers. During my Erasmus+ exchange at Sapienza University of Rome, I conduct research at the PSSM Lab, DIAG, under Prof. Massimo Mecella, where I lead the development of LegalSENN, an intrinsically interpretable transformer architecture for legal document classification. I have also worked in industry as an AI researcher, evaluating large language and multimodal models and building reproducible PyTorch evaluation tooling.

My research has resulted in four peer-reviewed publications and two manuscripts currently under review. I am broadly interested in building AI systems that are accurate, transparent, and reliable enough for real-world deployment.

Publications

2026

Self-Explaining Transformer Architectures for Legal Document Classification

Nikolaos Roufas, M. Marinacci, A. Kanavos, M. Mecella

Under review · Discover Artificial Intelligence, Springer Nature

Expressivity, Trainability, and Gradient Scaling in Variational Quantum Classifiers

I. Karamitsos, Nikolaos Roufas, A. Kanavos

Under review · Discover Computing, Springer Nature

2025

LegNER: A Domain-Adapted Transformer for Legal Named Entity Recognition and Text Anonymization

I. Karamitsos, Nikolaos Roufas, K. Al-Hussaeni, A. Kanavos

Published · Frontiers in Artificial Intelligence, 8, 1638971 · Paper

Analyzing Public Discourse and Sentiment in Climate Change Discussions Using Transformer-Based Models

Nikolaos Roufas, A. Mohasseb, I. Karamitsos, A. Kanavos

Published · IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), pp. 39–53, Springer · Paper

Do Deeper Layers Explain Better? An LID-Based Study of Transformer Explainability

Nikolaos Roufas, A. Kanavos, I. Karamitsos, K. Al-Hussaeni, M. Maragoudakis

Published · IEEE International Conference on Big Data (BigData), pp. 6552–6559 · Paper

Efficient Protein Folding with Transformer Models Using the Performer Architecture

Nikolaos Roufas, I. Karamitsos, K. Al-Hussaeni, V. C. Gerogiannis, A. Kanavos

Published · International Conference on Advances in Information and Communication Technology (ICTA) · Paper

Experience

Humanistic and Social Informatics Lab (HILab), Ionian University

Undergraduate Researcher · Nov 2024 – Present · Supervisor: Prof. Andreas Kanavos

  • LegNER, a domain-adapted transformer for legal named-entity recognition and text anonymization.
  • Transformer-based sentiment classifiers for climate-change discourse analysis.
  • Layer-wise explainability study linking Local Intrinsic Dimensionality to SHAP attribution strength.
  • A Performer-based protein-structure prediction model using linear attention.
  • Variational quantum classifiers, studying the expressivity–trainability trade-off.
  • Maintains the lab’s Linux/CUDA GPU research server.

PSSM Lab, DIAG, Sapienza University of Rome

Visiting Research Student (Erasmus+) · Sep 2025 – Jul 2026 · Supervisor: Prof. Massimo Mecella

  • Leading development of LegalSENN, an intrinsically interpretable transformer architecture for legal document classification.
  • Combines Legal-BERT representations with a concept bottleneck, input-dependent relevance scores, and additive prediction.
  • Evaluated on 7,800 SCOTUS opinions across 13 legal issue classes.

Stealth Startup

Artificial Intelligence Researcher · Jun 2025 – Oct 2025

Researched and evaluated large language and multimodal models across performance, robustness, and alignment dimensions, and built Python/PyTorch evaluation tooling to automate benchmarking workflows and improve experimental reproducibility, working within a small technical R&D team.

Education & Affiliations

Ionian University

B.Sc. Computer Science, Department of Informatics · 2024–2028 (expected)

Sapienza University of Rome

Erasmus+ Exchange · Visiting Research Student, DIAG · 2025–2026

Selected Awards

Teaching & Service

Teaching

Peer Tutor · Ionian University

Informal peer tutoring and coursework guidance for fellow students in Operating Systems, Artificial Intelligence, Data Mining, and Databases.

Volunteering

IT, Logistics & PR Coordination Team · Ionian University Student Conference in Informatics

Contributes to communication, logistics, and event operations for the university’s student informatics conference. Feb 2025 – Present

Erasmus+ Buddy · ESN Ionian

Supported incoming Erasmus students with practical guidance and integration into university and local student life. Feb 2025 – Jul 2025