Doctoral Position in Deep Learning with Vision Transformers

Royal Institute of Technology School of Electrical Engineering and Computer Science

Doctoral Student Position in Deep Learning with Vision Transformers

School of Electrical Engineering and Computer Science at KTH

KTH Royal Institute of Technology in Stockholm has grown to become one of Europe’s leading technical and engineering universities, as well as a key centre of intellectual talent and innovation. We are Sweden’s largest technical research and learning institution and home to students, researchers and faculty from around the world. Our research and education covers a wide area including natural sciences and all branches of engineering, as well as architecture, industrial management, urban planning, history and philosophy.

Project description

Third-cycle subject: Computer Science

We are looking for a doctoral student interested in Artificial Intelligence, Machine Learning, and Computer Vision that will work in a newly funded project financed by the Swedish AI-program WASP (Wallenberg AI, Autonomous Systems and Software Program, www.wasp-sweden.org), which offers a graduate school with research visits, partner universities, and visiting lecturers. The aim of the research project is to develop more efficient vision transformer models. Specifically, we are interested in methods that allow transformers to scale up to operate on high resolution images, an essential task for medical image analysis. We are interested in developing more data-efficient training methods for vision transformers which reduce their reliance on large pretraining datasets. The project will include aspects of interpretability – providing insights into how vision transformers make decisions – and applications to medical image analysis.

Supervision: The doctoral student will be supervised by Associate Professor Kevin Smith (https://www.kth.se/profile/ksmith) wh