Sushant Gautam is a PhD student in Multimodal AI at the Simula Metropolitan Center for Digital Engineering, Oslo, Norway. His work focuses on building safe, trustworthy, scalable, and real-world deployable AI systems across vision-language models, medical imaging, AI safety, alignment, reasoning, evaluation, fine-tuning, and agentic workflows.
_____________
PhD Student🎓 | Interested in ML/DL 🧠 | 🌱Ⓥ
🧑🔬 Google Scholar | 📚 ResearchGate | 🌐 LinkedIn
PhD Student, Simula Metropolitan Center for Digital Engineering, Oslo
May 2023 – Present (🎓 Finishing Soon)
Working on multimodal learning with applications in medical imaging and sports analytics.
Published in conferences and workshops in ACM MM, IEEE ISM, EMNLP, IEEE CBMI, IEEE CBMS, ACM ICMI, and MICCAI.
Organized Medical AI challenges: MediaEval Medico 2025 and ImageCLEF 2025
Contributed to building large-scale open multi-modal datasets: SoccerChat, Kvasir-VQA and Kvasir-VQA-x1
Representing Simula in NORA Student Council.
PhD Enrichment Student, The Alan Turing Institute, London
Oct 2024 – Jul 2025
Focused on multimodal AI and clinical reasoning, engaging in cross-institutional collaborations and professional development. Delivered multiple research presentations, including Kvasir-VQA and Structured Clinical Reasoning, participated in Turing–Roche co-working sessions, and volunteered at AI UK 2025. Represented the PhD cohort as Student Representative, contributing to community and academic initiatives. Selected through the NORA Research School for a six-month research stay in London as part of the Turing Enrichment Scheme 2024/25.
Adjunct Lecturer, Tribhuvan University, IOE, Thapathali Campus, Kathmandu
Dec 2022 - May 2023 (Contract based)
For the graduate level course: "A Practical Approach in Deep Learning" offered for MSc in Informatics and Intelligent Systems Engineering
Engineering Manager, North Star Developer's Village, Kathmandu
April 2019 to May 2023
Experimenting using new technology in various domains including education and healthcare.
NIA Project: Web-based Audio Data Collection, Annotation and Evaluation Platform
EPS UBT: Edge-based Automated Realtime Proctoring for EPS Korea Language Exam
UBL Cloud: NextGen Learning Management System with AI features
UBT Rec: Online Proctoring for Live Exams
Essay Ranking; Feedback Bot; Topic Modelling/Analysis; ML functions/models for through API.
Research Assistant, UGC Collaborative Research Grant, Lalitpur
January 2018 to March 2019
• Assistant to Prof. Dr. Nanda Bikram Adhikari. Research & implement appropriate algorithms & tools.
• Storing sensor data with GPS trace & data mining. RNN, RapidMiner, Hadoop, WebSocket, etc.
AI Intern, Leapfrog Technology, Lalitpur
October 2018 to March 2019
• Predictive models for time series modelling for weather and pollution prediction.
• ARIMA and windowing-based models. Model deployment and web-based interactive interface.
Simula Metropolitan Center for Digital Engineering & Oslo Metropolitan University - Oslo, Norway/ May 2023 – Present
PhD in Computer Science (Multimodal AI)
Courseworks:
PENG9560 Topics in Artificial Intelligence and Machine Learning (OsloMet)
PENG9200 Scientific Research Methods and Data Analysis in Engineering Science (OsloMet)
PENG9100 Engineering Science and Ethics (OsloMet)
IN9550 Neural Methods in Natural Language Processing (University of Oslo)
Six months Research stay at The Alan Turing Institute, London (Oct 2024 – Jul 2025) as part of the NORA–Turing Enrichment Scheme 2024/25.
IOE, Thapathali Campus - Lalitpur, Nepal/ 2020-22 August
MSc in Informatics and Intelligent Systems Engineering (Full Merit-Based Scholarship )
Courses: NLP, CV, Applied ML, DL, Computational Intelligence, Info. Theory, Info. Visualization, Optimization
MS Thesis in collaboration with SimulaMet at Simula Research Laboratory, Norway.
IOE, Pulchowk Campus - Lalitpur, Nepal/ 2015-19
BE in Computer Engineering (Full Merit-Based Scholarship)
Relevant Courses: AI, Probability & Statistics, Data Mining, Big Data, Theory of Computation
Programming: Python, C/C++, Java, SQL, Bash, Android
Frameworks & Tools: PyTorch, TensorFlow, Keras, Django, FastAPI, Hugging Face, LangChain, vLLM, PEFT, TFX, Git, Docker, Jupyter
Libraries & Ecosystem: NumPy, Pandas, SciPy, Scikit-learn, Matplotlib, OpenCV, Transformers, Gradio, Streamlit
Research & Modeling: Vision–Language Models (VLMs), Large Language Models (LLMs), Multimodal Learning, Synthetic Data Generation, Uncertainty Estimation, PEFT/LoRA Fine-tuning
Languages: English (Fluent), Nepali (Native), Hindi (Advanced), Norwegian (Basic)
Deep Learning-based Pose Estimation for Dystonia Score Prediction (MS Project)
Assessment of Spatiotemporal Weather and Pollution Proxies with RNN and ARIMA (Bachelor's Thesis)
Statistical analysis, visualization, regression & time series predictive modelling using NN models.
Human Facial Landmarks Detection using Multi-Layer Perceptron (Minor Project)
Trained MLP regressor for facial landmarks detection. Hyper parameter tuning.
IOT based Smart Traffic Light System:
A prototype of the Smart Traffic Light System using the Internet of Technology and smart cameras at traffic junction using the ESP8266 module.
Web Based Image Segmentation and Model Serving
Capable of tagging images for segmentation. ML tests & experiments, model training on server
(During Bachelors)
Full Scholarship for Participation, NAAMII’s Winter School in Al. Deep Learning, Computer Vision, Stats. & Algorithms, Data science, Optimization. Met with AI-fellows from renowned university and labs.
Hult Prize at TU 2017 Winner: for presenting a sustainable idea to empower refugees in Nepal using e-commerce platform and got the opportunity to present at Hult Business School, Dubai
Mentor at Global Venture Bootcamp at Asian Development Bank, the Philippines as an aspiring tech entrepreneur to enhance flourishing social ventures using emerging technologies.
Participant, IEEE AI & Big Data Workshop 2018. Led multiple IEEE Student Chapter activities in Campus.
Best Prototype Award for Mobile App idea at UNICEF’s 1000 Golden Hours Code Camp, 2017
📧 sushant@simula.no
🎫 Book a meeting with me!
Feel free to contact me for collaboration/research opportunities.