About me

I am a Computer Science PhD candidate at the University of California, Davis, advised by Dr. Vladimir Filkov. I build practical, reliable, and fair multimodal clinical AI that integrates EHR, imaging, physiological signals, multi-omics, and social/environmental data for clinical prediction.

I design missingness-aware fusion models that stay robust when modalities are incomplete. I have predicted atrial fibrillation type and recurrence from clinical, intracardiac electrogram, and metabolomics data, and exposome-informed models that account for social determinants of health in heart failure (HFpEF). In medical imaging, I have turned open-source vision-language models (VLMs) into locally deployable, privacy-preserving mammography report generators using multimodal retrieval-augmented generation (RAG), chain-of-thought prompting, and QLoRA fine-tuning.

Currently seeking

Research Intern / Research Scientist / AI / ML Intern · Summer 2027

Interested in teams working on multimodal learning, trustworthy medical AI, and foundation models (VLMs/LLMs, RAG).

Research Interests

  • Multimodal Learning
  • Vision-Language Models
  • Large Language Models
  • Retrieval-Augmented Generation
  • Parameter-Efficient Fine-Tuning
  • Learning with Missing Modalities
  • Trustworthy Medical AI
  • Medical Imaging
  • Clinical Prediction
  • Social Determinants of Health

At a Glance

  • 10+

    Peer-reviewed publications

  • 2

    Best paper & presentation awards

  • 0.87

    AUPRC on AF-type prediction

  • 3.96

    PhD GPA at UC Davis

News

  • Sep 2026

    Passed my Qualifying Exam on September 8 and advanced to PhD candidacy! 🎓

  • Jun 2026

    Completed my M.S. in Computer Science at UC Davis (GPA 4.00) on the way to the PhD.

  • Feb 2026

    MammoWise, our local multi-model RAG pipeline for mammography report generation, is now on arXiv.

  • Winter 2026

    Teaching Assistant for ECS 260: Graduate Software Engineering.

  • 2025

    Mammo-Find published and presented at SEET 2025 in Long Beach, CA (Springer).

  • 2025

    Presented Mammo-Find at the AMIA Clinical Informatics Conference (CIC) 2025.

  • 2025

    ECG arrhythmia classification paper published in BMC Cardiovascular Disorders.



Research

Current PhD projects as a Graduate Student Researcher at UC Davis (Sep 2024 – present).

EHR, cardiac imaging, omics and exposome data fused by interpretable multimodal ML into HFpEF phenotypes, outcomes and modifiable targets

Exposome-Informed Multimodal AI for Heart Failure (HFpEF)

Ongoing · NHLBI HeartShare cohort on BioData Catalyst

Heart failure with preserved ejection fraction (HFpEF) is a heterogeneous syndrome, and social, environmental, and behavioral exposures, collectively the exposome, shape how it presents and progresses. This project links where patients live to what happens biologically and to what can be changed.

  • Developing interpretable multimodal data fusion models that integrate EHR, cardiac imaging (echocardiography, CMR), multi-omics, and exposome/geospatial data to link social and environmental exposures to HFpEF subphenotypes and outcomes.
  • Analyzing a multimodal HFpEF cohort (NHLBI HeartShare: imaging, ECG, CPET, omics) on the BioData Catalyst cloud platform to identify biological pathways (inflammation, fibrosis, metabolic dysfunction) and modifiable targets for precision prevention.
  • Multimodal Fusion
  • Interpretable ML
  • EHR
  • Cardiac Imaging
  • Multi-omics
  • Social Determinants of Health
  • BioData Catalyst
Clinical, EGM and metabolomics data pass through modality-specific MLP encoders into an intermediate fusion model that predicts AF type and recurrence after ablation without imputing missing modalities

Multimodal Atrial Fibrillation Type & Recurrence Prediction

Ongoing · in collaboration with cardiologists

  • Designed an intermediate-fusion pipeline with modality-specific MLP encoders that integrates clinical, intracardiac electrogram (EGM), and metabolomics data, and handles missing modalities without imputation.
  • Benchmarked classical ML (Random Forest, XGBoost) and deep models (TabPFN, Transformers) for AF-type classification and post-ablation recurrence prediction.
  • 0.87 AUPRC · AF-type classification
  • Multimodal Fusion
  • Missing Modalities
  • TabPFN
  • Transformers
  • PyTorch
MammoWise pipeline overview

MammoWise: Local Multi-Model RAG for Mammography Reports

arXiv preprint, 2026

  • Built a locally deployable pipeline that turns open-source VLMs into mammography report generators and multi-task classifiers, with an optional multimodal RAG mode over image–text exemplars.
  • Benchmarked MedGemma, LLaVA-Med, and Qwen2.5-VL on VinDr-Mammo and DMID under zero-shot, few-shot, chain-of-thought, and RAG prompting, plus QLoRA fine-tuning.
  • Few-shot prompting and RAG improved report quality (BERTScore, ROUGE-L); QLoRA-tuned MedGemma gave the best classification results.
  • 0.88 breast density acc.
  • 0.93 calcification acc.
  • 0.75 BI-RADS acc.
  • VLMs
  • Multimodal RAG
  • QLoRA
  • Ollama
Mammo-Find interface

Mammo-Find: LLM Agent for Recommending Mammography Datasets

SEET 2025 (Springer) · AMIA CIC 2025

  • Built an LLM agent-based RAG recommender (Llama, Mistral, DeepSeek; LangChain, ChromaDB) that matches researchers' clinical and technical needs to 22 public mammography datasets.
  • Designed a multichannel interface that pairs conversational search with an interactive network visualization (PyVis) of dataset relationships.
  • LLM Agents
  • RAG
  • LangChain
  • ChromaDB

Earlier work on biosignals, medical imaging, and assistive technology is listed under .



Publications

Full list on Google Scholar.

Preprints

MammoWise pipeline overview

MammoWise: Multi-Model Local RAG Pipeline for Mammography Report Generation

Raiyan Jahangir, Nafiz Imtiaz Khan, Amritanand Sudheerkumar, Vladimir Filkov

arXiv preprint, 2026

Journal Articles

ECG arrhythmia classification framework

ECG-Based Heart Arrhythmia Classification Using Feature Engineering and a Hybrid Stacked Machine Learning

Raiyan Jahangir, Muhammad Nazrul Islam, Md. Shofiqul Islam, Md. Motaharul Islam

BMC Cardiovascular Disorders, 2025


Multilingual handwriting learning system

A Multilingual Handwriting Learning System for Visually Impaired People

Muhammad Nazrul Islam, Raiyan Jahangir, Nasif Shahriar Mohim, Md. Wasif-Ul-Islam, Anika Ashraf, Nafiz Imtiaz Khan, Mohammad Ratul Mahjabin, Abu Saleh Musa Miah, Jungpil Shin

IEEE Access, 2024


CNN-SCNet framework

Conference Papers

Mammo-Find interface

Mammo-Find: An LLM-based Multi-channel Tool for Recommending Public Mammogram Datasets

Raiyan Jahangir, Vladimir Filkov

Int'l Conference on Software Engineering of Emerging Technologies (SEET), Long Beach, CA, 2025


Brain tumor MRI classification

A Performance Analysis of Brain Tumor Classification from MRI Images Using Vision Transformers and CNN-based Classifiers

Raiyan Jahangir, Tanjim Sakib, Riasat Haque, Mahedi Kamal

26th Int'l Conference on Computer and Information Technology (ICCIT), 2023


RNN architectures for infant cry detection

Proposing Novel Recurrent Neural Network Architectures for Infant Cry Detection in Domestic Context

Raiyan Jahangir, Nasif Shahriar Mohim, Nafiz Imtiaz Khan, Md Akhtaruzzaman, Muhammad Nazrul Islam

IEEE 11th R10 Humanitarian Technology Conference (R10-HTC), 2023


Brain tumor MRI classification

Brain Tumor Classification on MRI Images with Big Transfer and Vision Transformer: Comparative Study

Raiyan Jahangir, Tanjim Sakib, Md Fahmid-Ul-Alam Juboraj, Shejuti Binte Feroz, Md Munkaser Islam Sharar

9th IEEE WIECON-ECE, 2023


Smart infant monitoring system

Development of a Smart Infant Monitoring System for Working Mothers

Raiyan Jahangir, Nasif Shahriar Mohim, Afnan Alauddin Mumu, Mahapara Naim, Anika Ashraf, Md Abu Syed, Muhammad Nazrul Islam

IEEE 11th R10 Humanitarian Technology Conference (R10-HTC), 2023


Maize leaf images classified by a Vision Transformer and CNN-based classifiers

Maize Leaf Disease Detection Using Vision Transformers (ViTs) and CNN-based Classifiers: Comparative Analysis

Syed Taha Yeasin Ramadan, Tanjim Sakib, Raiyan Jahangir, Sabbir Rahman

2nd Int'l Conference on Human-Centric Smart Computing (ICHCSC), 2023

Best Paper Award

Abstracts

Mammo-Find: An LLM-based Visual App for Matching Public Mammogram Datasets to Clinical and Translational Pipelines

Raiyan Jahangir, Vladimir Filkov

AMIA Clinical Informatics Conference (CIC), 2025



Resume


Education

  1. University of California, Davis

    Ph.D. in Computer Science · PhD Candidate

    Sep 2024 — Present (expected June 2028) · GPA 3.96/4.00

    Advisor: Dr. Vladimir Filkov

  2. University of California, Davis

    M.S. in Computer Science

    Sep 2024 — Jun 2026 · GPA 4.00/4.00

  3. Military Institute of Science and Technology (MIST)

    B.Sc. in Computer Science and Engineering

    Jan 2019 — Mar 2023 · GPA 3.92/4.00 · Dhaka, Bangladesh

Research Experience

  1. Graduate Student Researcher

    University of California, Davis · Sep 2024 — Present
    • Exposome-informed multimodal AI for heart failure (HFpEF): interpretable fusion of EHR, cardiac imaging, multi-omics, and exposome/geospatial data on the NHLBI HeartShare cohort (BioData Catalyst).
    • Multimodal atrial fibrillation type and recurrence prediction with missingness-aware intermediate fusion of clinical, EGM, and metabolomics data (0.87 AUPRC).
    • MammoWise: local multi-model VLM + RAG pipeline for mammography report generation; QLoRA-tuned MedGemma reached 0.88 density / 0.93 calcification / 0.75 BI-RADS accuracy.
    • Mammo-Find: LLM agent-based RAG recommender over 22 public mammography datasets (SEET 2025).

Teaching & Industry

  1. Teaching Assistant

    University of California, Davis · Winter 2025, Winter 2026

    ECS 36A: Programming and Problem Solving (Winter 2025)

    ECS 260: Graduate Software Engineering (Winter 2026)

  2. Lecturer, Department of CSE

    Ahsanullah University of Science and Technology (AUST) · Oct 2023 — Aug 2024

    Taught 8 undergraduate courses and collaborated with students on research projects.

    • Structured Programming
    • Data Warehouse & Data Mining
    • Numerical Methods
    • Digital Logic Design
    • Digital System Design
    • Microprocessors
    • Intro to Computer Systems
    • Software Development Lab
  3. Industrial Trainee, Data Science

    Robi Axiata Limited · Jan 2022 — Feb 2022

Technical Skills

  • Machine Learning

    Multimodal Learning, Vision-Language Models, LLMs, RAG, Parameter-Efficient Fine-Tuning (LoRA/QLoRA), Prompt Engineering, Computer Vision, NLP, Vision Transformers, CNNs, RNNs, Missing-Data Handling

  • Statistics & Evaluation

    Cross-Validation, Bootstrap Confidence Intervals, Hypothesis Testing (McNemar, Holm-Bonferroni), AUROC/AUPRC, Feature Selection

  • Frameworks & Libraries

    PyTorch, TensorFlow, Keras, scikit-learn, Pandas, LangChain, Ollama, ChromaDB, PyVis, Flask

  • Programming Languages

    Python, C/C++, Java, JavaScript, Bash

  • Tools & Platforms

    Git, Linux, LaTeX, Google Colab, Kaggle, NHLBI BioData Catalyst, Oracle, Firebase


Awards

  1. Best Paper Award, Int'l Conference on Human-Centric Smart Computing (ICHCSC), 2023 [certificate]

  2. Best Presentation Award, Int'l Conference on Computer and Information Technology (ICCIT), 2022 [certificate]

  3. Dean's List of Honors (all academic years) and University Merit Scholarship (every semester), MIST [certificate]

  4. Runner-Up, MIST Inter-University ICT Innovation Fest Hackathon [certificate]

  5. Runner-Up, IEEE Bangladesh Section Competition on Climate Change and Sustainability [certificate]

Service & Talks

  1. Journal Reviewer: IEEE Access, PLOS ONE, Computer Methods in Biomechanics and Biomedical Engineering [Web of Science] [records]

  2. Talk: Full paper presentation at SEET 2025, Long Beach, CA [ref]

  3. Talk: Abstract presentation at AMIA Clinical Informatics Conference 2025 [ref]

  4. Student Volunteer: IEEE/ACM International Conference on Automated Software Engineering (ASE) 2024 [ref]