University of Southern California · Viterbi School of Engineering

Prabudhd Krishna Kandpal

M.S. Computer Science, Artificial Intelligence

I work on multimodal machine learning, on models that reason jointly over speech, vision, and language rather than treating each stream in isolation. What keeps pulling me back is one question: how much of what a model appears to understand actually holds up when the conditions change, whether the streams arrive out of sync, a later round of training overwrites an earlier one, or the input was built to mislead it.

Portrait of Prabudhd Krishna Kandpal

Los Angeles, California
pkandpal@usc.edu
prabudhd@gmail.com

Status
Open to opportunities Full-time machine learning engineer roles
Degree
M.S. Computer Science Expected May 2027
Publications
2 peer-reviewed Springer

01 About

Background, current research, and what I am looking for next.

I am a master's student in Computer Science at the University of Southern California, on the Artificial Intelligence track, advised through coursework and project work in machine learning and applied AI. Before USC I completed a bachelor's degree in Artificial Intelligence and Machine Learning at Guru Gobind Singh Indraprastha University in Delhi, graduating as a Bronze Medalist from the 2025 batch.

My research concerns how meaning is distributed across modalities. In natural conversation, the signal that matters is rarely confined to the words: it is carried by prosody, by facial affect, and by timing relative to the other speaker. My current project treats this directly. Given a recorded dyadic exchange, the task is to localize the specific utterance at which the interaction shifts from cooperative to adversarial, which means aligning three asynchronous streams at utterance granularity rather than pooling them into a single clip-level embedding. A transformer architecture I designed and trained from scratch reaches 86.7% accuracy on this task over twenty hours of annotated dialogue, exceeding a strong Gemini API baseline by 7.2 percentage points.

Working on that problem left me with a broader unease, and it is the thing I have spent this year following. A model can look competent on the evaluation you happen to run and still be holding its answer together loosely. Two projects this fall put that suspicion under a controlled test. The first asks what a language model should rehearse. An assistant is rarely tuned once: it is tuned for helpfulness, then for safety, then for instruction following, and every stage quietly erodes what the one before it taught. Given a replay budget of ten percent, we record how far each stored preference pair's DPO margin has fallen from its peak, replay the pairs that lost the most, and check that rule against random and difficulty-based selection under an identical update budget.

The second project asks what a vision-language model is really reading. Expense and hiring pipelines now hand receipts and résumés straight to a VLM, and the person uploading the file is not always a neutral party. We optimize bounded pixel perturbations that leave the page visibly unchanged, measure whether they can force a chosen false total or a credential the document never states, and then test which lightweight defenses still hold once the attacker knows they are in place. Both projects interest me for the same reason the conflict work does: they ask what a model has actually learned, rather than what it manages to output on a good day.

Running alongside the research is a second interest in whether these methods survive contact with practice. Over two summers at Novartis and ZS Associates I built gradient-boosted models for identifying early adopters of therapies in markets that did not yet exist, and retrieval-augmented systems that pair a language model with a deterministic calculation layer so that generated figures remain auditable. The constraints in that setting, interpretability, calibration, and the cost of a false positive to a real clinician, shaped how I evaluate models generally.

I am currently looking for full-time machine learning engineer roles and, in parallel, doctoral programs in multimodal learning and the reliability of post-trained models. If you work on problems where the interesting structure lies between modalities, or on what survives the next round of training, I would be glad to hear from you.

02 Recent

  • Began Poisoned Paperwork (CSCI 566): targeted adversarial perturbations against vision-language document extraction on SROIE, CORD v2, and synthetic résumés, evaluated for transfer, transformation survival, and defense.
  • Began Most-Forgotten Replay (CSCI 544): does replaying the preference pairs that lost the most DPO margin beat random replay at the same 10% budget across sequential tuning stages?
  • Completed a summer at Novartis (AI & Automation), shipping an adoption-propensity model and an LLM reporting agent on AWS Bedrock.
  • Appointed Course Producer for CSCI 561: Foundations of Artificial Intelligence at USC.
  • Began the M.S. in Computer Science (Artificial Intelligence) at USC Viterbi.
  • Concluded a six-month decision-analytics engagement with ZS Associates on the Pfizer account; received the “Best Case Study Solution” award and a return offer.
  • Paper on transformer-based summarization and sentiment analysis published in Lecture Notes in Electrical Engineering (InCITe 2024). Read →

03 Publications

Peer-reviewed work, most recent first. A complete and continuously updated list is available on Google Scholar.

[3]

Predicting Emotional Descent in Dyadic Interaction

P. K. Kandpal

Manuscript in preparation, 2026  ·  In progress

A transformer trained from scratch to fuse prosodic, visual, and lexical streams at utterance granularity and localize conflict onset in two-person conversation. Evaluated on twenty hours of annotated dialogue; 86.7% accuracy, 7.2 points above a Gemini API baseline.

[2]

Text Summarization and Sentiment Analysis Using Transformer-Based Models: Comparative Analysis

P. K. Kandpal, D. Seth, N. Garg, N. Sharma

In Intelligent Solutions for Smart Adaptation in Digital Era (InCITe 2024), Lecture Notes in Electrical Engineering, vol. 1278. Springer, 2025.

A controlled comparison of transformer architectures on paired summarization and sentiment tasks, examining where abstractive summarization preserves the affective content of the source text and where it distorts it.

[1]

Time Series Forecasting of NSE Stocks Using Machine Learning Models (ARIMA, Facebook Prophet, and Stacked LSTM)

P. K. Kandpal, Shourya, Y. Yadav, N. Sharma

In Proceedings of Data Analytics and Management (ICDAM 2023), Lecture Notes in Networks and Systems, vol. 788. Springer, 2023.

A head-to-head evaluation of classical, additive, and deep sequence models on National Stock Exchange equities, with attention to the horizons at which added model capacity stops paying for itself.

04 Industry Experience

Applied machine learning and decision science in pharmaceutical and SaaS settings.

Jun – Aug 2026
East Hanover, New Jersey

Novartis

Business Planning & Analysis Intern, AI & Automation

  • Modeled adoption propensity for a novel cardiovascular therapy launching into a category whose diagnostic test had no prior clinical footprint. A LightGBM model over early testing and market signals ranked prescribers by likelihood of adoption, allowing field teams to allocate outreach while the market was still forming.
  • Designed conversational reporting agents on AWS Bedrock that pair retrieval-augmented generation with a deterministic calculation layer, so that every figure a stakeholder reads traces back to a computed value rather than a sampled one. Weekly performance reporting fell from hours to minutes.
LightGBMAWS BedrockRAGPythonSQL
Feb – Jul 2025
New Delhi, India

ZS Associates · Pfizer account

Decision Analytics Associate Intern

  • Built a predictive targeting model (XGBoost with SHAP attribution) to identify early adopters, with the interpretability requirement treated as a first-class constraint rather than a post-hoc report.
  • Formulated resource-allocation models that redistributed field coverage across 16 portfolios under simultaneous profitability, budget, and workload constraints.
  • Ran A/B tests, ROI modeling, and coverage-gap clustering across APAC markets (Japan, Australia, New Zealand) to inform promotional capital allocation.
  • Delivered analytics tooling adopted across global teams; received the “Best Case Study Solution” award and a full-time conversion offer.
XGBoostSHAPA/B testingTableauSnowflake
Aug – Nov 2023
New Delhi, India

LunexAI

Artificial Intelligence / Machine Learning Intern

  • Co-developed a content-generation engine combining GPT-3 with a ChromaDB vector store, restructuring the storage and preprocessing path to support real-time personalized retrieval for a pay-per-use SaaS platform.
GPT-3ChromaDBVector searchPython

05 Teaching

Graduate instruction and mentorship at USC.

Jan – May 2026
Los Angeles, California

University of Southern California

Course Producer, CSCI 561: Foundations of Artificial Intelligence

  • Supported the graduate section of USC's core AI course, covering search, adversarial game playing, propositional and first-order logic, and probabilistic reasoning.
  • Held office hours and mentored students through programming assignments, with particular attention to the gap between an algorithm that is understood and one that can be implemented correctly.
  • Designed and calibrated grading rubrics for examinations and assignments across a large enrollment, aiming for consistency across graders rather than speed.
Search & heuristicsLogicProbabilistic reasoningMentorship

06 Graduate Coursework

Coursework toward the M.S. in Computer Science at USC, with instructors.

Fall 2026 In progress
CSCI 544 Applied Natural Language Processing Prof. Xiang Ren Semester project: Most-Forgotten Replay, budgeted replay for continual preference tuning
In progress
CSCI 566 Deep Learning and Its Applications Prof. Yue Zhao Semester project: Poisoned Paperwork, adversarial document images against vision-language models
In progress
Completed 2025 – 2026
CSCI 535 Multimodal Probabilistic Learning of Human Communication Prof. Mohammad Soleymani
A
CSCI 567 Machine Learning Prof. Haipeng Luo
A
CSCI 561 Foundations of Artificial Intelligence Prof. Wei-Min Shen
A
CSCI 570 Analysis of Algorithms Prof. Shahriar Shamsian
A

07 Selected Projects

Implementation work, largely built to test an idea rather than to ship a product. Source is available for completed work; the two Fall 2026 studies are still running.

Calm to Conflict

Research

Utterance-level conflict-onset prediction in dyadic video. A multimodal transformer written from scratch aligns prosody, facial affect, and text across twenty hours of dialogue to localize the turn at which cooperation breaks down. 86.7% accuracy, +7.2 points over a Gemini baseline.

PyTorchTransformersMultimodal fusion
View repository →

Most-Forgotten Replay

In progress

What should a language model rehearse? Tuning in sequence for helpfulness, then safety, then instruction following erodes preferences an earlier stage taught. Every stored pair's length-normalized preference margin is rescored during later stages, and the pairs that fell furthest from their peak are replayed, against random and lowest-margin selection under an identical 10% replay budget. Qwen2.5-1.5B-Instruct, 4-bit QLoRA, twelve sequential runs.

DPOQLoRAContinual learningCSCI 544

Poisoned Paperwork

In progress

Can a bounded pixel perturbation make a vision-language model report a total that is not on the receipt? Targeted PGD against Qwen2.5-VL on SROIE and CORD v2, with a résumé-credential case study, measured for perceptibility, transfer to InternVL2.5, survival through JPEG, resizing, and printing, and against three lightweight defenses re-attacked by an adaptive objective.

Adversarial MLVision-language modelsDocument AICSCI 566

Retrieval-Augmented Generation from First Principles

A RAG pipeline over PDF corpora implemented without a framework. Chunking, embedding, vector search, and prompt assembly are written by hand, on the premise that every failure mode of retrieval should be visible rather than abstracted away.

PythonEmbeddingsVector search
View repository →

Safe Web

A browser extension that classifies page text and imagery in real time to filter content unsuitable for children. A convolutional classifier is exported to ONNX.js so that inference runs locally in the browser and no image leaves the user's machine.

CNNONNX.jsJavaScript
View repository →

NSE Forecasting Study

Published

The implementation accompanying the ICDAM 2023 paper: ARIMA, Prophet, and a stacked LSTM evaluated on the same National Stock Exchange series, packaged as a web application for interactive comparison.

LSTMARIMAProphet
View repository →

Q-Learning Agent for Snake

A tabular Q-learning agent that learns a food-seeking, self-avoiding policy from scratch. The state space is small enough that every transition can be inspected, which is precisely the appeal as a study of exploration and reward shaping.

Reinforcement learningPython
View repository →

Neuroevolution for Obstacle Avoidance

The Chrome dinosaur game solved by genetic algorithm: a population of controllers mutated and selected on fitness until competent obstacle avoidance emerges without a single gradient step.

Genetic algorithmsPython
View repository →

Pathfinding Visualizer

Dijkstra's algorithm and A* rendered step by step, so that the effect of an admissible heuristic on the explored frontier is something one observes rather than something one is told.

AlgorithmsPyGame
View repository →

Real-Time Sudoku Solver

A Java application that reads a Sudoku grid and solves it under a graphical interface, animating the backtracking search as constraints propagate and branches are pruned.

JavaBacktrackingGUI
View repository →

Tetris & Ping Pong in C++

Two arcade classics rebuilt with Raylib: game loop, collision resolution, scoring, and input handling written from scratch. An exercise in the fact that competitive-programming C++ and real-time systems C++ are different disciplines.

C++RaylibReal-time loops
View repository →

Styx Shopping Cart

A complete React shopping-cart application with state management, cart persistence, and a deployed production build, written to understand client-side state properly rather than by convention.

ReactJavaScript
View repository →

Research Papers

Manuscripts and supporting material for the published work, collected in one repository for readers without institutional access to Springer.

SpringerNLPForecasting
View repository →

Further Work

Competitive programming, algorithms coursework from CSCI 570, datasets, and the ordinary accumulation of experiments that did not become projects but taught something anyway.

C++PythonJava
Browse GitHub →

08 Technical Background

Machine Learning
PyTorchTransformersMultimodal fusionLLMs & RAG DPO & preference tuningQLoRA / PEFTAdversarial robustness XGBoostLightGBMSHAPTime-series forecasting
Languages
PythonC / C++SQLRJavaJavaScript
Infrastructure & Data
AWS BedrockSnowflakeDatabricksDataiku ChromaDBpandasNumPyGit
Quantitative Methods
A/B testingROI modelingMarketing mix modeling TableauPower BIMatplotlibSeaborn

Get in touch

I am glad to hear about research collaborations, full-time machine learning roles, and doctoral opportunities in multimodal learning, model alignment, and robustness. Email is the surest way to reach me.