Image

Hanseok Oh

Computer Science Ph.D. Student at NYU

hanseok.pro@gmail.com

About
Hello! I am an incoming Computer Science Ph.D. student at New York University (NYU) working with Professor Muhammad Shafique. I am broadly interested in building intelligent agents that can perceive and interact with the world around us. More specifically, I am currently interested in exploring Wearable and On-device Agents. I believe that for AI to truly mirror human perception, it must move toward multisensory intelligence—leveraging sensors and the "five senses" captured directly from the physical world. Furthermore, I am convinced that agents capable of integrating our digital and physical worlds will become increasingly vital, with embedded agents playing a central role in this evolution.
News
June 2025     Starting a Computer Science Ph.D in New York University! I'll work on Embedded / Wearable Agents!
June 2025     Starting a new position as a visiting reseracher in Mila! I'll work on conversational AgeticRAG!
May 2025     Our BiGGen Bench paper was selected for the Best Paper Award at NAACL 2025!
May 2024     Starting a new position as a Research Engineer at SoftlyAI/b>!
Feb 2024     Our Ktrl+F paper has been accepted to NAACL 2024! See you in Mexico :).
Feb 2024     Currently seeking opportunities in a research scientist/engineer role.
Feb 2024     New preprint INSTRUCTIR is out!
Nov 2023     New preprint Ktrl+F is out!
Sep 2023     Joining LG AI research as a Research Intern!
May 2023     Our Nonparametric Decoding for Generative Retrieval has been accepted to ACL 2023 Findings!
Feb 2023     Our Structured abstract summarization of scientific articles: Summarization using full-text section information paper has been accepted to JASIST 2022!
October 2022     Our Generative Multi-hop Retrieval paper has been accepted to EMNLP 2022! See you in Abu Dhabi (12.7 - 12.12) :)
Jan 2022     Our team got a 1st place at ICCV 2021 VALUE Challenge Retrieval Track! ViSeRet paper has been accepted to ICCV 2021 Workshop on Closing the Loop between Vision and Language (CLVL)!

Education

New York University (NYU) Jul. 2026 - present

Ph.D Student (advisor: Muhammad Shafique)

Korea Advanced Institute of Science and Technology (KAIST) Sep. 2021 - Feb. 2024

M.S. Student (advisor: Minjoon Seo)

Sungkyunkwan UniversityMar. 2014 - Aug. 2020

B.S. of Data Science & B.A. in Child and Adolescent education

Publications

Subject-level Inference for Realistic Text Anonymization Evaluation

Myeong Seok Oh, Dong-Yun Kim, Hanseok Oh, Chaean Kang, Joeun Kang, Xiaonan Wang, Hyunjung Park, Young Cheol Jung, Hansaem Kim

ACL 2026

Paper

Instruction Tuning with and without Context: Behavioral Shifts and Downstream Impact

Hyunji Lee, Seunghyun Yoon, Yunjae Won, Hanseok Oh, Geewook Kim, Trung Bui, Franck Dernoncourt, Elias Stengel-Eskin, Mohit Bansal, Minjoon Seo

EACL 2026

Paper

The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models

Seungone Kim, Juyoung Suk, Ji Yong Cho, Shayne Longpre, Chaeeun Kim, Dongkeun Yoon, Guijin Son, Yejin Cho, Sheikh Shafayat, Jinheon Baek, Sue Hyun Park, Hyeonbin Hwang, Jinkyung Jo, Hyowon Cho, Haebin Shin, Seongyun Lee, Hanseok Oh, Noah Lee, Namgyu Ho, Se June Joo, Miyoung Ko, Yoonjoo Lee, Hyungjoo Chae, Jamin Shin, Joel Jang, Seonghyeon Ye, Bill Yuchen Lin, Sean Welleck, Graham Neubig, Moontae Lee, Kyungjae Lee, Minjoon Seo

NAACL 2025 (Best Paper Award)

Paper

INSTRUCTIR: A Benchmark for Instruction Following of Information Retrieval Models

Hanseok Oh, Hyunji Lee, Seonghyeon Ye, Haebin Shin, Hansol Jang, Changwook Jun, Minjoon Seo

ACL 2024 Workshop on Knowledge-Augmented NLP (KnowledgeNLP)

Paper Code Twitter

Ktrl+F: Knowledge-Augmented In-Document Search

Hanseok Oh*, Haebin Shin*, Miyoung Ko, Hyunji Lee, Minjoon Seo

NAACL 2024

Paper Code Twitter

Zero-Shot Dense Video Captioning by Jointly Optimizing Text and Moment

Yongrae Jo, Seongyun Lee, Aiden SJ Lee, Hyunji Lee, Hanseok Oh, Minjoon Seo

Preprint

Paper

Structured Abstract Summarization of Scientific Articles: Summarization Using Full-text Section Information

Hanseok Oh, Seojin Nam, Yongjun Zhu

JASIST (2022)

Paper

Nonparametric Decoding for Generative Retrieval

Hyunji Lee, Jaeyoung Kim, Hoyeon Chang, Hanseok Oh, Sohee Yang, Vlad Karpukhin, Yi Lu, Minjoon Seo

ACL 2023 Findings

Paper

Generative Multi-hop Retrieval

Hyunji Lee, Sohee Yang, Hanseok Oh, Minjoon Seo

EMNLP 2022

Paper Code Twitter

ViSeRet: A simple yet effective approach to moment retrieval via fine-grained video segmentation

Aiden Seungjoon Lee, Hanseok Oh, Minjoon Seo

ICCV 2021 Workshop on Closing the Loop between Vision and Language (CLVL)

Paper
( * indicates equal contribution )

Vitæ

  • NYU eBRAIN lab Upcoming
    Ph.D Student (Advisor: Muhammad Shafique)
    Working on embedded and wearable agents.
  • Mila Jun. 2025 - Mar. 2026
    Visiting Researcher (Advisor: Siva Reddy)
    Working on building benchmark for multimodal information-seeking agents in the wild.
  • SoftlyAI May. 2024 - May. 2025
    Research Engineer
    Building conversational agentic RAG engines for real world domain (e.g., Clinical coordination).
  • LG AI Research Sep. 2023 - Feb. 2024
    Research Intern
    Worked on an evaluation benchmark, InstructIR, for measuring user-aligned instance-wise instruction following ability of information retrieval.
  • KAIST Language & Knowledge Lab Sep. 2021 - Feb. 2024
    M.S. Student (Advisor: Minjoon Seo)
    Thesis: Ktrl+F: Knowledge-Augmented In-Document Search
  • Kakao Enterprise Jul. 2020 - Oct. 2020
    Machine Learninig Engineer Intern
    Worked on large-scale knoweldge graph embedding.
  • NAVER Mar. 2020 - Jun. 2020
    Software Engineer Intern
    Worked on entity linking engine for the search system.
  • Sungkyunkwan University Mar. 2014 - Aug. 2020
    B.S. of Data Science & B.A. in Child and Adolescent education
Hanseok Oh
Last updated on May 26, 2026