Reinforcement Learning · Generative Models · Stochastic Processes

Soohyun Choi

Integrated M.S./Ph.D. student in Electronic Engineering at Hanyang University
Information and Intelligence Systems Lab (IISL) · Advisor: Prof. Songnam Hong

My research interests lie in reinforcement learning, particularly in the mathematical and geometric analysis of learning algorithms. I am also interested in developing new algorithms and modeling frameworks using generative models and stochastic processes, especially for goal-conditioned and long-horizon control. Building on PathBridger, I am currently investigating reusable skill learning and composition, alongside bridge generation in learned, geometrically structured latent spaces.

Portrait of Soohyun Choi

Selected research

Preprint 2026

PathBridger: Subgoal Bridges for Offline Goal-Conditioned Reinforcement Learning

Soohyun Choi, Seonvin Cho, and Songnam Hong

PathBridger plans across long horizons by selecting an intermediate subgoal, constructing a plausible bridge in state space, decoding the bridge into short executable action chunks with inverse dynamics, and replanning during execution. The method is evaluated on OGBench navigation and manipulation tasks.

Preprint 2026

Is One Step Enough for Offline Policy Improvement?

Soohyun Choi*, Seonvin Cho*, and Songnam Hong†

*Equal contribution · †Corresponding author

Multi-step Proximal Policy Improvement (MPI) composes re-centered proximal policy updates. The revised paper distinguishes subdivision of a fixed nominal total horizon T into K stages with local horizon T/K from additional refinement at a common local horizon. It studies how re-centering, geometry, and critic error affect policy improvement, with deterministic TD3+BC and Gaussian IQL extraction experiments.

Preprint 2026

Role-Adaptive Policy Optimization for Offline Reinforcement Learning

Seonvin Cho, Soohyun Choi, and Songnam Hong

RAPO learns policy-update coefficients by differentiating through candidate updates and evaluating them according to their role. For TD3+BC, it separates execution and bootstrap actors, using a local improvement surrogate for execution and target stability for bootstrapping. For IQL, it retains the original value updates and adapts only the inverse temperature of advantage-weighted policy extraction. Experiments cover D4RL locomotion and AntMaze tasks.

Technical report 2024 · revised 2026

ALARM: Attention and Line Search Based Analog Circuit Optimization on a Riemannian Manifold

Soohyun Choi, Minseok Oh, and Ickhyun Song

ALARM treats circuits with the same designer-selected performance as an equivalence class and combines the induced quotient geometry with an attention-weighted coordinate lift and backtracking line search. In the archived active-inductor VCO study, it met the target in 10/10 runs using 33.2 SPICE evaluations on average.

Ongoing research

Extensions of PathBridger

Skill Learning and Composition: Investigating how to learn reusable skills from offline trajectories and compose them for long-horizon goal-conditioned tasks.

Latent-Space Bridge Planning: Exploring learned representations and geometrically structured latent spaces for goal-conditioned bridge generation and short-horizon execution.

Additional research

Industry-sponsored research 2024–2025

REACT: Recursive Algorithm for RC Network Transfer Functions

Soohyun Choi, Joonghoon Lee, Sunggu Lim, Heatbit Park, Songnam Hong, and Jaeduk Han

First-author research conducted through an SK hynix–Hanyang University project. REACT develops a recursive closed-form transfer-function method for arbitrary RC trees and a dominant-pole reduced-order approximation validated against SPICE.

Background

Education & experience

2024–Present
Integrated M.S./Ph.D. Student
Electronic Engineering, Hanyang University
IISL · Advisor: Prof. Songnam Hong
2018–2024
B.S. in Electronic Engineering
Hanyang University
2024–2025
SK hynix–Hanyang University Research Project
Research participant, IISL
Fall 2025
BK Research Assistant
Hanyang University

Selected honors

  • Top Excellence Award Hanyang Electronics and Information Communications Alumni Association Special Award · 2023
  • Top Excellence Award, 15th Capstone Design Fair Hanyang University · 2023
  • Graduation Honors Hanyang University · 2024
  • BK Research Assistantship Fall 2025

Selected coursework

Learning & Control
Machine Learning · Robot Learning · Advanced Optimal Control Theory

Probability & Analysis
Probability and Statistics · Stochastic Processes · Uncertainty Quantification · Functional Analysis I