I’m a research scientist and founding member of OpenAI. I co-lead the reinforcement learning (RL) team, where we work on (1) developing RL algorithms that can learn new skills faster and in more general situations; (2) designing training environments that lead to transferrable skills. We mostly use games as a testbed. Previously, I received my PhD in Computer Science from UC Berkeley, where I had the good fortune of being advised by Pieter Abbeel.
Prior to my recent work in RL, I spent some time working on robotics, enabling robots to tie knots and plan movement using trajectory optimization. Before that, I did a brief stint in neuroscience at Berkeley before switching to machine learning, and before that, I studied physics at Caltech.
Outside of work, I enjoy running, playing jazz piano, and reading sci-fi.