Learning To Lead Adaptively