CS422: Interactive and Embodied Learning

Syllabus and readings

Required readings in bold; others supplementary. As an alternative to covering the one or two assigned papers, presenters should feel free to present on the general topic domain using the primary and supplementary readings (or even suggest their own!). The supplementary lists can get quite long -- this is not meant to be imposing! We simply think that each represents a handy constellation of papers for those interested in getting more acquainted with each subarea. We will provide a roadmap as we go with overviews in class. Feel free to ask for more context at any time.

Please see these guidelines for giving a good talk. Every student is responsible for doing all required readings. Please come prepared to discuss, and come being able to describe background, methodology, experimental setups, and key results (for experimental papers). For non-experimental papers, be prepared to discuss the background and each key idea.

Introduction

Class 1 (Jan 5): Introduction, logistics.

Minimo
Quiet-STaR

Rethinking self-supervision

Class 2 (Jan 12): Rethinking self-supervision, 1

Revisiting the Scaling Properties of Downstream Metrics in Large Language Model Training
Data-efficient pretraining

No project presentations – class ends at 5:00

Class 3 (Jan 26): Rethinking self-supervision, 2

EBM
TTT
    Supplementary: Looped Transformers

Class 4 (Feb 2): Rethinking self-supervision, 3

In-context pretraining
    Supplementary: SBP
LMLM

Play

Class 5 (Feb 9): Play

RL for pretraining
SPICE
    Supplementary: RLVE, RARO

Social reasoning

Class 6 (Feb 23): Social reasoning

ConfAIde
    Supplementary: CIMemories
Language and experience

Intrinsic motivation, in the LLM era, and synthesis discussion

Class 7 (Mar 2): Intrinsic motivation, in the LLM era, and synthesis discussion

Magellan

Final presentations

Class 8 (Mar 9): Final presentations