Sparse Mixture of Experts
Scaling language models efficiently through conditional computation and dynamic routing mechanisms.
Foundation ModelsEfficiency
Circuit Analysis
Identifying computational subgraphs that implement specific behaviors in neural networks.
InterpretabilityMechanistic
Constitutional AI
Training models to follow principles and self-correct without extensive human feedback.
AlignmentSafety