Deeper Learning

The author introduces the first flow equivariant models that respect motion symmetries, leading to significantly improved generalization and sequence modeling.

• Preprint
• Code

Diffusion models are powerful generative frameworks that iteratively denoise white noise into structured data via learned score functions. Through theory and experiments, the authors demonstrate that these score functions are dominated by a linear Gaussian component.

• Preprint
• OpenReview

Kempner researchers present a new algorithm for offline reinforcement learning that features a key property: self-consistency.

• Preprint
• Code

The authors uncover consistent training instabilities when using new, highly efficient low-precision formats, which has implications for the development of next-generation AI. By pinpointing the root causes of these failures and demonstrating effective mitigation strategies, this work offers crucial insights into enabling more cost-effective and scalable model training on future hardware.

• Preprint
• Code

The authors show that SAEs are inherently biased toward detecting only a subset of concepts in model activations shaped by their internal assumptions, highlighting the need for concept geometry-aware design of novel SAE architectures.

• Preprint
• Code (synthetic expt.)
• Code (formal lang. expt.)
• Code (vision expt.)

The authors present ATOMICA, a representation learning model that captures intermolecular interactions across all molecular modalities—proteins, nucleic acids, small molecules, and ions—at atomic resolution.

• Paper
• GitHub
• Huggingface

The authors find a sparse linear structure within VLM embedding spaces that is shaped by modality, yet stitched together through latent bridges—offering new insight into how multimodal meaning is constructed.

• Paper
• Demo

Backtracking is widely believed to improve reasoning by letting LLMs “fix their mistakes.” But is it always the best way to use test-time compute? The authors show that backtracking is not a one-size-fits-all solution: It depends on the task structure, model scale, and training paradigm.

• Paper
• Code

The researchers describe DUNL (Deconvolutional Unrolled Neural Learning), a novel framework for understanding how neurons encode information when they respond to multiple factors simultaneously.

• Paper
• Code

A smarter way to navigate complex drug decisions

The authors introduce TxAgent: a first of its kind AI agent for therapeutic reasoning across a universe of 211 tools, with a comparison against DeepSeek-R1 671B.

• Preprint
• TxAgent code
• ToolUniverse code
• Project website
• Huggingface