Deeper Learning

A smarter way to navigate complex drug decisions

The authors introduce TxAgent: a first of its kind AI agent for therapeutic reasoning across a universe of 211 tools, with a comparison against DeepSeek-R1 671B.

• Preprint
• TxAgent code
• ToolUniverse code
• Project website
• Huggingface

The authors find that Archetypal SAE anchors concepts in the real data’s convex hull and delivers consistent and stable dictionaries.

• Preprint
• Code

Through the use of recurrent neural networks trained to solve tasks requiring the integration of global information, but with constrained local connectivity, the authors find neurons learn to encode and transmit information to other spatially distant neurons through traveling waves.

• Preprint
• Repository

The authors use a new way of measuring the conceptual diversity of synthetically-generated LLM “populations” to investigate whether LLMs capture the conceptual diversity of human populations.

The authors introduce ProCyon, a multimodal foundation model to model, generate, and predict protein phenotypes.

• Preprint
• GitHub
• Project website
• Dataset

Scaling Laws for all Datasets

The authors develop a method to predict how large language models scale with compute across different datasets, enabling more efficient training and better understanding of data-compute tradeoffs.

• Preprint
• Training code
• Notebooks
• Huggingface models
• TMLR referee report

The authors empirically show that the critical batch size for pre-training scales with data size rather than model size, followed by theoretical justifications for it.

• Preprint

The authors demonstrate, through theory and experiments, that in MoEs, experts improve memorization more than reasoning.

• Preprint

The authors introduce an updated framework for understanding visual object recognition and category selectivity: contrastive coding.

• Paper

Introducing PINNACLE, a novel contextual AI model for single-cell protein biology that supports a broad array of biomedicalAI tasks by tailoring outputs to the cell type context in which the model makes predictions.

• Paper
• Research Briefing
• Code
• Project website
• Demo