In this week’s AI ∩ Bio paper, we look at a multi-dataset benchmark where deep learning models trained to predict single-cell perturbation outcomes did not outperform two deliberately simple baselines: “assume nothing changes” and “predict the additive combination of single perturbations.” Performance improved when models were reduced to just their internal embeddings and a linear decoder—no deep layers, just a direct projection from embedding space to gene expression. In other words, the models had learned biologically meaningful representations during training, but using those representations to make predictions through a complex decoder often made things worse.
This result may not surprise those familiar with traditional machine learning approaches. As the bias–variance tradeoff reminds us: when signal is weak and noise is high, simpler models often generalize better and overfit less, leading them to outperform more complex alternatives.
This study revealed both conditions:
- The signal from genetic perturbations is often modest or additive.
- The noise in single-cell gene expression is high, due to dropout, amplification bias, and biological variability.
If your model must detect subtle shifts in expression, but your measurement system is saturated with noise, then even an optimal model will struggle to generate meaningful predictions. And a large model may do worse, because it fits spurious correlations that simpler models ignore.
Before adding more architecture, it’s worth asking:
- Have we clearly defined our outcome?
- Do we understand the system we are working with?
- Can our data realistically support the question we’re asking?
Otherwise, we risk building a computational Rube Goldberg machine: impressive, fragile, and ultimately unclear.