Question 19 of 20 Advanced Interpretation
When should a pathway enrichment result be treated as exploratory rather than mechanistic evidence?
Short answer
Nearly always when it stands alone. Enrichment shows a gene list overlaps an annotated set more than expected against a chosen background, and that expectation is biased by gene length, detectability and tissue identity. It supports mechanism only alongside a direct experiment.
Why
An over-representation test asks whether more genes from a pathway sit in your hit list than chance would predict. Chance depends on the background, the set of genes that could have been called. A survey of 186 articles found that 95 percent of over-representation analyses did not use an appropriate background or did not describe it, and 43 percent did not correct for testing many gene sets.
Using the whole genome as background for a tissue makes tissue-typical pathways look enriched, because only expressed genes can ever be called. Timmons and colleagues show liver GO terms appearing for what was simply a list of liver-expressed genes. RNA-seq adds length bias: longer genes have more power to be called, and goseq corrects the test for it.
Even a carefully done enrichment only says the list resembles a pathway's membership. It does not show the pathway's activity changed, which direction it changed, or that it causes the phenotype. Treat it as a ranked set of hypotheses, then test the strongest with perturbation, protein or activity measurements.
A strong answer covers
- The background must be the genes that could have been detected
- Correct for the many gene sets tested
- Length and detection bias favor some categories
- Overlap with a gene set is not evidence of pathway activity or causation
Common mistakes
- Using the whole genome as background for a tissue RNA-seq study
- Reporting nominal enrichment p-values without correction
- Writing that a pathway is activated because its genes are over-represented
The interviewer might ask next
What experiment would you design to test the top pathway hypothesis from an enrichment result?