thebench.bio #1 Ecosystem for the Bio-Tech Industry
All Single-Cell Analysis questions

Question 10 of 20 Fundamentals Interpretation

Why should you not judge how similar two clusters are from their distance on a UMAP plot?

Short answer

UMAP and t-SNE squeeze thousands of dimensions into two and must distort distances to do it. They try to keep each cell's near neighbors close, but say little about the distance between separate islands, so cluster sizes and gaps are not measurements.

Why

Each cell is described by thousands of genes, or by 10 to 50 principal components after reduction. A two-dimensional picture cannot keep all those distances. The Bioconductor book explains that t-SNE and UMAP work hard to keep each cell's nearest neighbors together, so cells in one unbroken island were probably close in the full data.

It warns that nothing guarantees large distances are preserved, and that measuring gaps between islands to compare cell types would be courageous. Its advice is to cluster on the principal components and use the embedding only to display the result. Chari and Pachter went further in The specious art of single-cell genomics.

They found that even the neighbor sets in 2D embeddings differed strongly from those in the original space, with Jaccard distances above 0.8 on average, and argued that such plots are poor tools for quantitative conclusions. Settings matter too. Perplexity in t-SNE and the random seed change the picture, so the book suggests trying several values.

Use distances in PCA space, or marker genes, to compare clusters. Use the plot to see the overall layout and to color cells by a gene or a sample.

A strong answer covers

  • Reducing to two dimensions must distort distances
  • Local neighborhoods are the safest thing to read
  • Gaps between islands and island sizes are not measurements
  • Cluster and compare in PCA space, display in UMAP
  • Parameters and random seeds change the picture

Common mistakes

  • Clustering on UMAP coordinates instead of principal components
  • Concluding a cell type is more abundant because its island looks larger
  • Reading a gap between two islands as evidence they are unrelated