thebench.bio #1 Ecosystem for the Bio-Tech Industry
All Sequence Alignment questions

Question 15 of 20 Intermediate Practical

How would you test whether a weak pairwise protein alignment reflects real homology?

Short answer

Check its statistical significance rather than its percent identity, then confirm the estimate by aligning the query to shuffled versions of the target and to proteins known to be unrelated. If those controls also score as significant, the claimed relationship is suspect.

Why

Percent identity is a poor test of homology. Pearson notes that the common rule of 30 percent identity misses many easily detected homologs, and that short alignments reach much higher identity by chance. The test is excess similarity, measured by an E-value or bit score from an accurate statistical model.

For proteins, an E-value below 0.001 can reliably support homology, and about 50 bits is almost always significant for average-length proteins. Statistics can still go wrong for unusual sequences, so two checks help. The first is to align the query with proteins known to be unrelated, for example ones with different domains.

Accurate statistics should give them E-values near 1. If they score below 0.001 to 0.01, the new relationship is suspect. The second is to shuffle the target, keeping length and composition, and see how often the shuffled sequence scores as well as the real one.

Pearson recommends shuffles that preserve local composition, such as reversing the sequence or shuffling within windows, because a global shuffle can be too easy to beat for sequences with biased composition.

How to work it through

  1. Run a search with an accurate statistical method and note the E-value and bit score.
  2. Align the query with several proteins known to be unrelated and check that their E-values are near 1.
  3. Generate a set of shuffled targets that preserve local composition, such as windowed shuffles or the reversed sequence.
  4. Score the query against each shuffled target and see where the real score falls.
  5. Check that the alignment is not confined to a low-complexity or repetitive segment.
  6. Look for supporting evidence, such as conserved key residues or a profile search.

An example

A query aligns to a candidate with 24 percent identity over 180 residues, E-value 2e-4. Six unrelated proteins with different domains score E-values from 0.8 to 6. Two hundred windowed shuffles of the candidate give a best E-value of 0.05.

The real alignment also keeps the family's catalytic triad, and an HMM search confirms the relationship with an E-value of 1e-9.

Where the answer stops holding

Shuffled sequences are an imperfect stand-in for real proteins, especially those with repeats. A non-significant score does not prove two proteins are unrelated, because very distant homologs can fall below detection. Structural similarity can sometimes reveal relationships that sequence tests cannot.

A strong answer covers

  • Percent identity is not a test of homology
  • Use E-values or bit scores from accurate statistics
  • Unrelated proteins should score E-values near 1
  • Use shuffles that preserve local composition
  • Absence of significance does not prove non-homology

Common mistakes

  • Applying a fixed identity cutoff such as 30 percent
  • Shuffling globally for a sequence with strong compositional bias
  • Treating a non-significant result as proof of no shared ancestry