Molecular chaperones are indispensable proteins that assist the folding of aggregation-prone proteins into their functional native states, thereby maintaining organized cellular systems. Two of the best characterized chaperones are the Escherichia coli chaperonins GroEL and GroES (GroE), for which in vivo obligate substrates have been identified by proteome-wide experiments. These substrates comprise various proteins, but exhibit remarkable structural features. They include a number of α/β proteins, particularly those adopting the TIM β/α barrel fold. This observation led us to speculate that GroE obligate substrates share a structural motif. Based on this hypothesis, we exhaustively compared substrate structures with the MICAN alignment tool, which detects common structural patterns while ignoring the connectivity or orientation of secondary structural elements. We selected four (or five) substructures with hydrophobic indices that were mostly included in substrates and excluded in others, and developed a GroE obligate substrate discriminator. The substructures are structurally similar and superimposable on the 2-layer 2α4β sandwich, the most popular protein substructure, implying that targeting this structural pattern is a useful strategy for GroE to assist numerous proteins. Seventeen false positives predicted by our methods were experimentally examined using GroE-depleted cells, and 9 proteins were confirmed to be novel GroE obligate substrates. Together, these results demonstrate the utility of our common-substructure hypothesis and prediction method.