The café wall pattern is composed of rows of alternating light and dark tiles, and alternate rows are shifted by one fourth of a cycle. The rows of tiles are separated by narrow horizontal mortar lines whose luminance is between those of the dark and the light tiles. Although the mortar lines are physically parallel, they are perceived to be tilted, which is known as the café wall illusion. In this study, an energy-based model for encoding orientation is implemented in order to estimate the strength of the café wall illusion, and it is shown that the estimated orientation depends on the spatial frequency to which each orientation-encoding unit is tuned. The estimation of mortar line orientation from an orientation-encoding unit tuned to a lower spatial frequency was greater than that from a unit tuned to a higher spatial frequency. It is assumed that the perceived mortar line orientation is the result of an integration of responses from the orientation-encoding units tuned to various spatial frequencies. This leads to the prediction that under viewing conditions in which responses from orientation-encoding units tuned to a higher spatial frequency are presumably weakened, the strength of the café wall illusion increases. In agreement with this prediction, it is shown that the café wall illusion is stronger when the café wall image is presented at the periphery or is observed under low luminance levels. On the other hand, the weighted averaging of the estimated mortar orientations across spatial frequencies overestimates the perceived orientation of the mortar lines. This suggests that the final percept of the café wall illusion could be determined by some kind of nonlinear interaction, such as an inhibitory interaction, between orientation-encoding units.