An extension line that is off is not displayed, of course. To identify it, snap to a point between the end of the dimension line and the point on the element that it dimensions. If you have difficulty locating the extension line, toggle all the dimension's extension lines, and turn off the one that you want on, and toggle all the extension lines again.

When the extension line is identified, it is highlighted.