Well, the selector works, it just doesn't give you what you want:
According to jQuery Docs .prev([expr]) :
Get a set of elements containing unique previous siblings of each of the agreed set of elements. Use an optional expression to filter a consistent set. Only immediately the previous sibling returns, not all previous brothers and sisters.
: $(elem).prev("div.a").find('.b') DOM, div.a - .find() .b
: $(elem).prev("div.a .b") , div.a .b .
.