Yes, by definition. The search for the optimal solution entails a proof of optimality. This can be done by finding all the solutions or by proving that no solution can have a higher value than the one that has already been found. In any case, at least one solution must be found.
If there is no solution, neither the optimal nor the complete algorithm will be found, of course.