BeautifulSoup cannot find a tag by class

Question

Here is the part of the web page:

<div class="MPinfo"> <ul class="frontList"> <li>some text</li> <li>some text</li> <li>some text</li> <li>some text</li> <li>some text</li> <li>some text <a href="/some_local_link/8976">some text</a>; <a href="/some_local_link/8943">some text</a>; </li> <li>E-mail: <a href="mailto: [e-mail] "> [e-mail] </a> </li> </ul> </div> 

I am trying to get a div by its class and then extract the link by email only for sending by email, for example: [e-mail]

 page = urllib.urlopen(link) soup = BeautifulSoup(page.read()) print soup.find('div', attrs={'class': 'MPinfo'}) 

I tried several ways to get a div, but it returns an empty list or None

Answer 1

You can select all li under the div, it will be a list, so you can select the last li element, for example [-1]

 >>> soup.find("div",attrs={"class":"MPinfo"}).find_all("li")[-1].a.text ' [e-mail] '