Extract text from multiple span elements without classes - using BeautifulSoup

Question

This is what the HTML looks like:

<p class="details">
<span>detail1</span>
<span class="number">1</span>
<span>detail2</span>
<span>detail3</span>
</p>

I need to extract detail2 and detail3.

But using this code, I can only get detail1.

info = data.find("p", class_ = "details").span.text

How do I extract the required items?

Thanks in advance!

Answer 1

In your case, select a more specific element, i.e. select all sibling elements of a element with class number:

soup.select('span.number ~ span')

Example

from bs4 import BeautifulSoup
html='''<p class="details">
<span>detail1</span>
<span class="number">1</span>
<span>detail2</span>
<span>detail3</span>
</p>'''
soup = BeautifulSoup(html)

[t.text for t in soup.select('span.number ~ span')]

Output

['detail2', 'detail3']

Answer 2

You can find all <span> and do a normal index:

from bs4 import BeautifulSoup

html_doc = """\
<p class="details">
<span>detail1</span>
<span class="number">1</span>
<span>detail2</span>
<span>detail3</span>
</p>"""

soup = BeautifulSoup(html_doc, "html.parser")

spans = soup.find("p", class_="details").find_all("span")

for s in spans[-2:]:
    print(s.text)

Output result:

detail2
detail3

---

Or use CSS selector:

spans = soup.select(".details span:nth-last-of-type(-n+2)")

for s in spans:
    print(s.text)

Output result:

detail2
detail3