I am currently starting to use beautifulsoup to clean websites, I think I have the basics, although I do not have theoretical knowledge about web pages, I will do my best to formulate my question.
What I mean with a dynamic webpage is this: a site whose HTML changes based on user action, in my case, it's collapsible tables.
I want to get the data inside some div tag, but when the page loads, the data seems to be inaccessible in the html code, when you click on the table that it expands, and the “class” of this “div” changes from something like “something blabla collapsible "on" something blabla collapsible active ", and I can clear it with my knowledge.
Can I get this data using beautifulsoup? In case I cannot, I thought of using something like selenium to click on all the tables and then load the html that I could clear, is there an easier way?
Many thanks.
source
share