One of the most sought-after skills on Fiverr and Upwork is web scraping .
Make no mistake: extracting data programmatically from web sites is a critical life-skill in today’s world that’s shaped by the web and remote work.
This course teaches you the ins and outs of Python’s BeautifulSoup library for web scraping.
Hi,
Thanks for this interesting course.
Can you help on how to scrap a website using JavaScript ?
I tried to apply on a website, but do not get the same result in my “soup” compared to what i am seeing on the webpage using :
import webbrowser
webbrowser.open(url, new=2)
I think JavaScript is the issue.
Yes, this could actually be the case. You can use the module requests_html as shown here: http://theautomatic.net/2019/01/19/scraping-data-from-javascript-webpage-python/
But first think about whether you actually want to go through the pain. 😉
This Web Scraping with BeautifulSoup is fine. I wish you could structure better and offer a graphic analysis and transfer the data to DATA BASE using sql queries to transform into metadata to create new information. It feels a little bit basic.