Problem Statement:
I have a simple Django app which scrapes product data from an online store. What I need is to add a CSV import and export functionality in my administration area and add custom commands (i.e. python manage.py [custom_command] ) that will only trigger for certain group of products in my list.
Solution:
Web scrapping : Web scraping, web harvesting, or web data extraction is data scraping used for extracting data from websites.
why web scrapping:
Most of the website doesn't provide API for data access then concept of web scrapping came into existence
Challenges:
The main challenge of web scrapping is that data is not available in correct format, extracting data from website is not hard if you have single page website link then you can easily get data. but what when data is scattered on more than 1000 pages. so main concern here is to scrap data and prepare then in the correct so that it can useful for your need or business.
If you like Codersarts blog and looking for Assignment help,Project help, Programming tutors help and suggestion you can send mail at contact@codersarts.com.
Please write your suggestion in comment section below if you find anything incorrect in this blog post.
Comments