Skip to content

Project developed in the Entra21 Python Class - Using the Scrapy library as our framework, we perform a Web-Crawling on websites, to gather data such as price, date and amount of installments.

Notifications You must be signed in to change notification settings

ViniciusReisch/ScrapyProject

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ScrapyProject EN-US

README em PT-BR

Teamwork using the Scrapy framework

Scrapy is a free and open source web-crawling framework developed in Python

Program features:

  • Gather data (price, web-crawling date, number of installments)

  • Returns the smallest product value in a .txt file

How to download and run the project:

  • First, download the project from Github: git clone https://github.com/Flyinng/CRUD-Supermarket.

  • Then install the Scrapy library in your IDE.

  • In your IDE's terminal, use the command cd main and then the command cd spiders to access Crawler.

  • After that, in the terminal type the command scrapy crawl bs -O data.json.

  • This will gather all the product data in the respective stores, to get the lowest value run the refactor.py file.


📜Project developed in the Entra21 Python Class

About

Project developed in the Entra21 Python Class - Using the Scrapy library as our framework, we perform a Web-Crawling on websites, to gather data such as price, date and amount of installments.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages