Yet another scrappy crawler for beginners to comprehend scrappy functions in general and to understand how login works by tweaking intermediate URLs that website itself uses for authenticating users.
Required repositories:
- Python 2.7
- Scrapy 1.5.x
Crawler fetches following fields:
- Post URL
- Post Title
- Price
- Product Notes (Html)
- Cross Ref. Number
- Manufacturer
- Category
- Product Code
- Current Image
- Remaining Images