svijayb / steam_webscraper Goto Github PK

View Code? Open in Web Editor NEW

13.0 1.0 3.0 536 KB

An application built to monitor CS:GO prices on the Steam market

Home Page: http://vijaybalaji.me/Steam_WebScraper/

License: MIT License

Python 100.00%

steam-api webscraper steammarket csgo-items csgo csgo-market csgo-skins

steam_webscraper's Introduction

Steam_WebScraper

A simple App to monitor prices on the Steam market

Motivation
Usage
Contributing
License

Motivation

This application was built to monitor Steam market value changes of all CSGO Items. It was an attempt at learning the basics of Web Scraping

It helps in obtaining an item at a lower price than normal. i.e., It notifies the user when the product value decreases below the desired price. Hence saving money and time that goes wasted on waiting for the prices to fall.

Usage

For the latest Stable version, go to Releases

As an alternative, you could also clone this repository using,

git clone https://github.com/SVijayB/Steam_WebScraper.git

Extract the files and run Update.py file present in the src folder.
This is to update your local data (Item skin names).

Once the update is completed, run the Steam_WebScraper.py file present in the src folder.

Now, just follow the instructions provided by the application.

NOTE : Update your local data using the Update.py file after every new CSGO case releases in order to view all the latest skins.

Gmail Notification

In case you want to be notified via mail when price falls down, follow the below steps :

Create a Gmail Account, if you don't have one already.
Sign into your Google account.
Next, go to your Google account Security Settings.
Click on the Less secure app access setting.
Set Allow less secure apps to ON
Next, Open your Gmail account.
Click on Gmail Settings.
Now, click on the Forwarding and POP/IMAP tab.
Under POP download section, Click on Enable POP for all mail.
Under IMAP access section, Click on Enable IMAP.

Contributing

To contribute to Steam_WebScrapper, fork the repository, create a new branch and send us a pull request. Make sure you read CONTRIBUTING.md before sending us Pull requests.

Also, thanks for contributing to Open-source!

License

Steam Web Scraper is under The MIT License. Read the LICENSE file for more information.

steam_webscraper's People

Contributors

Stargazers

Watchers

Forkers

atvc19ec lundsteve dadscap

steam_webscraper's Issues

Unable to convert String to Float

Exception has occurred: ValueError
could not convert string to float: 
  File "D:\CSE\Steam_WebScraper\Steam_WebScraper.py", line 50, in main
    price = float(sub(r'[^\d.]', '', item.price))
  File "D:\CSE\Steam_WebScraper\Steam_WebScraper.py", line 61, in 
    main()

When I use the same code on Python command-line Interpreter, it seems to work perfectly.
price = float(sub(r'[^\d.]', '', item.price))

When I ran it on command-line :

>>> from re import sub
>>> money = "$573,975,73.84"
>>> price = float(sub(r'[^\d.]', '', money))
>>> print(price)
57397573.84
>>>

Sending a Mail when condition matches

Once the Price falls below the mentioned price level, the program automatically mails you.

Provide Item names to choose from

Feature Description :

As of right now the application works when the user provides(enters) the item name.
If a list of names of the skins for the item is displayed, like the names of the items itself, it would be much more useful.
Especially since the API used is case sensitive and requires item names to be precise.

Exchange API now requires a key

Description

Exchange rate API requires a key now.
This means users will have to sign up for a free account and get an API key.

Expected Behavior

The API was available without a key and functionalities were direct, i.e., the user did not have to create or use a key.

Actual Behavior

Now, the user is expected to create an API key by signing up to excahangerateapi.

Possible Fix

Find a different API for currency conversion.
Update the currency module as per latest changes to the API.

Steps to Reproduce

Irrespective of the platform or functionalities, the bug would exist. Probably work on building out test modules.

Your Environment

Version used: v2.0.0
Operating System and version: Ubuntu 20.04

Converting to the correct Currency type.

Right now the data of the price extracted is of a different currency. Have to convert it to INR or USD.

Auto update data

Updating local data automatically after either a new cs:go case is released or the number of days since the previous update crosses a certain number.
Can verify previous date and request for update every time the main program is launched instead of making the user update first and then use the application.
Can automate the process for the repository to keep it updated from time to time.

Build an API

Build an API that takes in queries and returns desired item's current pricing in the market.

This would help in easier use of the product and increase it's scalability.
If item name is provided -> Return skins for all of the items with all the quality.
If skin name is provided -> Return with all the quality types for that skin.
Else specific items with qualities can also be retrieved.

Adding a Currency Converter

Adding a Currency Converter to the program to convert currency type from USD to any desired currency type.