contrevien / scrapgen Goto Github PK
View Code? Open in Web Editor NEWScrapGen is a "Web-Scraping scripts generator"; an interactive tool, making it easier for developers to scrape different websites.
ScrapGen is a "Web-Scraping scripts generator"; an interactive tool, making it easier for developers to scrape different websites.
Figure out how to change the logo/icon on the title bar of an Electron.js app and add a new logo/icon.
The title is self-explanatory. The kinds of errors that can arise are:
Document the UI, the features, the tools used and also the testing document.
A method to verify that the entered URL in the input element is in valid format.
The format of a URL could be:
www.xyz.com
xyz.com
https://xyz.com
https://www.xyz.com
Plus if the URL has a path to some file so each of the above mentioned can also have an optional following add-on:
/path/to/file.optionalExt
Display the name of the file on top of the Generation Area
A graph with visualized amount of effort that would be needed in each Sprint. Must show:
Getting 2 error -
Python version - 3.x
astroid==2.2.5
bottle==0.12.17
bottle-websocket==0.2.9
certifi==2019.6.16
cffi==1.12.3
Click==7.0
colorama==0.4.1
Eel==0.10.4
Flask==1.1.1
future==0.17.1
gevent==1.4.0
gevent-websocket==0.10.1
greenlet==0.4.15
isort==4.3.21
itsdangerous==1.1.0
Jinja2==2.10.1
lazy-object-proxy==1.4.2
MarkupSafe==1.1.1
mccabe==0.6.1
msgpack==0.6.1
pipenv==2018.11.26
pycparser==2.19
pylint==2.3.1
PyQt5==5.13.0
PyQt5-sip==4.19.18
pyqt5-tools==5.13.0.1.5
PySide2==5.13.1
PySimpleGUI==4.4.1
PySimpleGUIQt==0.28.0
PySimpleGUIWeb==0.28.1
PySimpleGUIWx==0.11.0
python-dotenv==0.10.3
pyzmq==18.1.0
remi==2019.4
selenium==3.141.0
shiboken2==5.13.1
six==1.12.0
typed-ast==1.4.0
urllib3==1.25.3
virtualenv==16.7.5
Just a normal loader for the user to wait at something while we scrape the website.
The Generation Area or The Editor will be a Python editor in which the generated script will be shown.
Features:
A reset button on top of the display area which when clicked must dis-select all the buttons
A Text Editor for Python. A bit of searching maybe required to choose an embedded editor for Python in our app.
Text editor will have:
These buttons are the primary display component of the Display Area and the App.
Features:
The buttons, when clicked on once, should be selected and a record for the buttons that are selected must be maintained.
Vice versa, the buttons must be removed from the list if the user clicks it again.
The URL Input component must have a "Press Enter to Send/Trigger" function such that as soon as the user is done typing the URL, s/he can easily trigger the URL to be scraped.
Make the buttons such that, when they are selected either the name or some text is appended to the text field.
However, when the buttons are dis-selected and user has changed the inserted text, the Software must raise an error/pop-up, telling the user that s/he cannot dis-select the component as it has changed.
The user can only dis-select the component if they have changed the dog-tag of the inserted code.
The Display Area component is a long rectangular UI Component which will consist of buttons that are nodes from the retrieved HTML.
Features:
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.