flailingcanary's People
flailingcanary's Issues
Debug code left in tweepy_test_search_store.py
Remove
print(type(hashtags))
print(type(urls))
from the ##BEGIN INSERTING DATA INTO DATABASE section
Store search results
Need to update search functionality to store results in a way which makes it convenient to write to a database.
Utilities module
As suggested by Adam, create a utilities file for storing common methods.
Config file
The config file should be a python module, not a text file read by our script.
Interaction with MySQL
Need to define a function to search dictionaries for specified fields, add those fields to a SQL table.
Python writing to mySQL
Need code to write tweepy output in to a mySQL database
No clear way to differentiate variables instantiated in config file from local variables
I think we should have an easy way to tell if a variable is defined in the config file. This makes it easier to read other peoples code.
Some possible implementations:
- Use all caps for variable names in config file
- Append a set prefix string to variable name
- Put all config variables in a dictionary called config. Ex.) config["access token"]
Sorting output
We are have a method which iterates through lists of dictionaries, and dictionaries whose values are themselves dictionaries. How do we sort a list of dictionaries?
It is not a big issue because the ordering shouldn't matter when writing to the database. When we have decided what fields to use, perhaps we should make another print to screen listener which will print our specified fields.
Naming conventions
Currently the scripts for this project are importing modules from tweepy, and occasionally sub-objects. Is there a reason not to import tweepy in its entirety, so that we have a clearer set of naming conventions? (tweepy.submodule.function).
Spelling mistake in tweepy_test_search_store.py on Database branch
BEGIN DEFING QUERY should be #BEGIN DEFINING QUERY
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. ๐๐๐
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google โค๏ธ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.