flow-inspector's People
Contributors
Stargazers
Watchers
flow-inspector's Issues
Add no-cache option to preprocessor
The preprocessor uses heavy caching when importing data. Newly imported data will not be committed to the database until the script is stopped using (SIGTERM, e.g. with Strg+C) or until the END token is read.
This is bad for live-data import, as one will not see newly added data.
A switch that disables heavy caching will enable more commits to the index tables can help with this problem.
Update Wiki documentation on how to import data into the backend
The wiki currently does not contain any information on how to import data into flow-inspector.
preprocess.py and app.py both report pymongo missing
I am running centos6.
I have installed python 2.7.4 from source and installed pip:
I see some odd things occurring when attempting to run either preprocess.py or app.py:
# python -m pdb ./preprocess/preprocess.py
> /root/flow-inspector/preprocess/preprocess.py(10)<module>()
-> """
(Pdb) c
./preprocess/../vendor/pytz-2012h/pytz/__init__.py:35: UserWarning: Module bson was already imported from ./preprocess/../vendor/bson-0.3.2/bson/__init__.pyc, but /usr/local/lib/python2.7/site-packages is being added to sys.path
from pkg_resources import resource_stream
./preprocess/../vendor/pytz-2012h/pytz/__init__.py:35: UserWarning: Module redis was already imported from ./preprocess/../vendor/redis-py/redis/__init__.pyc, but /usr/local/lib/python2.7/site-packages is being added to sys.path
from pkg_resources import resource_stream
2013-04-25 16:34:35.700845: Init...
Cannot connect to Mongo database: pymongo is not installed!
The program exited via sys.exit(). Exit status: 1
> /root/flow-inspector/preprocess/preprocess.py(10)<module>()
-> """
What's interesting is the module can be imported by MongoBackend.connect() when I add import pymongo to the original executing file.
This might be something not unique to flow-inspector, but it seems odd that it only occurs within this app.
The following is also interesting:
adding print sys.path before the try statement in MongoBackend.connect() reveals:
['./preprocess/../lib', './preprocess/../vendor/bson-0.3.2', './preprocess/../vendor/pytz-2012h', './preprocess/../vendor/redis-py', './preprocess/../vendor', './preprocess/../config', '/root/flow-inspector/preprocess', '/usr/local/lib/python2.7/site-packages/setuptools-0.6c11-py2.7.egg', '/usr/local/lib/python27.zip', '/usr/local/lib/python2.7', '/usr/local/lib/python2.7/plat-linux2', '/usr/local/lib/python2.7/lib-tk', '/usr/local/lib/python2.7/lib-old', '/usr/local/lib/python2.7/lib-dynload', '/usr/local/lib/python2.7/site-packages', '/usr/local/lib/python2.7/site-packages/setuptools-0.6c11-py2.7.egg-info']
Note:
# ls -al /usr/local/lib/python2.7/site-packages/pymongo/__init__.py
-rw-r--r--. 1 root root 2711 Apr 25 16:24 /usr/local/lib/python2.7/site-packages/pymongo/__init__.py
Thanks Lothar!
Integrate Google Maps and Geolocation
Provide a new view that allows to visualize host locations on Google Maps
Restrict TimelineView to smaller time windows
TimelineView currently shows all the imported data. The view gets very crowded and it gets very difficult to properly select the desired time windows.
Cassandra Backend support
It would be great if you could add Cassandra as a supported storage backend.
Donut-Charts for ports and IPs are not correct
The donut charts display incorrect values. Instead of showing the overall distribution of ports and IPs, they only show the TOP 30 IPs/Ports (without the share of traffic that has been produced by the others).
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.