ycccq / mdfreader Goto Github PK
View Code? Open in Web Editor NEWThis project forked from dasense/mdfreader
Automatically exported from code.google.com/p/mdfreader
License: Other
This project forked from dasense/mdfreader
Automatically exported from code.google.com/p/mdfreader
License: Other
**MDFREADER** ************** Abstract: ========= This Module imports MDF files (Measured Data Format V3.x and V4.x), typically from INCA (ETAS), CANape or CANOe. It is widely used in automotive industry to record data from ECUs. The main module mdfreader.py inherits from 2 modules (One pair for each MDF version X) : The first one to read the file's blocks descriptions (mdfinfoX) and the second (mdfXreader) to read the raw data from the file. It can optionally run multithreaded and I am proud to say I did not see any other tool reading faster this kind of files --> makes it suitable to process big amount of data in a batch, generally data from endurance evaluation. The structure of the mdf dictionary, for each channel: mdf[channelName] below keys exist ======================================================================================== - data: numpy vector - unit: unitName - master : vector name corresponding to master channel - masterType : type of master channel (time, angle, distance, etc.) - description : physical meaning of channel - conversion: (optional) dictionary describing how to convert raw data into meaningful/physical data mdf object main attribute: masterChannelList, a dict containing one list of channel names per datagroup Mdfreader module methods: ========================= - re-sample channels to one sampling frequency - merge files - plot a simple or a list of channels It is also possible to export mdf data into: - CSV file (excel dialect by default) - NetCDF file for a compatibility with Uniplot for instance (needs netcdf4, Scientific.IO) - HDF5 (needs h5py) - Excel 95 to 2003 (needs xlwt, really slooow, be careful about data size) - Excel 2007/2010 (needs openpyxl, slow if not resampled data) - Matlab .mat (needs scipy.io) - MDF 3.3 simplified file. It allows you to modify data, units, description and save it again - Pandas dataframe(s) (only in command line). One dataframe per raster. Compatibility: ============== This code is compatible for both python 2.6-7 and python 3.2+ Evaluated for Windows and Linux platforms (x86 and AMD64) Requirements: ============= Mdfreader is mostly relying on numpy/scipy/matplotlib. Reading channels defined by a formula will require sympy. Cython is required to compile dataRead module for reading mdf4 not byte aligned data. However, if cython compilation fails, bitarray becomes required Export requirements (optional): scipy, csv, h5py, xlwt(3), openpyxl, pandas Mdfconverter user interface requires pyQT User interface: mdfconverter (PyQt4) ================================== User interface in PyQT4 to convert batch of files is also written. You can launch it with command mdfconverter. By right clicking a channel in the interface list, you can plot it. You can also drag-drop channels between columns to tune import list. Channel list from a .lab text file can be imported. You can optionally merge several files into one and even resample all of them. Others: ======= In the case of big files and lack of memory, you can optionally: - Read only a channel list (slightly slower, argument channelList = ['channel', 'list']) - Keep raw data as stored in mdf without data type conversion (mdfreader argument convertAfterRead=False). Data will then be converted on the fly by the other functions (plot, exportTo..., getChannelData, etc.) but raw data will remain as in mdf file along with conversion information. Warning: ======== MDF 4.x specification is much complex compared to 3.x and its implementation is young. Even though I tested it with around 150 different files, chances of bug is higher with version 4.x compared to 3.x For great data visualization, dataPlugin for Veusz (from 1.16, http://home.gna.org/veusz/) is also existing ; please follow instructions from Veusz documentation and plugin file's header. Can be downloaded at this `link <https://drive.google.com/open?id=0B7B2LHSheZ5qdU9HaXJBMkpQQU0&authuser=0>`_
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.