Comments (3)
If we have almost the same amount of packets for every label, can we skip the undersampling?
Yes
The question is how to have almost the same amount not only for the train set, but also for the test set?
I need your context on the reason why you want to do this.
from deep-packet.
The question is how to have almost the same amount not only for the train set, but also for the test set?
I need your context on the reason why you want to do this.
I have unbalanced set.
/application_classification/train.parquet
label count
16761
16761
...
/application_classification/test.parquet
label count
57476
4232
I have now around 15 labels (my own dataset for other application) and the test set is very unbalanced, from 4k to 57k. Doing an evaluation in this way is not precise I suppose.
from deep-packet.
I presume the distribution of your dataset (test set) is similar to your actual environment. So I would suggest you keep the exact distribution of the test set.
You can get the evaluation result for each individual label after the model is trained. E.g., what is the precision/recall of label 1, i.e. treating the rest of the data with other labels as the "negative sample" and the data with label 1 as the "positive samples". You should get the precision/recall for your label 1 data under such a setting. Repeat this for all labels. You will know how your model performs.
from deep-packet.
Related Issues (20)
- close
- 关于create_train_test.py问题 HOT 1
- pre-train model HOT 2
- 关于数据标签的问题 HOT 1
- 运行错误 HOT 2
- About the missing data set categories HOT 5
- The result of evaluation.ipynb HOT 1
- About missing .pcap file HOT 1
- error when run train_cnn.py HOT 1
- KetError:length when run train_cnn.py HOT 1
- Make a prediction HOT 3
- other datasets for encrypted traffic classification HOT 1
- cannot convert float NaN to integer HOT 2
- SAE
- Approach flawed if ports left in dataset HOT 1
- training fails on VPN dataset with a ValueError HOT 1
- Provided train_test_set is not correct HOT 2
- Why "remove tor and torrent related data as they are no longer available" mean? HOT 1
- About utils.py for classification
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from deep-packet.