This contest is to distinguish human writing or robot writing from articles, and we won the champion out of 240 teams.

Given an article, we need to create algorithms that judge types of authors (automatic summary, machine translation, robot writer or human writer). More details see SMP EUPT 2018

• tensorflow >= 1.4.0
• keras >= 1.2.0
• gensim
• scikit-learn
  you may need keras.utils.vis_utils for model visualization

• my_utils/: for data preprocessing
  • my_utils/data: convert origin data to csv file
  • my_utils/data_preprocess: create data sequences and batches for the input of deep learning models
  • my_utils/w2v_process: get the vocabs and pre-trained embeddings for words and chars
  • my_utils/metrics: calcuate the precision, recall and F1 scores for each categories of authors

There are total 12 models that combine word representations and character representations. The best model word rcnn char cgru we devised is spired by two papers:

• A Hybrid Framework for Text Modeling with Convolutional RNN
• A C-LSTM Neural Network for Text Classfication

Here is the scores of different models:

• Note that rcnn comes from A Hybrid Framework for Text Modeling with Convolutional RNN while cgru comes from A C-LSTM Neural Network for Text Classfication

The source codes derives from https://github.com/fuliucansheng/360
We use model to create the architectures of models, and use train to train them

We use LightGBM for ensemble combined 12 models and extra statistical features, which is in ensemble, more details seen in https://github.com/TFknight/SMP-2018-Ensemble-Guide
In test dataset, we only adopt a simple but efficient voting mechanism for ensembling, which is in evaluate/predict

• my_utils/: for data preprocessing
  • my_utils/data: convert origin data to csv file
  • my_utils/data_preprocess: create data sequences and batches for the input of deep learning models
  • my_utils/w2v_process: get the vocabs and pre-trained embeddings for words and chars
  • my_utils/metrics: calcuate the precision, recall and F1 scores for each categories of authors
• models/: for creating deep learning models
  • deepzoo: for keeping all models
• init/config.py: for saving the path of models, data and so on
• train: for training models
• figure: for saving the visualization of models

Thanks for all the efforts of my teammates in GDUFS-iiip
We hope that more people will join in our labs: Data Mining Lab in GDUFS(广外数据挖掘实验室）