Code Monkey home page Code Monkey logo

unifl's Introduction

Universal EHR Federated Learning Framework

This repository is the official implementation for UniFL

Release Note

  • 2023.09.16: Support MIMIC-IV 2.0 & Bug Fix

How to Run

Requirements

$ conda env create -n unifl -f env.yaml

Preprocessing

  • MIMIC-III, MIMIC-IV, eICU are public, but require some certificates

  • Download the files from below links:

  • Then, execute the preprocessing codes

$ cd preprocess
$ bash preprocess_run.sh {MIMIC-III} {MIMIC-IV} {eICU} {save_path}
  • Note that the preprocessing takes about 1 hours with AMD EPYC 7502 32-core processor, and it requires more than 60GB of RAM.

Model train

$ python src/main.py --device_num 0 --input_path <INPUT_PATH> --save_dir <SAVE_PATH> --train_type fedrated --algorithm fedpxn --pred_target mort --wandb_entity_name <ENTITY_NAME> --wandb_project_name <PROJECT_NAME>

or, you can execute multiple experiments simulatneously with scheduler.py


NOTE

  • Pause & Resume is only supported for fedrated learning (Kubernetis support)
  • Pause & Resume is not verified with distributed environment
  • We used one A100 80G gpu or two A6000 48G gpus for each run
  • Distributed Data Parallel (DDP) with resume is not tested
  • You can check hyperparameters on main.py

Citation

@article{kim2022universal,
  title={Universal EHR federated learning framework},
  author={Kim, Junu and Hur, Kyunghoon and Yang, Seongjun and Choi, Edward},
  journal={arXiv preprint arXiv:2211.07300},
  year={2022}
}

unifl's People

Contributors

starmpcc avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.