Code Monkey home page Code Monkey logo

uni-evaluator's Introduction

Uni-Evaluator: A unified interactive model evaluation for classification, object detection, and instance segmentation in computer vision

Uni-Evaluator is a visual analysis tool to support a unified model evaluation for different computer vision tasks, including classification, object detection, and instance segmentation. More information, including the video and live demo, can be found here.

demo

We further cleaned the annotations of the COCO validation dataset after the case study shown in our paper. The COCO-format annotation file can be downloaded via this link.

Quick start

1. Download repo

git clone https://github.com/thu-vis/Uni-Evaluator.git
cd Uni-Evaluator

2. Setup environment

(This repo is tested with node_v16 and python3.8 on Ubuntu)

a. setup frontend environment

npm install -g yarn
cd frontend
yarn

b. setup backend environment

# install from requirements.txt
cd ../backend
# install the packages in order
cat requirements.txt | xargs pip install

# install RangeTree
cd ./data/RangeQuery
python setup.py build_ext --inplace
cd ../../

# install fastlapjv
git clone [email protected]:thu-vis/fast-lapjv.git
cd fast-lapjv/
python setup.py install --user
cd ../

# install faiss (you can also follow https://github.com/facebookresearch/faiss/blob/main/INSTALL.md)
conda install -c pytorch faiss-gpu
# or
conda install -c pytorch faiss-cpu

3. download data

We provide COCO test data used in our case study for demonstration, which can be downloaded here. It corresponds to the dataPath below.

4. run

# start backend
cd backend
python server.py \
    --dataPath <path> \ # contains sub-directories with training or test data
    --seg \ # added for segmentation task
    --dataName <name> # the name of dataset, e.g., "COCO", "iSAID"
    --host <host> \
    --port <port> \
cd ../

# start frontend
cd frontend
yarn start

Citation

If you use this code or the cleaned annotations of COCO validation data for your research, please consider citing:

@article{chen2023unified,
  title={A unified interactive model evaluation for classification, object detection, and instance segmentation in computer vision},
  author={Chen, Changjian and Guo, Yukai and Tian, Fengyuan and Liu, Shilong and Yang, Weikai and Wang, Zhaowei and Wu, Jing and Su, Hang and Pfister, Hanspeter and Liu, Shixia},
  journal={IEEE Transactions on Visualization and Computer Graphics},
  year={2023},
  publisher={IEEE}
}

uni-evaluator's People

Contributors

libricardo avatar chencjgene avatar uni-evaluator avatar

Stargazers

Duan Li avatar Jun Yuan avatar Wesley avatar Yuri avatar jiajukang avatar 辰 avatar Chen Jiashu avatar  avatar Jie X avatar Bill Chen avatar Leonardo Holtz de Oliveira avatar Shilong Liu avatar  avatar

Watchers

Kostas Georgiou avatar  avatar

Forkers

chenjash

uni-evaluator's Issues

Version issue

Excuse me, do you have a version of this model that supports Windows?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.