Code Monkey home page Code Monkey logo

dvc-fromrawvideo's Introduction

DVC-fromRawVideo

Dense Video Captioning from Raw Video（mp4動画のキャプション生成）/ 特徴抽出&キャプション生成

  • I3D PWC-Net VGGishの特徴を抽出
  • BMTを用いてキャプションを生成

動作環境

  • OS : Ubuntu 16.04 , Ubuntu 20.04
  • GPU: GTX 1080Ti ※「RTX3080Ti」では動作しません

環境構築

bash setup.sh

実行

inputsフォルダにmp4動画を入れた状態で実行.
ファイル名は「main.py」で書き換えてください

def main():
    videoname="women_long_jump.mp4"  <---

注意

Miniconda ではなくAnacondaで実行したい場合はcommand_SingleGPU.shもしくはcommand_MultiGPU.shを書き換えてください

before: source ~/miniconda3/etc/profile.d/conda.sh
after: source ~/anaconda3/etc/profile.d/conda.sh

エラー対応

239dimension error

  1. add glove.840B.300.zip to ".vector_cashe(hidden directory)" https://nlp.stanford.edu/projects/glove/
  2. And, open zip file

使用

https://github.com/v-iashin/BMT

dvc-fromrawvideo's People

Contributors

textcunma avatar

Watchers

avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.