Code Monkey home page Code Monkey logo

tall's Introduction

TALL: Temporal Activity Localization via Language Query

This is the repository for our ICCV 2017 paper TALL: Temporal Activity Localization via Language Query.

Visual Features on TACoS

Download the C3D features for training set and test set of TACoS dataset. Modify the path to feature folders in main.py

Sentence Embeddings on TACoS

Download the Skip-thought sentence embeddings and sample files from here of TACoS Dataset, and put them under exp_data folder.

Reproduce the results on TACoS

python main.py

Charades-STA anno download

The sentence temporal annotations on Charades dataset are available here: train, test. The format is "[video name] [start time] [end time]##[sentence]". You may want to generate the skip-thought embeddings and C3D features on Charades-STA, and modify the codes slightly to reproduce the experiments.

Updates on Charades-STA performance

I did some anno cleaning for Charades-STA (compared to the version I used in ICCV paper), the updated performance is listed below. Please compare to these results when using Charades-STA.

Model R@1,IoU=0.5 R@1,IoU=0.7 R@5,IoU=0.5 R@5,IoU=0.7
CTRL (aln) 17.69 5.91 55.54 23.79
CTRL (reg-p) 19.22 6.64 57.98 25.22
CTRL (reg-np) 21.42 7.15 59.11 26.91

tall's People

Contributors

jiyanggao avatar

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.