Code Monkey home page Code Monkey logo

Comments (5)

gkordo avatar gkordo commented on June 12, 2024 1

For both of your queries, you have to create a dictionary similar to the one found in the cc_web_video.pickle file. It consists of several list objects that comprise information about the dataset. More precisely, it contains the following key-value pairs:

  1. index: a list that contains the id of each video in the dataset. The index of each video in this list corresponds to the row in the output feature matrix of the global video descriptors. Empty entries are ignored.
  2. queries: a list that contains the indexes of the query video for each query set.
  3. ground_truth: a list that contains the indexes and labels of the videos in the query sets. Each entry is a dictionary that corresponds to a query set and contains key-value pairs of the video indexes and their labels with respect to the query video. Visit the CC_WEB_VIDEO website for more information regarding the labels.

I would recommend you to go through the .pickle file to take a look in its composition. Also, I have made some changes in the format of the cc_web_video.pickle file, so make sure to pull the latest version of the code.

from ndvr-dml.

gkordo avatar gkordo commented on June 12, 2024

Having a trained model, you can initialize a DNN object by providing the required argument, and then use the embedding function to extract the final video representations. This is exactly what I am doing to evaluate the model performance on CC_WEB_VIDEO dataset, see here. Also, see the following example:

features = np.load(path_to_features)
model = DNN(features.shape[1],
             path_to_model,
             load_model=True,
             trainable=False)
video_embeddings = model.embeddings(features)

Once you have extracted the video embeddings, you may use any dimensionality reduction algorithm (e.g. PCA, tSNE) to transform vectors to 2 or 3 dimension. I would recommend to use the same color for all near duplicates of a particular query, in case you already have such information.

from ndvr-dml.

maida-shahid avatar maida-shahid commented on June 12, 2024

from ndvr-dml.

maida-shahid avatar maida-shahid commented on June 12, 2024

sorry sir for bothering you again. I have some other queries that i have to ask you.

  1. for triplet_generator.py only applicable datasets are vcdb and cc_web_video. if we want to test this model on our video dataset, is the extracted features file .npy using intermediate-cnn-features enough?
  2. to evaluate the cc_web_video dataset .pickle file is used, how can we generate that pickle file for our own testing dataset?

from ndvr-dml.

maida-shahid avatar maida-shahid commented on June 12, 2024

Thanks!

from ndvr-dml.

Related Issues (16)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.