Code Monkey home page Code Monkey logo

dlimp's Introduction

DLIMP

Dataloading is my passion.

Installation

Requires Python >= 3.8.

git clone https://github.com/kvablack/dlimp
cd dlimp
pip install -e .

Usage

Core usage is through the DLataset class, defined in dlimp/dlimp/dataset.py. It is a thin wrapper around tf.data.Dataset designed for working with datasets of trajectories; it has two creation methods, from_tfrecords and from_rlds. This library additionally provides a suite of frame-level and trajectory-level transforms designed to be used with DLataset.frame_map and DLataset.traj_map, respectively.

Scripts for converting various datasets to the dlimp TFRecord format (compatible with DLataset.from_tfrecords) can be found in legacy_converters/. This should be considered deprecated in favor of the RLDS format, converters for which can be found in rlds_converters/ and will be expanded from now on.

dlimp's People

Contributors

kvablack avatar kpertsch avatar homerw avatar

Stargazers

Kazybek Askarbek avatar 爱可可-爱生活 avatar Vaibhav Singh avatar hu-po avatar ganzhiruyi avatar Jihoon Oh avatar Ocean Wang avatar Guanning Zeng avatar Haowei Wen avatar Guangqi Jiang avatar Shaofeng Yin avatar Federico Mustich avatar Peter David Fagan avatar Jeff Carpenter avatar Moritz Reuss avatar Jannik Grothusen avatar  avatar Philippe Hansen-Estruch avatar Kyle Stachowicz avatar Dibya Ghosh avatar

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.