Code Monkey home page Code Monkey logo

augmentedgesture.js's Introduction

Release in progress of the augmented gesture demo from web5 talk. see this video to see it in actions.

Cools stuff people did with it

Ideas

  • make a pong to play with postit
    • multiplayer game with post it

augmentedgesture.js's People

Contributors

jeromeetienne avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

augmentedgesture.js's Issues

schedule on the project

  • what is the future of augmentedgesture.js
  • what remain to be done ? in which field ? the fields seem to be:
    • code
    • examples
    • communication
  • What about the structure of the code
    • currently the code is hardcoded with 2 pointers
    • not good to be hardcoded
    • a single pointer is a very valid usecase, one pointer in one hand
    • 10 pointers, one per finger is a very valid case too
    • So the pointer must be configurable
    • handle that in dat.gui too
  • code the minimal value for marker too
  • which kind of marker are possible
    • anything kindof round with a flashy distinctive color

event refactoring

  • from a code point of view, change it to mouseup, mousedown, mousemove ?
    • and do that for each pointer
  • maybe to provide the same value as in touch event
    • it has multiple events like touch
    • ask paul panserrieu about touch event structure
  • maybe to provide both ?
  • one things is different from touch event
    • one can konw which finger is touching
  • so in fact this is like many mouse at the same time

notify .clientX and not .x

  • for the mousemove event, the notified event could be made closer to the normal mouse event, with .clientX
  • in anycase the coordinate are in 0-1( so no real compatibility can be made

cleanup dat.gui integration

  • currently it is dirty

namespace

  • it defines various global wihtout need

requirement

  • it is required to have dat.gui
    • this requirement isnt needed
    • make it optinal

code examples

  • find good examples
  • what is a good example
  • some super simple examples for educational purpose
  • some link with various possibilities
    • link to be an actual mouse pointer
  • is that possible to simulate mouse pointer from javascript ?

ideas of example

  • link with $1 gesture recognition seems a cool test
  • a extension chrome where i navigate page ?
  • find some actual case which can be reused externally
  • a way to navigate slides ?
    • nice for demo

post-it color code

I am unable to understand how to use the Option pointers .
What values do I use it for a post-it note ?

I have tried the following but it does not seem to recognize the color

pointerOpts.colorFilter.r   = {min:   0, max: 255};
pointerOpts.colorFilter.g   = {min:   0, max: 255};
pointerOpts.colorFilter.b   = {min:  0, max: 230};

augmentedpong screencast

current material

  • running code: clean
  • slides for the tutorial: each step
  • video for the tutorial: why not following doing the slides + live coding

make a build .js

  • Currently there is like 3 file.js and various dependancy
  • this isnt nice

handle absence of marker

  • how to handle absence of marker
  • currently it isnt handled so the pointer goes crazy on noises

Mobile as marker

  • good for sync with qrcode
    • the user flash the qrcode and immediatly display the proper color.
  • issue with bright screen.
  • able to use marker withour props.
    • good for the case of "shop front sidewalk"

Port on learningthreejs

  • tell the story of the lib, web5 demo, the video, webrtc team, previous posts
  • give the api of the lib
  • min code is just min marker. No gesture recognition
  • $1 gesture and actual touch event later

notify coord in 0 to 1

thus independant of the screen resolution

        var x   = (e.x / (320/4))*window.innerWidth;
        var y   = (e.y / (240/4))*window.innerHeight;

is what i do now... super ugly and hardcoded

Augmented auto calibration

  • put the marker in a predefined square
  • maximize n point in marker zone, detected density
  • minimze ratio out of marker zone
  • ok this is the estimation function... Now how to autotune parameter
  • simulated annealing? Relativly easy

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.