shiffman / bodyblock Goto Github PK

https://www.npmjs.com/package/ffmpeg-static-electron

Thanks to https://twitter.com/radiodario/status/1267604137648295936

Thanks to https://twitter.com/ldenoue/status/1267702800173223939

https://github.com/tensorflow/tfjs-models/blob/master/blazeface/README.md

As a first pass for a simple editing interface for image frames. Sorry for the eye-sore of a wireframe, but working quickly to jot down some basic thoughts!

• Loading those big models in the beginning can take some time. We should include a loading gif or something to indicate that the app is loading or doing some processing task

Description

As mentioned in previous issues (e.g. #24) we will definitely be approaching the limits of our managing the state of our application as it is currently implemented.

As our application is growing, it is a good time now to define how we might want to proceed about managing state in the project.

In general, a good place to start would be to adopt some kind of Model-View-Controller (MVC) paradigm. We can implement our own like this -- https://www.taniarascia.com/javascript-mvc-todo-app -- or we can go with something more opinionated, but well used like Redux with Redux Toolkit -- https://redux-starter-kit.js.org/.

For the same reason why we might not introduce react (see below), I would say that introducing redux might not also be necessary at the moment and we can just develop our own MVC setup.

Other considerations

This also brings up some questions about whether or not we want to switch to a more robust front-end framework like react.js or vue.js, but for now i'm inclined to not introduce new frameworks since AFAIK @shiffman is not familiar with them yet and I think we don't absolutely need a framework given the relatively contained size of the project. All that being said, I'm totally open to choosing the right tools for the job.

State is required for when the App is initializing, upload or processing.
This should be a global state with a reusable busy indicator.
The loading state should lock the App and display the loading indicator animation from #19

• Turn into electron app?
• incorporate ffmpeg to unpack video into frames (retaining audio) and repack?
• options for blur / blackout / differentiate faces / bodies
• interface for manual editing of frames when it's missing or incorrectly categorizing pixels?

interactivity

On the todo list then seems like:

• add checkbox input to allow face-api - maybe default is just face masking?
• add checkbox input to allow body-pix

Data clean up

• remove images from /frames and out-frames before each function call to "process" and "save" -> addressed in #21

List of similar projects

• Anonymous Camera: https://apps.apple.com/us/app/anonymous-camera/id1504102584?ref=producthunt