Code Monkey home page Code Monkey logo

nec_app's Introduction

NEC_app Repo

This is the repository for the android app for the Neural Efficient Coding Project under Dr. Mark V. Albert, Biomedical AI Lab, UNT.

Austin Meek, Rhea Pookulangara

Initially this was the 4901 Capstone repo of: Jeremy, Nelson, Kale, Brandon's capstone repository

nec_app's People

Contributors

ajmeek avatar rheap1 avatar relaxolotl07 avatar

Stargazers

 avatar  avatar  avatar

Watchers

 avatar  avatar

nec_app's Issues

Adjust display of audio receptive fields

Currently the audio receptive fields are not displayed well. Artifacts from removed graphs remain and the surviving graphs can be adjusted to more fully take up the user's screen.

Change sound processing screen to not say "processing image"

Currently when audio is being processed, the UI pulls up the same page that it does for processing an image. This is confusing to the user since an audio recording is being processed, not an image. Change this so that it says processing sound.

Homepage Description

The wording here seems really awkward to me. I’ll change it to “Now you can see the receptive fields generated from images and audio which match the ones generated in your brain!” unless anyone has anything else to add. I think this feels more natural. We’ll also need to explain what receptive fields are to new users first. See a below problem for something similar.

Show Introductory "About app" section to New Users

For new users, the homepage description won’t make much sense because outside of neuroscience, nobody knows what a neuron’s receptive field is. This will probably turn a lot of people off initially. When a user loads the app for the first time, I therefore think that they should automatically be shown the “About App” section which goes into more detail about the app, its purpose, and the underlying phenomena. They’ll have an option to skip it of course.

Allow recording to be replayed in the Recording Audio UI

When viewing the recordings the user has made, the bottom part of the UI is unable to replay a recording as a normal person would expect it to. You have to reclick the same recording from the top part of the UI to replay it. We should add a replay functionality which replaces the triangular play button once the recording stops.

Labelling and information page for gammatone filters and gabor filters

Currently, gammatone filters only display 8 graphs without axes or information describing what they represent. We need to 1, display data and plot the axes of each graph, and then include an information page to explain the purpose of both the gabor filters and gammatone filters and what they represent.

Change app screen icon from default

Currently, when you search for an app on the app screen, our app comes up with "Neuroscience" as the visible title and the stock default app icon there. We need to change this to something custom to our project.

I think that using the lab icon would be a good idea.

Ambiguous Button in the Recording Audio UI

In my opinion, the button to process the audio into its corresponding receptive fields is not very clear, intuitive, or well positioned. I think that this may cause confusion for a small subset of users, so if anyone has an idea of how to make this more intuitive please tackle this one.

App Info Screen Names, Any Licensing or Copyright Info

Add our names to this. Also, what type of licensing or copyright info do we need to add, if any? Since we’re already doing this open-source, could we use some type of copyleft or alternate paradigm copyright license? If anyone has thoughts I’m eager to hear them on this one.

View "About App" Button from Homepage more easily

We need to change the UI so that the “About App” section can be viewed much more easily from the main screen. Right now you have to hit the three dots in the top right to see it, and hardly any normal users browse there because typically that section only contains licensing info or settings access etc. This is a major problem because the “About App” section has the introduction to what the app is trying to accomplish and what a receptive field even is. By making this more accessible we can probably increase our user engagement and capture rate significantly. I’m thinking it would be best to have a big button in between the homepage description and the image/audio buttons titled “More Information” or something. Again, open to suggestions.

Audio Receptive Field UI Zoom

Similar to viewing the generated receptive fields for images, I am having trouble being able to easily and clearly see the generated receptive fields. I know we don’t have a working FastICA implementation yet, but I think this can be done ahead of time. Again, this is really the point of the whole app so this problem is important.

Homepage UI Center Image

Make sure that the brain picture is centered around text? This may not be an issue really, but for my emulator (running as a Pixel 5) the text is running right up against the brain picture some.

“About App” Section Picture

The first screen does not have a picture - a good one needs to be added. This will likely be the first thing people will see when they open the app so choose a good one.

“About App” Section Descriptions

We should either change some of the slide’s descriptions or add more slides. I think that we can keep the information intelligible to the layman while also giving more accurate information.

Add Back Button to the Recording Audio UI

When checking the list of recordings that the user has made, there is no back button (this is necessary if the user doesn’t like what they’ve just recorded and wants to try again). Currently the only way to go back is to process one of the current recordings into receptive fields or restart the app. Add a back button.

Sample natural stimulus data options

We need to include an option for users to select sample natural stimulus data in addition to their own inputs, to both simplify the task of testing the gabor and gammatone filters and for the user to have immediate access to images and audio input data that they might not be able to currently test(nature pictures or sounds if they're indoors, etc.)

Receptive Field Image UI Zoom

When showing the generated receptive fields for images, in the UI, allow users to click on the receptive fields picture and zoom in to look. Right now in the top left corner and small and hard to see. If the users aren’t able to examine the receptive fields closely and see how cool this all is, the app isn’t doing its job.

App crashes during Audio Processing

For me, usually during the second time I try to process audio into receptive fields it crashes the app. Whoever tackles this will need to attempt to isolate and fix this. This may be happening because our FastICA is absent. Whoever starts working on this, just try it first and we can work on it together if you have any problems. Bugs can be pretty frustrating.

FastICA Implementation Missing

Last but not least. This’ll be the toughest one in my opinion. We’ll need to either find or create a good FastICA implementation in Java. We have several previous attempts that we can build off of and of course successful implementations in other languages to use as well. Dr. Albert has asked that the rest of the app be made launch ready before this so that if we don’t finish it, a new team can just do FastICA and get it over with without having all the time necessary to learn and grok Android Studio as a whole, which I think is a fair point (remember, it’s November and we’re just now getting all our stuff set up since we’re all new to android app dev). We’ll come to this last then.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.