Code Monkey home page Code Monkey logo

deepblue's Introduction

DeepBlue

Screenshot from 2022-10-22 23-13-14

Abstract

Our project "DeepBlue" is an user friendly application that focuses on providing children the knowledge about marine life. Users can upload or paste the image URL of which they want to identify and that image will be given to our ML modal to classify and the result will be given back with an image preview. We use Twilio SMS API to send an SMS to the user's mobile with extra resources about the sea object, so that they can learn much more than they expected.

Inspiration

Kids enjoy art and cartoons and at the same time, parents want them to observe and learn whatever they see. So we came up with DeepBlue, an user friendly tool that can classify marine objects based on the image provided.

What it does

Kids may learn more about marine life with the aid of DeepBlue. When the user uploads the image in the input field, the AlexNet models classifies it as either a dolphin, jellyfish, etc. The output is sent as response by FastAPI to the client . After clicking the microphone icon, a computer-generated voice will speak out the results that corresponds to the input picture. The user may later get additional information about that specific marine species by pressing "more information" and entering their mobile number.

Screenshot from 2022-10-22 21-27-44 Screenshot from 2022-10-22 22-42-36 Screenshot from 2022-10-22 22-43-46

How we built it

Our project was divided into 3 phases.

  • The initial step was brainstorming, during which we looked at several publications, research papers, and actual instances. We learned about it from there.
  • The second step is planning, during which we choose the tech stack for the project's front end, back end, dataset, and neural network model.
  • The third phase is implementation, during which we used React JS to build our GUI, Fastapi for our API, and Pytorch to train our deep learning model on a deep fictitious dataset.

Architecture of DeepBlue

architecture

Deep Learning Model Phase

Screenshot from 2022-10-22 23-25-48

AlexNet :

architecture

Paper : https://arxiv.org/pdf/1404.5997v2.pdf

Challenges we ran into

Some of the AlexNet capabilities have to be modified to fit our product. Developing an API for the Deep Learning Model using the FastAPI framework and utilising the React Axios framework to make API requests were some areas were we spent a lot of time. The model responds to the requested request in a shorter amount of time with the help of FastAPI & Axios framework.

Accomplishments that we're proud of

Using AlexNet model for identifying sea creatures. Customizing the AlexNet model according to our project . Adjust parameters to bring a better accuracy for the model. Building an API using Fastapi to handle request response cycle. Using Twilio API to communicate more information about the sea creature.

What we learned

Using pretrained Neural Network models with different datset. Customizing the pretrained neural network according to our needs. Usage of FastAPI. Creating UI/UX using React JS .

What's next for DeepBlue

Implement DeepBlue as a mobile application . Introduce as browser extension such that kids can find the information of sea creatures within single click. Improving accuracy of the Deep Learning model by tuning the parameters.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.