Code Monkey home page Code Monkey logo

frogboss74 / realcattranslator Goto Github PK

View Code? Open in Web Editor NEW
18.0 1.0 2.0 1.22 MB

Project in several phases to ultimately built an app that translate from human to cats and cats to human using deep learning algorithm

Home Page: https://frogboss74.github.io/RealCatTranslator/

License: GNU General Public License v3.0

HTML 0.02% CSS 0.63% JavaScript 99.35%
cats cnn-classification animal sound recognition translator fun realcattranslator real cat

realcattranslator's Introduction

RealCatTranslator

Project in several phases to ultimately built an app that translate from human to cats and cats to human using deep learning algorithm For all cat lovers by Lea B, Teo B and Herve B

web site link: here

Development wiki link: here

--> Current Status

Help me to collect cat sounds either by recording your cat and droping the file in the drop box below or capturing sounds from Youtube videos using online mp3fy here or any recording app on mobile (see how to name the file below)

CuteCat

Introduction

  • Phase 1: Collection of cat sound samples in a specific format with annotation of the cat behaviour following a prescribed method for each predesignated designed behavours (eg hungry, don't bother me, etc.)
  • Phase 2: Data manipulation and preparation for deep learning
  • Phase 3: Machine learning on initial sample (this could branch out depending on machine learning algorith used)
  • Phase 4: App development to apply the learned model to real situation and use language recognition to speak cat language

Drop your sound files here according to instructions on link above:

<iframe src="https://onedrive.live.com/embed?cid=EB02B52BD1CE79FD&resid=EB02B52BD1CE79FD%212644&authkey=AOroewqAhmmou_0" width="165" height="128" frameborder="0" scrolling="no"></iframe>

Phase 1 Collecting cat sounds

This task is probably the most challenging task.

FlowChart1

Collecting raw sounds

This requires either volunteers to record their own cats, which could be fun, though time consuming or screening online resources such as Youtube and then post processing the audio files. In any case wave files need to be collected.

Submission of cat sounds to: CatSounds Drop Box

Tools to collect cats sound : mp3fy here or any recording app on mobile

Naming of raw cat sounds files: Cat sounds should be named as follows: "SoundClass_Sex_Age_Name_FistNameOfWhoIsSubmitting_Country_Source"

where,

  • SoundClass is one of the following:
Sound Class Meaning
Growling I am warning you
MomoMooh I am angry
Hissing Leave me alone
Nyaaan Want to fight?
MeowMeow I am happy
Chatting I want to hunt/play
GyaGyaGya I want a cat-mate
KittenMiyouMiyou Mama! Mama!
Miyoou It hurts/hungry
Purring I am comfortable
  • Sex is either M for male of F for female (if known)
  • Age is age of cat (approximately if known, eg 3m or 2Y, etc.) (if known)
  • Name is name of cat (if known)
  • FirstNameOfWhoIsSubmitting is name of who is sending the file
  • *Country is country where the cat is. (this will be used to find out if cats in different countries understand each others) (if known)
  • Source should be Web or Recorded

Classification of sounds

Hear the cats and what they say at: Link here

<iframe width="540" height="360" src="https://www.youtube.com/embed/nX1YzS_CYIw" frameborder="0" allow="autoplay; encrypted-media" allowfullscreen></iframe>

After a bit of research, it is proposed to follow the work done by JH Lee Domestic Cat Sound Classification Using Transfer Learning. The following site shows examples of sound within each classis used as a guide for classification of site The research proposes to classify cats sounds in 10 classes as follows:

Cat classes

Phase 2

Data filtering [HOLD: not decided yet]

It is curretly proposed to use Librosa library in python for MFCCS feature extractions

Phase 3

It is currently proposed to use Supervised Training Convulational Neural Networks CNN with Tensorflow and Keras given its accuracy and portability. The model will be developed in Python hand the model will be saved for further used in other languages. The target accuracy is 70%.

Phase 4

Simple app will be developed using MIT App Inventor to record cat and translate to human and vice versa.

realcattranslator's People

Contributors

frogboss74 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar

realcattranslator's Issues

Project Status

Hi! I just discovered this. It looks like there haven't been any commits in 3 years. Is this because you are still waiting for more data to be submitted or is the project officially over? It looks really interesting and I would like to help out.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.