Code Monkey home page Code Monkey logo

audio_alignment's Introduction

audio_alignment

Collection of scripts and utilities to align Sanskrit text and audio.

To use the scripts and perform alignment of text and audio:

  1. Install aeneas using pip install aeneas
  2. Install the required libraries - ffprobe ffmpeg espeak libespeak-dev (E.g. using apt on Ubuntu).
  3. Use the align function in utils/alignment.py to align the text and audio.

For examples, please see align.py in the rAmAyaNa or meghaduta subdirectories.

Website

Please see the result at the project page

Adding new data

To contribute new data to the project, please follow these Instructions

audio_alignment's People

Contributors

avinashvarna avatar hrishikeshrt avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

audio_alignment's Issues

Confusion on landing page

Hi,

(Sorry just leaving this as a comment for now, if I get time I'll try to submit a PR.)

I've noticed that at least a couple of people to whom I sent the https://avinashvarna.github.io/audio_alignment/ link thought that it wasn't working — digging deeper, it seems that what happened is that in the below screenshot (sorry for the large image size) they clicked on one of the links in the red rectangles, instead of clicking in the green rectangle:

screenshot

I wonder if there's some way to make this more obvious. For example, does the "text source", "audio source" and "aligned by" need to be on the main page — could it instead be made that clicking on "Rāmāyaṇa" (say) takes you to an "about" page (or even the page for the first sarga, with the details on a separate page)?

Handling multiple audio/text files

I was looking at vishvAsa's email regarding ~1k mahAbhArata recordings and texts being available, e.g. here, and thinking that it might be a good addition to this site. The complicating factor appears to be that there are multiple audio files per adhyAya. For generating the alignment, it is easy to locally concatenate the files into one larger file. but it is not clear what is the easiest way to present it on the website. Any thoughts @hrishikeshrt @shreevatsa?

Document data.json format for interface

Document the structure of the data.json or add a "How to add a new set of data" section to the README to make it easy to contribute new aligned audio + text data.

Add Ashtadhyayi Sutrapatha

Text is available from ashtadhyayi.com/ (I can push text files in)
One source for audio is http://surasa.net/music/samskrta-vani/ashtadhyayi.php
Another is https://www.sanskritfromhome.in/course/ashtadhyayi/ (While this one is not freely available, it is very precise and devoid of some occasional errors, thus more useful for someone trying to learn to chant/memorise)

I tried aligning both versions. I am not sure if it's my system or it's about the nature of the text, but the alignments I obtained are pretty bad.

Progressive Web app?

After the recent posting of this website on many mailing lists, a few people (especially from India) asked if this tool could be installed as an app, so that it could be used offline. This seems like a reasonable goal.

The easiest path I could think of to achieve this was to create a progressive web app so that the site could be "installed". We can leverage the existing flask/jinja templates in nunjucks and create a service worker that caches files that the user has visited recently using something like workbox, so that they can be used offline as well. I will try to test out some of these tools.

Any thoughts? @hrishikeshrt @shreevatsa

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.