Code Monkey home page Code Monkey logo

tapas's Introduction

TaPAS

Theoretical acoustics Plugin ⟿ Artificial Saxophones

Pomysłodawca: dr hab. Tomasz Pruchnicki

Autor: inż. Alexander Stefani

Konsultacja: Kamil Kozak

Open MAIN In Colab (a MAIN version of Jupyter notebook)

Idea is to develop an independent add-on (preferable VST plugin) for acoustical physical modelling of different shapes of saxophones to play as an virtual instrument in real-time through 4.x. MIDI controller. We will use open source tools and make a free closed product for artists.

The modelling will be calculated from OpenWinD library, JUCE VST creator and "popsicle" library for Python-JUCE integration.

The GUI can be assisted through Python FreeCADGui, JUCE Qt libraries and using language API for 3D modelling - CadQuery which is supported by FreeCAD.

The next milestone is to simulate all typical woodwind instruments through calculation many combinations of waveguides, throats and nozzles to learn a deep-learing algorithm to predict a physical synthesis of physics of woodwind acoustics, such as transmittance, nonlinearities, types of excitations, special sound production and articullations.

These machine learned results will be used for accelerate future add-on and create an AI predication of specifics of woodwinds.

Furthermore, we could use Marek Kac's isospectral (isophonic) theory for some strict constraints and use statistics spectral methods. The AI training and validating theory of isospectrality could be very innovative and will show emerging patterns of acoustics of wind instruments (not only): shape -> timbre, spatial boudaries -> harmonic function, which leads to solution of so-called Dirichlet problem in some special cases.

The project will be used for next generation of physical modelling synths using AI prediction 4.x. Hammond organ nonlinear (AI assisted) synthesis.

Potencial far milestone of this plugin will evolve to independent C++ program, 4.x. full-writen VST, without any "Pythonish-like" libraries, only based on trained AI model, possibly run on some microcontroller or microcomputer (STM32, RaspPi, Google Coral, Nvidia Jetson).

<<<<<<< Updated upstream Usage of this project will be also moved to KaRKAS - full trained AI morfing plugin for pipe organ simulation with evolving shapes (sound morphing).

Usage of this project will be also moved to KaRKAS - full trained AI morfing plugin for pipe organ simulation with evolving shapes.

Stashed changes

tapas's People

Contributors

alexxior avatar

Stargazers

 avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.