[Request] library for audio analysis

Found this via reddit. any chance to get it as a Plugin or FX?

Javascript music analysis library

https://github.com/wizgrav/clubber/

Clubber is a small library that analyzes the frequency data from an audio source and extracts rhythmic information. The processing takes the music key into account and outputs data in a form suitable for direct use in webgl shaders. It is a step above simple beat detection and allows for rapid creation of visualisations that sync pleasantly with the audio.

demo: http://wizgrav.github.io/clubber/

Yeah hopefully Ashley can add this in for the next update.

https://developer.mozilla.org/en-US/doc ... _Audio_API

adcornaglia

That bit is already implemented in C2.

R0J0hound I can analyze the audio from my speakers in C2? IE: Have it analyze anything from what's playing in VLC to a Mic/Line-in? If so please educate me good sir XDDDDDDDDDD.

Off the top my head there is the audio analyzer example bundled with C2. It works with sounds you play from your game. To use it with you mic add the userMedia object to access it, and it then is tied in with the audio plugin. line out/line in aren't accessible as far as I know.

adcornaglia

Thread of analyzing mic input

BTW, this topic is not EFFECT, it is plugin/behavior.

The interessting part for me to read was "outputs data in a form suitable for direct use in webgl shaders".

if this is possible the i must RTFM and study C2 more.

Sorry, for posting to a wrong section.

totoe

It might be 3 steps

1. ability to get input data

2. processing data

tone.js plugin could get mic data and analyze the amplitude, like official audio does. (step 1, 2)

3. present data, might show by sprites or draw on canvas.

totoe

It might be 3 steps

1. ability to get input data

2. processing data

tone.js plugin could get mic data and analyze the amplitude, like official audio does. (step 1, 2)

3. present data, might show by sprites or draw on canvas.

rexrainbow . Yes, thank you seen that. It is completely unnecessary and impractical in it's current state though. Music analysis needs to be down to the second if not millisecond in some cases.

The HTML5 API is already in place, it just needs to be integrated. Not to mention I'm not a fan of relying on a plugin somebody else made. Also, MediaStreamAudioSourceNode Interface: covers microphone input live, also just would need to be integrated. https://dvcs.w3.org/hg/audio/raw-file/t ... SourceNode

Ashley , R0J0hound Here are two methods of html5 live audio input:

https://www.html5rocks.com/en/tutorials ... dia/intro/

&

https://developers.google.com/web/updat ... ut-Enabled:

// success callback when requesting audio input stream

function gotStream(stream) {

window.AudioContext = window.AudioContext || window.webkitAudioContext;

var audioContext = new AudioContext();

// Create an AudioNode from the stream.

var mediaStreamSource = audioContext.createMediaStreamSource( stream );

// Connect it to the destination to hear yourself (or any other node for processing!)

mediaStreamSource.connect( audioContext.destination );

}

navigator.getUserMedia = navigator.getUserMedia || navigator.webkitGetUserMedia;

navigator.getUserMedia( {audio:true}, gotStream );

adcornaglia

Thread of analyzing mic input

BTW, this topic is not EFFECT, it is plugin/behavior.

rexrainbow meant that reply about this.

R0J0hound shouldn't this topic should be under Javascript SDK since it's actually to do with Construct 2's functionality of the audio API and not effects except as an end result?