showcasing multitouch string simulator on ipad with a common chord progression try it yourself over at should work on an iphone too. how is it on android phones/tablets?

goal now is to add chords for specific songs. people with kids: what themes or songs would they enjoy strumming the most? the goal is to make it so kids can get the feel of strumming/rhythm/plucking without knowing an instrument

it's possibly a bit over-engineered but the sounds & visuals are synthesized from the same identical math: based on the pluck position, at the moment of release, the fourier transform of the pulled string provides the amplitudes for all possible overtones & about 12 overtones are used per string lower freq overtones decay faster, like they do IRL, making the sound a bit twangy the audio math is done on the GPU with some hacky WebGL code

the project started from trying to figure out what exactly makes a string pluck sound different when you pluck it from the edge vs. the middle applying the math to both sound & visuals made it so checking correctness is easy (by comparing to slow motion vids)

A little bit of crackle on iOS, usually helps to add an envelope w/ couple ms of attack time to the start to fix that

i did that actually, it seems the sound is clear when it's just one string or so. i think there's an issue with clipping with too many strings maybe? do you get crackles even with one string?

@mrdoob Works great on my pixel 6a although the audio crackles a bit.

@mrdoob good to know, thanks!

This is amazing! I accidentally realized if you strum “between” two chords (the base notes of one and the high notes of the one above it) you end up with nice 7 chords.

i noticed the same. very intuitive for learning about composition isn't it