Leap Motion & KRONOS

[Corgy]

Sharp - is this you on the LASERS?

lol... I'm afraid so.

Cool - I envy you and many thanks for the links . I will check it out ... and I will stop kidnapping the thread for LASER harps - back to leap motion then ...

Kind regards
Corgy

[Bertotti]

That pad video was very well done. I suppose now I will have to load the Kronos driver into my Mac and start the integration process. I am also curious to interface it to some of the maschine parameters. Either way this thing is a ball. I sure hope it goes mainstream.

[Corgy]

Just finished a jam session with Leap Motion, Geco, and Kronos checking out, how much dynamics can be inserted in a standard Kronos program sound.

I selected one of my favorites, Stradivarious, did some setup in Geco and startet improvising with my right hand and moving some air quickly with the left. Man, this thing is realy fast and responsive. Never had such modulation dynamics before. Don't know, if one could do the same with the joystick without damage

The Leap Motion/Geco rigg can indeed be recommended as a very dynamic and versatile modulation controller.

[Yuma]

I was just thinking... would it be possible with LeapMotion to give sound to an air guitar?

[Corgy]

I was just thinking... would it be possible with LeapMotion to give sound to an air guitar?

I suppose - yes.

Get the sensor fixed to your body or belt and try using it together with the AeroMidi app, which allows to play a kind of "3D keyboard" and generate notes on a rompler or synth.

Why not?

[Chrutil]

The Leap is pretty cool, I preordered one so long ago that I forgot about it and was taken by surprise when it showed up. Haven't hooked it up to my gear yet, but Sharp's stuff looks great so I might.

Next up is doing it with your mind: http://www.kickstarter.com/projects/tan ... ss-and-per

C

[Corgy]

Just wanted to share my first experience with AeroMidi, which is also available for Leap Motion to control Midi instruments. The testbed was a

- Intel-i7 PC with Win 7, 64bit
- Aeromidi-Demo and the corresponding driver, and
- the Leop Motion sensor

The idea behind the app is to have a couple of virtual boxes in 3d space in front of you and by "touching" those boxes the app generates notes or CCs. The manual suggests to start with one streched out finger and poke it into the virtual boxes. After some exercise two hands with single fingers or more fingers could be used also. The GUI of the app is clear arranged and easy to learn. You can create patterns of boxes as you like: strings, rings, arrays, ... and you may put your boxes everywhere in 3D inside the field of view of the sensor.

But the fun was limited by poor reliability of recognition of the hand. My impression was that the trigger point to activate a virtual box changed often without reason and sometimes my finger was not recognized at all. The misfunction could be caused by myself and/or a bad setup. But having worked with Geco in the identical environment before, I can tell, that Geco seems to have a much better sensibility, recognition, and reliability right out of the box.

If any of you knows better, I would appreciate advice. For this Aeromidi app has got interesting potential to play tunes and CCs out of space simultaneously.

[Sharp]

Does it have the options like Geco where you can increase detection by specifing the probably of the first hand it will see will be a Left hand or a right hand?

I also find that if your pointing with index finger, it's best to tuck your thumb underneath than pressing it into the side of your hand.

If you see the video of me using KARMA and Pads above, chances are I'm probably doing this in the video.

Given time, I think all the application and the leap motion software / firmware itself will evolve greatly.

Some apps like Geco run very well already, but they too will get much better in time.

Regards
Sharp

[Corgy]

Does it have the options like Geco where you can increase detection by specifing the probably of the first hand it will see will be a Left hand or a right hand?

Not exactly this way. In "preferences" "max. fingers" and "max. hands" can be set. Didn't find something about left/right hand. And there is also a slider with "Hand Tracking Sensitivity". Didn't check out all the possibilities provided there.

I also find that if your pointing with index finger, it's best to tuck your thumb underneath than pressing it into the side of your hand.

If you see the video of me using KARMA and Pads above, chances are I'm probably doing this in the video.

Yep, this is what I do too. Just don't expose, what could be confusing to the sensor.

Given time, I think all the application and the leap motion software / firmware itself will evolve greatly.

Some apps like Geco run very well already, but they too will get much better in time.

Yes Geco is a great app. I was amazed how Geco was performing without a special set up or training. Others will follow. For music production with Midi interfaces Geco is a milestone.

[metallo]

This is absolutely impressive:

http://www.youtube.com/watch?v=TjF8JN5aVfc

Imagine doing this on the kronos with leap motion, it would be great.

And this gave me the idea to do it on the kronos using the vector joystick just to gave more expressivity to the orchestral parts....is it possible?

[Sharp]

This is absolutely impressive:

http://www.youtube.com/watch?v=TjF8JN5aVfc

Imagine doing this on the kronos with leap motion, it would be great.

That was a pretty darn good video. Thanks for sharing.

Sharp.

[Corgy]

This is absolutely impressive:

http://www.youtube.com/watch?v=TjF8JN5aVfc

Imagine doing this on the kronos with leap motion, it would be great.

And this gave me the idea to do it on the kronos using the vector joystick just to gave more expressivity to the orchestral parts....is it possible?

Thanks for sharing - it's impressive and looks like conducting a symphonic orchestra, which responds to the motions.

With Leap Motion & Gecko you can do the same thing at the Kronos - given you have one and a computer connectec to the keyboard. So far I used Leap Motion to control various Kronos synth parameters, but the volume sliders of a combi should allow to link them to the corresponding midi channels. There is only not such thing as midi learn in the Kronos, but Gecko allows direct input of CC numbers.

But I fear, the use of a joystick instead of Leap Motion will not do, to achieve a similar man-instrument interface. A joystick does not support the same degrees of freedom (I counted at least 4 in the video, 3D plus roll of the hand) a stick allows for two only.

[metallo]

This is absolutely impressive:

http://www.youtube.com/watch?v=TjF8JN5aVfc

Imagine doing this on the kronos with leap motion, it would be great.

And this gave me the idea to do it on the kronos using the vector joystick just to gave more expressivity to the orchestral parts....is it possible?

Thanks for sharing - it's impressive and looks like conducting a symphonic orchestra, which responds to the motions.

With Leap Motion & Gecko you can do the same thing at the Kronos - given you have one and a computer connectec to the keyboard. So far I used Leap Motion to control various Kronos synth parameters, but the volume sliders of a combi should allow to link them to the corresponding midi channels. There is only not such thing as midi learn in the Kronos, but Gecko allows direct input of CC numbers.

But I fear, the use of a joystick instead of Leap Motion will not do, to achieve a similar man-instrument interface. A joystick does not support the same degrees of freedom (I counted at least 4 in the video, 3D plus roll of the hand) a stick allows for two only.

I still don't have the leap motion, I'm going to get one soon.
BTW the vector joystick is for sure more limited but probably is it possible to do something interesting.

Question: Is Geco an app that runs on the ipad?

[Corgy]

This is absolutely impressive:

http://www.youtube.com/watch?v=TjF8JN5aVfc

Imagine doing this on the kronos with leap motion, it would be great.

And this gave me the idea to do it on the kronos using the vector joystick just to gave more expressivity to the orchestral parts....is it possible?

Thanks for sharing - it's impressive and looks like conducting a symphonic orchestra, which responds to the motions.

With Leap Motion & Gecko you can do the same thing at the Kronos - given you have one and a computer connectec to the keyboard. So far I used Leap Motion to control various Kronos synth parameters, but the volume sliders of a combi should allow to link them to the corresponding midi channels. There is only not such thing as midi learn in the Kronos, but Gecko allows direct input of CC numbers.

But I fear, the use of a joystick instead of Leap Motion will not do, to achieve a similar man-instrument interface. A joystick does not support the same degrees of freedom (I counted at least 4 in the video, 3D plus roll of the hand) a stick allows for two only.

I still don't have the leap motion, I'm going to get one soon.
BTW the vector joystick is for sure more limited but probably is it possible to do something interesting.

Question: Is Geco an app that runs on the ipad?

With the joysticks (2) you can do a lot of things - I love to have two of them! But one hand at the keys and one hand on one of the sticks is a limitation compared to one hand in multi-D space of Leap Motion.

Gecko is an app and integrates in the "Airspace" environment, which is part of the Leap Motion support software. You install the driver and "Airspace" on your computer and from there you go to the "Airspace Store" to get "Airspace Apps", like Gecko. Some are free and for some you have to pay an App-typical price. "Airspace" is for Mac and PC, but I have not seen iPad yet.

[metallo]

Thanks for sharing - it's impressive and looks like conducting a symphonic orchestra, which responds to the motions.

With Leap Motion & Gecko you can do the same thing at the Kronos - given you have one and a computer connectec to the keyboard. So far I used Leap Motion to control various Kronos synth parameters, but the volume sliders of a combi should allow to link them to the corresponding midi channels. There is only not such thing as midi learn in the Kronos, but Gecko allows direct input of CC numbers.

But I fear, the use of a joystick instead of Leap Motion will not do, to achieve a similar man-instrument interface. A joystick does not support the same degrees of freedom (I counted at least 4 in the video, 3D plus roll of the hand) a stick allows for two only.

I still don't have the leap motion, I'm going to get one soon.
BTW the vector joystick is for sure more limited but probably is it possible to do something interesting.

Question: Is Geco an app that runs on the ipad?

With the joysticks (2) you can do a lot of things - I love to have two of them! But one hand at the keys and one hand on one of the sticks is a limitation compared to one hand in multi-D space of Leap Motion.

Gecko is an app and integrates in the "Airspace" environment, which is part of the Leap Motion support software. You install the driver and "Airspace" on your computer and from there you go to the "Airspace Store" to get "Airspace Apps", like Gecko. Some are free and for some you have to pay an App-typical price. "Airspace" is for Mac and PC, but I have not seen iPad yet.

Thanks for the explanation, I'm going to get one