Leap motion is an infrared somatosensory control device that can choose whether to recognize organisms, such as human hands and hand models. This function can be used skillfully, such as holding a pencil in hand, to simulate a violinist holding a bow and better imitate the performer’s performance. This controller can be used in games, education, medicine, the Internet, artificial intelligence and other fields, and has a wide range of applications. Leap motion offers unlimited possibilities for music creation. Leap motion connects the computer through USB. After installing the driver, it can control the computer and software and use Leap motion. It has 1/100mm, 150. Ultra-wide space three-dimensional field of view with ultra-high accuracy, has more than 200 frames of speed to track hand movement, through the capture of hand movements into various control signals, it can track all 10 fingers, thermostatic element while showing the movement status of both hands.
By connecting with DAW, Leap Motion can easily control various MIDI signals, automation information of mixer, etc. Here, take Logic Pro X as an example, connect Leapmotion with computer.
After automatic scanning, the indicator light can be used as green. Then open the MIDI information editing interface and input the MIDI information you want to control. At this time, the host software will display the corresponding MIDI information input source, and the Logic MIDI signal detection window will also be prompted. Later, by locking a gesture in the MIDI editing interface, you can control a kind of information separately, either up-down or left-to-right. After locking, you can successfully trigger the set MIDI information by hand operation, thus controlling the parameters of instruments in DAW. For example, through the upward and downward movement of the hand, triggering controller 11 (expression control) to control the volume of the virtual instrument, can produce strong and weak fluctuations, there are changes in the details of the sound.
You can record the MIDI information you have drawn by hand through the recording key.
You can also choose to unlock the solo mode of MIDI information editing interface, so that you can use a variety of gestures to send multiple sets of control information, such as the up and down movements of the left hand to control the volume, the opening and closing of the right hand to control the movement of the violin bow, in order to achieve a more realistic playing mode. Leap motion provides a new way of music creation. Previously, we used mouse to draw MIDI CC signal, or use MIDI controller to control it.
This operation often requires a lot of time and repeated modifications, and is not accurate enough, inspiration is fleeting and inefficient. Now, through Leap Motion, you can enjoy a new way of control, which is more direct, more intuitive, more accurate and more smooth. Imagine that through the movement of the hands, you can control the strength of the instrument, playing techniques, the parameters of the effect instrument. Through Leap Motion somatosensory controller, we can combine our body movement with music. On the one hand, it is more performative and can make people see more control process, so that music is no longer dependent on listening, combining vision with hearing, and more artistic. On the other hand, through the movement of hands, you can control your virtual Orchestra like a conductor, making music creation more playable, rather than boring writing various control information. Leap motion is also suitable for live music performances. Through ingenious setting and practice, it can be used in percussion performance on the spot. The combination of one or more Leap motion controllers can form a set of air drums, i.
e. using gestures to trigger the components of each drum, and playing virtual shelf drums with drumsticks in isolation.
Create a new way of acting. On the DJ performance site, through the cooperation of Turntable, various audio effectors are controlled by hand motion information, and the forward, backward, acceleration and inversion of the disc are controlled to produce a combination of one or more audio effects. The use of the controller, instead of the traditional dish machine, is more convenient, fast and efficient.
The combination of Leap Motion and Muse can play a more powerful role. Muse is a control software developed for Leap Motion. Muse can be used to play complex chords, multiple voices, intricate rhythms, and free up and down tones. When we use Muse, we can control the parameters of timbre, reverberation, sound and image when we put the palm close to the screen. When we wave our fingers, we can add harmony, buzz, and all kinds of effect sounds. When we turn on Auto Muse function, we trigger the arpeggio in the software, so that the software can play freely and overlap at the same time. Add various voice parts. The mixing amount and EQ of the effector can be adjusted by gesture operation. Leap motion is no longer a simple hardware device, it has become a platform, developers can write various kinds of novel and practical software according to different needs to achieve different results. If the previous way of creating music was to write music on paper and then play with musicians, now, by using a laptop computer and somatosensory controller, one can accomplish all things by oneself, and a DJ can play with ease with only one laptop computer and Leap motion.
From then on, the creation of music from the development of inspiration, to the performance of musical instruments to the presentation of finished audio, everything is so simple and free. The development of music is inseparable from science and technology. The inspiration of science and technology comes from music. So that while we create music, we pay more attention to the connotation of music, and let music return to its most beautiful and pure essence – touching people’s hearts.