TINKER PIEDESIGN IN INDIA

Air piano

Raise and lower your hand in the air to play high and low notes.

AI camerahandsmusic

Open in TinkerPie Studio

What you need

Step by step

  1. Open Air piano in TinkerPie Studio. It opens as blocks.
  2. Press Run, then Start camera in the AI camera panel and allow the webcam. No webcam? Use the “Pretend here” controls.
  3. Connect TinkerPie with a USB-C cable in Chrome or Edge, press Connect, then Download. Or, with Studio started from the TinkerPie launcher on your computer, open the Arduino C++ tab and press Build & Flash.
  4. Change something: a colour, a number, a sound. Then run it again.

The code

This is the program the blocks make. The same program runs in the simulator and on the board.

JavaScript
basic.forever(function () {
  if (ai.handVisible()) {
    led.plot(2, Math.round(math.map(ai.handY(), 0, 100, 0, 4)), Colors.Purple);
    music.playTone(Math.round(math.map(ai.handY(), 0, 100, 1047, 262)), 150);
    basic.clearScreen();
  } else {
    music.stopAll();
    basic.pause(50);
  }
});
Arduino C++ (TinkerPie library)
// Air piano
// Arduino C++ made by TinkerPie Studio from the blocks. Board: TinkerPie V1 (ESP32-S3).
// Arduino IDE: install the TinkerPie library (Studio menu > Arduino library), then Tools > Board > ESP32S3 Dev Module,
// USB CDC On Boot: Enabled, Flash Size: 16MB, Partition Scheme: 16M Flash (3MB APP/9.9MB FATFS), PSRAM: OPI PSRAM.
#include <TinkerPie.h>
using namespace tinkerpie;

void setup() {
  tinkerpie::begin();
  basic::forever([]() {
    if (ai::handVisible()) {
      led::plot(2, round(math::map(ai::handY(), 0, 100, 0, 4)), Colors::Purple);
      music::playTone(round(math::map(ai::handY(), 0, 100, 1047, 262)), 150);
      basic::clearScreen();
    } else {
      music::stopAll();
      basic::pause(50);
    }
  });
}

void loop() {
  tinkerpie::loop();   // runs the forever blocks and handles events
}

More projects like this

Finger counterShow 1, 2, 3… fingers to the webcam and TinkerPie shows the number. Use both hands for up to 10!AI cameraRock, paper, scissorsPlay against TinkerPie with your hand: fist = rock, open hand = paper, peace sign = scissors.AI cameraThumbs-up votingA class vote: thumbs up counts YES, thumbs down counts NO. Button A shows the result.AI cameraHand-controlled servoMove your hand left and right: a servo on S1 follows it, like a robot arm.AI cameraFace greeterWhen someone looks at the camera, TinkerPie smiles and says HI. When they leave, it falls asleep.AI cameraFace-following robotA two-wheel robot turns to keep your face in the middle of the camera picture.AI camera