Animatronic RoboKaraoke

Message Sasquatch on discord to get an account.

Overview

For the Toorcamp NIGHTMRKT, provide a karaoke bar experience.
Allow people to provide their own Karaoke file for playing. (or buy one)

Provide royalty free songs that are interesting, probably by using AI.

Provide an animatronic band to play along with the karaoke singer, as a kids activity, see big mouth billy bass(ordered) and dancing cactus…

There is a display element, The user needs to see ahead a bit more than usual karaoke as they will not be familiar with the song. It will likely be the first time this song has been performed ever.

There should be a melody hint to the performer
There may be a vocoder to force the singers input to fit into the AI melody, hopefully to be a bit extreme and a bit funny for listeners.

AI generated lyrics with AI generated music. Lyrics displayed for a real human to sing to and a vocoder forces the melody as the person sings. Animatronics accompany the singer.

AI Song Lyrics

–AI generated songs will likely need 3 general inputs:
* Constraints for parsing and playing the song, such as specifying how to do chords, key, tempo, melody>
* A topic — such as feeding hungry cats, crocheting every day, deerfacts, The struggle to find parking
* A genre such as punk, thrash metal, ballad, 80s new wave, dance techno, dubstep

The application will consist of a prompt for those 3 fields.

The application may be written in python.
It may use online tools, and may require cutting and pasting.

The program should parse the music file and convert it into Midi or some other file. There are online programs that play chords, so it would be possible to estimate the stroke pattern based on the number of syllables each word has and how it lines up with the chords.

Language processing may be needed, breaking the lyrics into syllables is useful for karaoke..

using the international phonetic alphabet may be good.

AI song Melody and music

This part I am not sure about.

copilot was able to give compelling lyrics with chords and a key about a topic, for example, a punk song about a hungry cat.

a balad of the deer inundated with facts

Here’s an answer I got using Microsoft Copilot, the world’s first AI-powered answer engine. Select to see the full answer or try it yourself. https://sl.bing.net/buctZX8P6ZM

Ideal would be to make this sheet music.

I want real people to sing it.

it would be cool if the music adapted to the singer, but I also want the singer to be adjusted by a vocoder to match the melody.

to go beside this, there can be beat activated cactuse equivalents of animatronics.

Displaying the music for the Singer

Music Encoding

abc format can go to sheet music

Midi makes sense

mods may make sense

guitar tabs may be useful

a line by line timestamp with lyric, note and everything may be good.

Displaying the Music

Lets list programs that are already good at doing Karaoke, and the formats that these programs need and accept.
It may be better to show actual sheet music.

Integration

Python should be the glue.

https://www.vocaluxe.org looks really promising

Sheet music would be the best.

Since copilot can really output good song lyrics with the chords that a guitarist would be playing, it may be possible to just parse the file and break it into time sequences.

fall back is a regular Karaoke machine, people may have to buy songs if they want to sing something.

Animatronics

space constrained
arduino controller with servos
craft supplies like paint
paper mache
glue
3d printer kit may have stronger stepper motors.

rubber bands for making mouths move?


would be nice to sync the things with a real person dancing, if there is an open cv project that can find joints. and map them to a figure, we could copy what people are doing.

The servos will be weak.

Space for packing stuff is tight.

Prior art, includes dancing cactus, which is just a motor with a bent wire… and something like a sock.

BIg mouth billy bass, already bought…