Showing posts with label music. Show all posts
Showing posts with label music. Show all posts

Wednesday, March 8, 2023

Neural Amp Modeler (NAM) running on Raspberry Pi


Recently I've been messing around with, and contributing to the Neural Amp Modeler project. It uses machine learning (more specifically the WaveNet model) to create captures of amplifiers and distortion pedals.

It has been gaining a lot of traction recently, with lots of people modeling their equipment. The resulting models are very good.

I've now got it integrated into my Raspberry Pi pedalboard. The audio for the above video was recorded on a Raspberry Pi 4.

The hardware on the pedalboard consists of:

- Raspberry Pi 4
- Hotone Jogg audio interface
- Hotone Ampero Control MIDI Controller
- Wio Terminal (used for a serial-based display)

My pedalboard is using a custom app on top of Jack audio, but I have also made a Neural Amp Modeler LV2 plugin available.

Tuesday, September 13, 2022

Chord data for jazz standards

I recently started playing jazz on bass guitar. So naturally, I also recently started writing software for facilitating jazz practice.

As a basis for a number of my projects, I needed access to chord data from a corpus of jazz standards. The best source I found was the database of user-submitted scores for the IReal mobile app: https://www.irealpro.com/main-playlists

I've been converting these to an easy-to parse json format. The current database of songs can be found here:


Here is an example score:   
  
{ "Title": "Alone Together", "Composer": "Schwartz Arthur", "Key": "D-", "Rhythm": "Medium Swing", "Sections": [ { "Label": "A", "MainSegment": { "Chords": "Dm6|Em7b5,A7b9|Dm6|Em7b5,A7b9|Dm6|Am7b5,D7b9|Gm7|Gm7|Bm7,E7|Gm7,C7|Fmaj7|Em7b5,A7b9" }, "Endings": [ { "Chords": "Dmaj7|D(Em7b5),(A7b9)" }, { "Chords": "Dmaj7|Dmaj7" } ] }, { "Label": "B", "MainSegment": { "Chords": "Am7b5|D7b9|Gm6|Gm6|Gm7b5|C7b9|Fmaj7|Em7b5,A7b9" }, "Endings": [] }, { "Label": "A", "MainSegment": { "Chords": "Dm6|Em7b5,A7b9|Dm6|Em7b5,A7b9|Dm6,Bm7b5|Bb7,A7b9|Dm6|Em7b5,A7b9" }, "Endings": [] } ] }

Thursday, January 30, 2020

Using the Mod Devices guitar effects interface on Raspberry Pi 4


My last post was about getting my Boss GT-1 guitar effects floorboard to work in Linux. The reason I wanted to do this was to couple it with a Raspberry Pi to create a more configurable effect chain using LV2 plugins.

Once I had audio working, I installed Guitarix, an open-source guitar effects stack for Linux, and I was quickly off to the races. Guitarix works really well, but the interface is designed for desktop use - not ideal for my needs.

I had been aware of Mod Devices for a while, with their Mod Duo multi-effects hardware pedals built on top of Linux. They have added a slick, web-based pedalboard interface running on top of LV2 plugins. It is primarily designed for their hardware devices, but the project is open source.

The folks over at blokas.io have a project called MODEP, which provides a custom Raspberry Pi image for running the Mod Devices interface. Unfortunately, it currently does not work on Raspberry Pi 4, which is what I have.

So, I went straight to the Mod Devices GitHub and built it myself. It turned out to be pretty straightforward, and I was up and running after about a half an hour of tinkering. I'm going to try to outline what I did here in case anyone else wants to give it a try:

Get Jack running with audio capture and playback - there is plenty of information out there on this

Get the Mod software from GitHub:
  git clone --depth 1 https://github.com/moddevices/mod-host
  git clone --depth 1 https://github.com/moddevices/mod-ui
Install the tools you need to build the mod software. You'll need at least:
sudo apt-get install virtualenv python3-pip python3-dev git build-essential libasound2-dev libjack-jackd2-dev liblilv-dev libjpeg-dev zlib1g-dev
Build mod-host from the mod-host directory:
make
sudo make install
cd mod-ui
make
sudo make install
Make sure Jack is running, and start mod-host:
mod-host -n -p 5555 -f 5556
In another shell, build mod-ui from the mod-ui directory:
virtualenv modui-env
source modui-env/bin/activate
pip3 install -r requirements.txt
make -C utils
Run mod-ui from the mod-ui directory (you will also need to do "source modui-env/bin/activate" first if you did not just do it in the above build step):
export MOD_DEV_HOST=0
export MOD_DEV_ENVIRONMENT=1
export MOD_APP=1
export MOD_LIVE_ISO=1
python3 ./server.py
The mod-ui web server should now be running on port 8888. To access it, find out the IP address of your Raspberry Pi, and go to:
http://YOUR-PI-IP:8888/
You should see the Mod pedalboard interface. It should load whatever LV2 plugins you have in /usr/lib/lv2 with a generic look. In my case, I had Guitarix installed and all of its plugins were there and ready to be used.

The Mod folks have custom UI overlays for most popular plugins. You can grab them here:
git clone --depth 1 https://github.com/moddevices/mod-lv2-data
Look in the "plugins" and "plugins-fixed" sub-folders for your plugins. If you copy a plugin folder over your existing plugin in /usr/lib/lv2, you will install the custom UI for the plugin.

My Pi 4 has no trouble at all running a decently complex guitar effect stack, complete with multiple pedals and pre-amp and cabinet simulation, all at very low latency.

Monday, April 5, 2010

So far so good, despite the baby...

Tunescape

When Tunescape hit the New Arrivals list on Xbox Live Indie Games, my first reaction was "Cool!". My second reaction was "What's up with that baby?". I'm guessing a lot of other people have the same reaction. Oh, well - nothing I can do about that.

Despite the baby, Tunescape is off to a pretty good start (at least by Indie Games standards). It made the Top Downloads page today, which was a very pleasant surprise. My trial to purchase conversion rate so far is almost 10% 12% 14%,  which I am also quite pleased about.

Friday, April 2, 2010

Tunescape is live on Xbox Indie Games!

Tunescape passed peer review earlier today and is now available on Xbox Live Indie Games for 80 Microsoft points ($1). I know, pretty spendy...

Last time I checked, it was not yet showing up in the "New Arrivals" section, but if you search for it under 'T', you can find it.

The Tunescape page on the web-based marketplace is here.

I've also put together a little promo website:

  tunescape.nostaticsoftware.com

Monday, March 29, 2010

Latest Tunescape Screenshots

Tunescape

I submitted Tunescape into the peer review process for Xbox Live Indie Games today, so I needed to update my screenshots. This is what the game is looking like right now.

Tunescape

Tunescape

Tunescape

Thursday, March 4, 2010

Tunescape Tutorial Video



This is the in-game tutorial in Tunescape.

Tuesday, March 2, 2010

Tunescape DBP 2010 Trailer



This is the Tunescape trailer for DreamBuildPlay 2010.

I suck at video editing...

Friday, February 12, 2010

Tunescape Update

Tunescape

I've managed to avoid my standard behavior and have been pushing to try to actually finish (!!) Tunescape. It is in pretty good shape right now, and I've currently got it in playtest over on Xbox Live Indie Games.

In polishing the game, I've been doing some fun shader work. I implemented a particle system shader for my new explosion effects, and I created a "plasma" shader for the background that uses multi-resolution noise to generate a smoothly moving cloud pattern.

Tunescape

Friday, November 6, 2009

Music-based Gameplay

Music-based Gameplay

My latest project is a game that uses music as the gameplay content. I use spectrum information to detect energy pulses in the music and use peaks to trigger emission of particles. The object of the game is pretty simple - collect the particles while avoiding the red boulder-thingies. Grabbing stars increases a score multiplier.

Music-based Gameplay

Collecting the particles, in addition to increasing your score, fuels three kinds of colored energy - shown by the three lines inside your circle. This energy can be expended to use a shield, give you a speed burst, or temporarily suck particles toward you.

There are also cooperative and competitive multiplayer gameplay modes. This is a mode where players are "bungied" together:

Music-based Gameplay

Here is a gameplay video: