Pixel-based musical notation. That's what I'm still experimenting with.
Formerly I was taking a photographic narrative approach and creating a musical score based on a series of images. This was okay, but it turns out people are actually more interested in how changing the graphic changes the resulting audio. It's also interesting to see what type of image (photograph, in this case) creates the most appealing or dynamic range of sounds.
Through breaking down many different photographs into pixel based musical notation, I've found the most exciting audio comes from images that have a varying, somewhat vertical pattern. Diagonally balanced patterns are also very nice.
EXAMPLES OF IMAGES THAT AREN'T SO AWESOME IN AUDIO FORM:
(As a reminder, the audio notation reads from left to right. The pitch is determined by the height of a pixel, and the brighter the pixel, the louder the audio value.)
I will edit these examples to play in the same key for comparison's sake.
A graphic of simple horizontal lines has no rhythm and no variations in melody:
A graphic of vertical lines has an obvious rhythm but also has no movement of melody:
So there is definite motivation to use images that actually will make for interesting audio.
For my final end product this semester, I will still be making a video with the images and their corresponding sounds, but instead of using narrative photographs, I have chosen to just photograph things I see within walking distance of my house that I think will sound the best. I am mostly looking for interesting patterns that transform both horizontally and vertically.
Here is one example:
Depending on how I change this bitmap image, the sound also changes. To show this relationship, I will also include different variations for each photograph (which will be included in the video).
Compare the following graphic and audio to the previous one. Notice how the more elongated tones in the second example match the longer horizontal groups of pixels.
I will also include all the edited graphics of the notation in my final body of work.