Transcript Presentation Slides

Acoustic Art:
Revolutionizing The Way You
Listen To Pictures
Matt Clark (Image Analysis Expert)
Jay Davis (Spring Team Lead)
Kyle Kearney (Fall Team Lead)
Vince Tilanus (Client Liaison)
Louis Piano (Client)
Will French
(Industry Rep., Jive Software)
Dr. Karen Ward (Faculty Advisor)
Introduction
• Music out of images
• Beau Lotto (TED Talk)
• Visuals in sound therapy
Beau Lotto: Optical illusions show -how we see - Oct 2009. Ted.com
Why?
• Take an idea a step further
• Novel concept
• Combining abstract ideas
• Microsoft Imagine Cup
Image As Blocks
Design: Image analysis
• Edge Detection-Sobel Edge Detection (Sobel, 1991)
• Texture Analysis- Haar wavelet (Discrete
Wavelet Transform)
• Dominant Color-most common color (mode)
• Average Brightness-average all pixels (mean)
Life After Edge Detection
Design: Image analysis
• Edge Detection-Sobel Edge Detection
• Texture Analysis- Haar wavelet (Discrete
Wavelet Transform) (Sobel, 1991)
• Dominant Color-most common color (mode)
• Average Brightness-average all pixels (mean)
Texture Analysis
Design: Image analysis
• Edge Detection-Sobel Edge Detection
• Texture Analysis- Haar wavelet (Discrete
Wavelet Transform)
• Dominant Color-most common color (mode)
• Average Brightness-average all pixels (mean)
Dominant Color and Average Brightness
Design: Music Generation
• Take input from image analysis.
• Configurable instruments-user can edit and composer will
use.
• Multiple composers.
o Naive Pentatonic
o Music Theoretical
Naïve Pentatonic Composer
• Just brightness
• Pentatonic scale
o Guaranteed to have notes not clash
Music Theoretical Composer
• Apply basic music theory.
• Use all available image characteristics
• Generate:
o Rhythm
o Melody
o Counter-melody
o Harmony
o Bassline
o Volume
o Scale
o Key Change
Demonstration
Accomplishments
• Combined two forms of creative expression
o Visual Art
o Music
• Created a complex algorithm from scratch
Conclusion
• What next?
o MTC updates and modifications
o GUI progress display
o Next year senior project?
Questions?