Transcript Diapositiva 1

E-infrastructure shared between Europe and Latin America
Music from Volcanoes on the
Network
Domenico Vicinanza
CERN – Geneva – Switzerland
University of Salerno - INFN Catania - Italy
Conservatory of Music of Salerno - Italy
Hugo Yepez
Istituto Geofisico – EPN – Quito - Ecuador
IST-2006-026409
www.eu-eela.org
Volcano eruption forecasting
E-infrastructure shared between Europe and Latin America
• Currently no definitive method to predict the eruption
of a volcano has been discovered or implemented (yet).
• Scientists monitor
– seismic waves
– number of earthquakes and the intensity of a specific type of
quake (harmonic tremors) in the run up to eruptions.
– changes in the shape of the volcano or concentrations of gases
emitted from the cone.
IST-2006-026409
www.eu-eela.org
TNC2007 - Copenhagen, May 21st 2007
2
The hope: music for forecasting
E-infrastructure shared between Europe and Latin America
• By correlating spectra and melodies with precise
stages of volcanic activity we hope to discover a sort
of “signature tune” of an imminent eruption or
earthquake.
• By identifying musical patterns that warn of an
eruption it would be possible to implement civil
protection measures, days or even hours before the
event
IST-2006-026409
www.eu-eela.org
TNC2007 - Copenhagen, May 21st 2007
3
E-infrastructure shared between Europe and Latin America
Data Audification
• Data audification can be considered as the acoustic
counterpart of data graphic visualization, a mathematical
mapping of information from data sets to sounds.
• Data audification is currently used in several fields, for
different purposes:
– science and engineering,
– education and training,
mainly as data analysis and interpretation tool.
• Although most data analysis techniques are exclusively
visual in nature, data presentation and exploration systems
could benefit greatly from the addition of sonification
capabilities.
IST-2006-026409
www.eu-eela.org
E-infrastructure shared between Europe and Latin America
Motivations
• Sonic representations are particularly useful when dealing
with complex, high-dimensional data, or in data monitoring
tasks where it is practically impossible to use the visual
inspection, or for pattern detection.
• Research has shown that people are quite more confident in
recognizing patterns audibly rather then visually
• Music theorists and researchers have carried out in centuries
of history lots of techniques and methods to detect, study and
classify musical phrases
• Main idea: Music as a language and music analysis as a tool
to inspect scientific data
IST-2006-026409
www.eu-eela.org
Sonification on the GRID network
E-infrastructure shared between Europe and Latin America
• First experiments involving sound production with
INFN-GRID facilities started during the last months of
2003.
• In September 2003, it was installed CSound, a free and
cross-platform acoustic compiler, on a GRID test site,
the Catania INFN-GRID computer farm
• The compiler was tested within the new environment
and since its beginning, the test phase produced
interesting results: efficient use of the calculus
resources, customizable quality of the audio files.
IST-2006-026409
www.eu-eela.org
TNC2007 - Copenhagen, May 21st 2007
7
E-infrastructure shared between Europe and Latin America
Computing power
• The computing power needed to run data sonification
(and analyze patterns) and the mass storage to keep
results are really large
• To create one minute of music coming from volcanoes,
the algorithm has to process:
– more than 2.6 Millions data
– taking more than 100 Mb of disk space
– and 10-12 CPU hours
• This is why GRID is a natural platform for this kind of
studies
• Moreover the possibility granted by the Grid to have a
unique distributed shared database accessible from
the researcher of all the word will pave the way for an
effective interaction among researchers
IST-2006-026409
www.eu-eela.org
TNC2007 - Copenhagen, May 21st 2007
8
Java Sound Production Package
E-infrastructure shared between Europe and Latin America
• Sound production suite based on Java (equipped with
the standard audio and math libraries), more flexible and
easy to manage.
• All the results presented in this website have been
carried on using this last approach: sample computation,
audio rendering, DFT computing were obtained with the
Java sonification program on the GRID
Executable = "/bin/sh";
StdOutput = "sonification.out";
StdError = "sonification.err";
InputSandbox = {"sonification.sh", "Sonification.java", "etna.dat"};
OutputSandbox = {"Sonification.aiff", "Sound.dat","Spectrum.dat",
"sonification.out","sonification.err", "logfile"};
RetryCount = 7;
Arguments = "sonification.sh";
IST-2006-026409
www.eu-eela.org
Sound form volcanoes
E-infrastructure shared between Europe and Latin America
• Sonified data were geophysical
data collected by digital
seismographs placed on the Etna
volcano in Catania (Italy) and on
Tungurahua volcano in Ecuador.
•Data from Tungurahua are
transferred from the Ecuadorian
NREN, CEIDA, to GARR in Italy via
RedCLARA’s 622 Mbps
connection to GEANT2
Etna Volcano
• We carried out two sonifications:
– seismogram straight
sonification (tranformation into an
audible waveform)
– seismogram melodisation
(tranformation into a melody)
Tungurahua
IST-2006-026409
www.eu-eela.org
(Picture: M. Monzier IRD/IG-EPN)
About seismograms audification
E-infrastructure shared between Europe and Latin America
• In both the cases, structural properties of the
seismographic information would be straightly mapped
into sound or melody properties
• In the first case, regularities in the seismograms will
be reflected into spectral lines in the sonified signal
• In the second case, regularities in the seismograms will
be transferred into regularities in the melody (such as a
repeated set of data will become a repeated musical
phrase)
IST-2006-026409
www.eu-eela.org
TNC2007 - Copenhagen, May 21st 2007
11
Quasi-regular phenomena
E-infrastructure shared between Europe and Latin America
• The waveform coded in the audio file will have exactly
the same regularities, also recognizable thanks to the
presence of some higher lines in the spectrum.
• The order of magnitude of the frequency of quasiregular phenomena is in the range 0-50 Hz, with a
spectral envelope centered around 25-30 Hz.
IST-2006-026409
20x resampled Etna seismogram
www.eu-eela.org
Etna waveform and sonogram
E-infrastructure shared between Europe and Latin America
IST-2006-026409
www.eu-eela.org
Tungurahua Waveform
E-infrastructure shared between Europe and Latin America
IST-2006-026409
www.eu-eela.org
TNC2007 - Copenhagen, May 21st 2007
16
Tungurahua Spectrum
E-infrastructure shared between Europe and Latin America
Spectral lines = Regular patterns
IST-2006-026409
www.eu-eela.org
TNC2007 - Copenhagen, May 21st 2007
17
Tungurahua Sonogram
E-infrastructure shared between Europe and Latin America
Time evolution of the spectrum. Each vertical slice is the spectrum at a certain time
Oscillation pattern variations
are clearly visible in the pattern
IST-2006-026409
www.eu-eela.org
TNC2007 - Copenhagen, May 21st 2007
18
E-infrastructure shared between Europe and Latin America
Data melodization
• The whole data set interval is mapped on the (equally
tempered) piano keyboard
• The min value of the seismographic data will
correspond to the lowest playable note on the piano
keyboard
• The max value to the highest playable note
IST-2006-026409
www.eu-eela.org
TNC2007 - Copenhagen, May 21st 2007
20
E-infrastructure shared between Europe and Latin America
Main advantages
• Already available tools to manage MIDI files and
analyze them
• Tracking the evolution of the musical intervals, the
dynamics of their patterns, it is possible to detect, with
an high level and in a customizable way, any kind of
modifications in the shape of seismogram.
Two example of MIDI analysis (free) software:
• Rubato (www.rubato.org)
• MIDI Toolbox (http://www.jyu.fi/musica/miditoolbox/)
IST-2006-026409
www.eu-eela.org
TNC2007 - Copenhagen, May 21st 2007
21
E-infrastructure shared between Europe and Latin America
IST-2006-026409
www.eu-eela.org
MIDI Toolbox
TNC2007 - Copenhagen, May 21st 2007
22
Dynamic evolution of the tonalities
(related to couples of adjacent values)
E-infrastructure shared between Europe and Latin America
IST-2006-026409
www.eu-eela.org
TNC2007 - Copenhagen, May 21st 2007
23
Example: Sinusoidal behavior
E-infrastructure shared between Europe and Latin America
•
0.0
0.587785252292
0.951056516295
0.951056516295
0.587785252292
0.0
-0.587785252292
-0.951056516295
-0.951056516295
-0.587785252292
0.0
0.587785252292
0.951056516295
0.951056516295
0.587785252292
0.0
Original data
IST-2006-026409
Graphical representation
www.eu-eela.org
E-infrastructure shared between Europe and Latin America
Sinus melodization
Data are periodic, so the melody is periodic, with the same period
Music representation
(of the same set of data)
IST-2006-026409
www.eu-eela.org
Melodization: a pictorial view
E-infrastructure shared between Europe and Latin America
• Pictorially we can say that the melodization works by
overlaying seismograms with music notes
• To create the volcanic score, we take a seismogram
and trace the shape on to blank music bars.
• Then we overlay the contours with musical notes.
IST-2006-026409
www.eu-eela.org
TNC2007 - Copenhagen, May 21st 2007
26
Seismograms Melodisation
E-infrastructure shared between Europe and Latin America
IST-2006-026409
www.eu-eela.org
Seismograms Melodisation
E-infrastructure shared between Europe and Latin America
IST-2006-026409
www.eu-eela.org
Seismograms Melodisation
E-infrastructure shared between Europe and Latin America
IST-2006-026409
www.eu-eela.org
Seismograms Melodisation
E-infrastructure shared between Europe and Latin America
… have you ever heard a volcano playing a piano ?
IST-2006-026409
www.eu-eela.org
E-infrastructure shared between Europe and Latin America
Melody follows
the shape
of the
oscillation
IST-2006-026409
www.eu-eela.org
TNC2007 - Copenhagen, May 21st 2007
31
First Etna-Tungurahua duet
E-infrastructure shared between Europe and Latin America
Players:
• Mt Etna: Piano
• Mt Tungurahua: Guitar
IST-2006-026409
www.eu-eela.org
TNC2007 - Copenhagen, May 21st 2007
32
E-infrastructure shared between Europe and Latin America
Reference sites:
• Etna Sonification website:
http://grid.ct.infn.it/etnasound
• Tungurahua Sonification web repository:
http://grid.ct.infn.it/tungurahuasound
• MIDI Toolbox manual:
http://www.jyu.fi/musica/miditoolbox/MIDI_Toolbox_Ma
nual.pdf
IST-2006-026409
www.eu-eela.org
TNC2007 - Copenhagen, May 21st 2007
33
Thanks! …Questions
E-infrastructure shared between Europe and Latin America
IST-2006-026409
www.eu-eela.org
TNC2007 - Copenhagen, May 21st 2007
34