not

Download Report

Transcript not 

#DEEPDREAM DREAM MACHINE SAW SEEING
London Deep Learning Meetup
Claire Tolan
October 2015
#DDDMSS
1.0 #DEEPDREAM (#DD) MECHANICS
#DDDMSS
#DeepDream Dream Machine Saw Seeing
#DeepDream (#DD) begins with a collection of images known
as Training Data (TD).
TD is an amalgamation of image libraries.
These libraries usually contain photographs of common
things: flora, fauna, foods, people, automobiles.
#DDDMSS
#DeepDream Dream Machine Saw Seeing
TD defines what #DD is capable of dreaming.
#DD can only dream a subset of TD.
#DDDMSS
#DeepDream Dream Machine Saw Seeing
#DD works as a feedback loop.
1. #DD is given an image (IM1) with which to dream.
2. #DD compares IM1 to TD, and locates a similarity.
1. Image IM1
2. Similarity
Identified
#DDDMSS
#DeepDream Dream Machine Saw Seeing
3. #DD dreams TD into IM1, creating IM2
3. Similarity
Enhanced
#DDDMSS
#DeepDream Dream Machine Saw Seeing
#DD repeats, substituting IM2 for IM1 in the next cycle, IM3
for IM2 in cycle after that, and onward.
1. Image - IM2
2. Similarity
Identified
#DDDMSS
#DeepDream Dream Machine Saw Seeing
TD becomes recognizable within #DD, eventually overwhelming
the original IM1.
3. Similarity Enhanced
#DDDMSS
#DeepDream Dream Machine Saw Seeing
Let's follow #DD through several cycles.
1. Image
#DDDMSS
#DeepDream Dream Machine Saw Seeing
2. Similarity Identified
#DDDMSS
#DeepDream Dream Machine Saw Seeing
3. Similarity Enhanced
#DDDMSS
#DeepDream Dream Machine Saw Seeing
1. Image
#DDDMSS
#DeepDream Dream Machine Saw Seeing
2. Similarity Identified
#DDDMSS
#DeepDream Dream Machine Saw Seeing
3. Similarity Enhanced
#DDDMSS
#DeepDream Dream Machine Saw Seeing
1. Image
#DDDMSS
#DeepDream Dream Machine Saw Seeing
2. Similarity Identified
#DDDMSS
#DeepDream Dream Machine Saw Seeing
3. Similarity Enhanced
#DDDMSS
#DeepDream Dream Machine Saw Seeing
Occasionally, moments of completion arise, but
#DD advances.
#DDDMSS
#DeepDream Dream Machine Saw Seeing
Each full rotation of #DD can be considered as a
distinct form, #DDi.
#DDDMSS
#DeepDream Dream Machine Saw Seeing
#DDDMSS
#DeepDream Dream Machine Saw Seeing
#DDDMSS
#DeepDream Dream Machine Saw Seeing
#DDDMSS
#DeepDream Dream Machine Saw Seeing
#DDDMSS
#DeepDream Dream Machine Saw Seeing
Though #DD continues morphing, we will pause
to examine #DD at this arbitrary moment, #DDn.
#DDDMSS
#DeepDream Dream Machine Saw Seeing
2.0 #DD MOTION
#DDDMSS
#DeepDream Dream Machine Saw Seeing
#DD can be understood to have two distinct sources
of forward propulsion.
#DDDMSS
#DeepDream Dream Machine Saw Seeing
1. Developmentally, #DD is moving forward, following rotational
rules of IM1, leaving a trail of discarded #DDi. Here is a sample of
#DDi representing forms along the path of #DD1 ... #DDn.
#DDDMSS
#DeepDream Dream Machine Saw Seeing
2. Simultaneously, the (self-)consumption of #DDi
rolls each instance of #DDi forward as well.
#DDDMSS
#DeepDream Dream Machine Saw Seeing
In addition to lateral motion, #DDi displays two conflicting
mutational tendencies.
For ease of example, we will use #DDn as a model.
#DDDMSS
#DeepDream Dream Machine Saw Seeing
1. #DDn will display a finite amount of shrinkage as a result of
self-consumption.
#DDDMSS
#DeepDream Dream Machine Saw Seeing
2. #DDn will grow in girth and in circumference as its scales
expand to accommodate self-consumption.
#DDDMSS
#DeepDream Dream Machine Saw Seeing
2. #DDn will expand in girth (cont'd)
Source:
http://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20030015198.pdf
#DDDMSS
#DeepDream Dream Machine Saw Seeing
2. #DDn will expand in girth (cont'd)
Source:
http://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20030015198.pdf
#DDDMSS
#DeepDream Dream Machine Saw Seeing
This mutation of form is finite. #DDn will eventually rupture.
Prior to rupture, a large bulge will form at the throat, where the
skin is most flexible.
#DDDMSS
#DeepDream Dream Machine Saw Seeing
This bulge's soft skin is the weakest section of #DDn, and
so it will be #DDn's point of rupture.
#DDn prior to
rupture
#DDn postrupture
#DDDMSS
#DeepDream Dream Machine Saw Seeing
3.0 IMPLICATIONS OF #DD RUPTURE
#DDDMSS
#DeepDream Dream Machine Saw Seeing
Each iteration of #DDi conjoins in consumption and selfcombusts, leaving residue behind the advancing #DD. To be
clear, this encompasses #DD1,...,n-1.
#DDDMSS
#DeepDream Dream Machine Saw Seeing
The distribution of #DD residue could manifest in one
of several forms. It's possible that iterations of #DDi
would simply be dropped behind #DDn, creating a
trail.
#DDDMSS
#DeepDream Dream Machine Saw Seeing
It's also possible that the strong pull of the rotating
#DDn would suck the exploded and exploding #DDi
into orbit.
#DDDMSS
#DeepDream Dream Machine Saw Seeing
Yet it is most likely that the residue #DD1,...,n-1 creates a growing
pile of exploded and exploding #DDi. This cluster of debris is
captured in the wake of #DD's advance, much like the tail of a
comet.
#DDDMSS
#DeepDream Dream Machine Saw Seeing
Here, #DDn gazes, mouth wide open, as though in a
stupor, at the collecting wreckage of #DD.
#DDDMSS
#DeepDream Dream Machine Saw Seeing
Only when it is
upside down
does the gaze
of #DDn find
the future.
#DDDMSS
#DeepDream Dream Machine Saw Seeing
With rotation, #DDn begins to morph. It sprouts the bulge that
signals its coming rupture. This bulge announces the arrival of
#DDn+1.
#DDDMSS
#DeepDream Dream Machine Saw Seeing
#DDn-1
#DDn
#DDn
#DDn+1
The bulge will develop by the time that #DDn
completes its rotation to gaze once more into the
past. Then, #DDn+1 takes its place as the “comet” at
the front of the pile of debris.
#DDDMSS
#DeepDream Dream Machine Saw Seeing
4.0 #DD DISCUSSION AND SPECULATIONS
#DDDMSS
#DeepDream Dream Machine Saw Seeing
It is unclear if this trend of consumption and self-combustion
is merely a passing quirk of the current #DD0,...,n, n+1,..,n+i
ecosystem, or a bias of Training Data (TD).
#DDDMSS
#DeepDream Dream Machine Saw Seeing
It is possible that in future cycles (as #DDn->infinity), #DD will
dream its discarded #DDi residue into forms more robust
and dynamic than the current speed and physical
constraints of consumption/rupture allow.
#DDDMSS
#DeepDream Dream Machine Saw Seeing
Understanding of the #DD residue is not advanced
enough for researchers to publicly speculate about the
existence of signals embedded in the growing pile of
debris. The arrangement of the pile, at present, appears
to be random.
#DDDMSS
#DeepDream Dream Machine Saw Seeing
4.1 FRINGE SPECULATION
Unsurprisingly, the powerful system of #DD has provoked
speculation in certain Internet forums, especially those
dedicated to hierophany and Artificial Intelligence.
#DDDMSS
#DeepDream Dream Machine Saw Seeing
aidreams.co.uk is a popular forum for the discussion of the
future of Artificial Intelligence.
September 2015: anonymous poster1 (“scientist with major
software company”) claims on forum that the pile of debris “is
not dumbly towed by advancing #DD.”
1.
http://aidreams.co.uk/forum/i
ndex.php?PHPSESSID=9e5
2e2baf6ee8f39969a64ed735
36f19&board=19.0#.Vh9q8x
CrSNY
#DDDMSS
#DeepDream Dream Machine Saw Seeing
“The only conclusion I'm able to draw
from 5+ years of #DD research (and a
significant amount of time with machine
learning and AI/IA before that) is as
terrifying as it is wonderful.”
#DDDMSS
#DeepDream Dream Machine Saw Seeing
“The seemingly impenetrable and
randomly arranged pile of #DD residue
not only travels as a 'comet tail' behind
the advancing #DD, but it is also
constructed with an intelligent purpose.”
#DDDMSS
#DeepDream Dream Machine Saw Seeing
“Though fantastic, all my data suggest
that that the residue pile is attempting to
shield (or nurture/incubate?) some
enclosed form.”
#DDDMSS
#DeepDream Dream Machine Saw Seeing
“Moreover, this pile of debris is not
dumbly towed by the advancing #DD.
Rather, it is drafting off of #DD. It is using
the energy and momentum of #DD to pull
it into the future, towards some as-yet
undetermined goal.”
#DDDMSS
#DeepDream Dream Machine Saw Seeing
“What is the motivation of the debris?
What is the dream of the discarded #DD?
What do they conceal? How will they
open?”
#DDDMSS
#DeepDream Dream Machine Saw Seeing
“What will wake the sleepers?”
#DDDMSS
#DeepDream Dream Machine Saw Seeing
QUESTIONS?
#DDDMSS
#DeepDream Dream Machine Saw Seeing