Transcript Video Object Tracking and Replacement for Post TV Production

FYP Project LYU0301:
Secure and Reliable PDA-Based
Communication System
Secure and Reliable PDA-Based
Communication System

Abstract






Design and develop a PDA-based
communication system for a group of
workforce (e.g. Police)
The communication content should be secured.
The system can be executed over 72 hrs (at
least) without crash.
Fault tolerant measures on both the client and
server sides.
All the information should still be consistent
after failure.
Unauthorized users cannot access the content
Secured and Reliable PDA-Based
Communication System
Secured and Reliable PDA-Based
Communication System

Techniques:




Server load balancing
Embedded systems programming
Bluetooth or 802.11b
Encryption and security
Symbian-based Mobile Tour Guide
System

Abstract





Develop an interactive tour guide
system using the Symbian OS (e.g.
Nokia 3650…)
The system should equips multimedia
presentation capabilities.
Making use of messaging systems:
MMS and SMS.
Making use of the camera function of
modern mobile phone devices
Location sensitive elements can be
added
Symbian-based Mobile Tour Guide
System
Virtual Tour Guide
Multimedia Presentation
Camera
Navigation
Symbian-based Mobile Tour Guide
System

Technique




Native Symbian programming in C++.
(Beware! Symbian OS is very tough to
learn.)
Multimedia processing
Mobile Messaging
Location sensitive services
Symbian-based Mobile Tour Guide
System

Technique




Native Symbian programming in C++.
(Beware! Symbian OS is very tough to
learn. Pick this project only if you want
to face the most challenging work in
modern mobile device programming.)
Multimedia processing
Mobile Messaging
Location sensitive services
FYP Project LYU0302:
PVCAIS – Personal
VideoConference Archives
Indexing System
LYU0302: PVCAIS-Personal VideoConference Archive Indexing System
• Background
– Videoconference is becoming popular
– Participants wish to keep videoconference
archives for the later reference
– Normal video and audio files are neither
searchable nor helpful to recall their contents
– Indexing of videoconference archives has not
been investigated till now
LYU0302: PVCAIS
• Objective: develop an experimental
system with the following architecture.
LYU0302: PVCAIS
• Project tasks
1. Study the mechanism and media format of a
videoconferencing client to receive data.
LYU0302: PVCAIS
• Project tasks
2. Select a group of algorithms to implement
the multimedia-indexing functions.
3. Integrate these functions to generate an
XML index file for each videoconference.
4. Create and manage the file system of
indexed archives.
LYU0302: PVCAIS
• Project tasks
5. Implement a GUI of PVCAIS to provide
the searching and browsing functions of
indexed videoconference archives.
Searching
Browsing
Figure 4. An example GUI of PVCAIS
FYP Project LYU0303:
Video Object Tracking and
Replacement for Post TV Production
15
Augmented Reality

Augmented Reality (AR) is a form of humanmachine interaction where information is
presented in the file of view of an individual
– augmenting the real world scene necessitating that
the user maintains a sense of presence in that world.
– the virtual images are merged with the real view to
create the augmented display.
– technology for merging the real and virtual image
streams in tight constrain.
AR (movie)
AR Animation (movie)
Key Technologies of AR

accurate registration of the virtual objects
with the real world image
– camera position, viewing parameters
– digital composition, scene lighting, object
texture mapping
– real-time processing constraint
– user viewing method
Three Classes of AR Systems
Monitor Based Augmented Reality
 Video See-through Augmented Reality
Display
 Optical See-through Augmented Reality
Display

AR using Monitor (movie)
AR using Head Mount Device (movie)
ARCADE: Augmented Reality Computing
Arena for Digital Entertainment
AR provides new ways of digital
entertainment possibilities when
combining with traditional entertainment
channels.
 Key applications: TV and Movie
productions combining fantasy with reality

LYU0303: Video Object Tracking and
Replacement for Post TV production
Design the special pattern markers for 3D
objects to be applied on objects during the video
shooting
 Develop efficient algorithm to calculate the
object’s positions and orientations in the video

– Non real-time algorithm
– MPEG-1 or DV quality video
– The special pattern marks and the detection
algorithm must survive from the partial occlusion of
the object.
LYU0303: Video Object Tracking and
Replacement for Post TV production
Develop algorithm to determine the lighting
condition of the scene in a video
 Generate realistic images to replace the video
object according to it’s positions and orientations

–
–
–
–
non real-time algorithm
MPEG-1 or DV quality video
Simple object, soda can or cereal box
The algorithm must survive from the partial occlusion
of the object
– Photometric registration problem
Popular 2D Markers
Illustration of possible Special
Pattern Markers for 3D Object
Same Object with Two Brand
Names
References

International Symposium on Mixed and
Augmented Reality, ISMAR 1999-2002
– Can be downloaded from IEEE website using Campus
network (IP address restrictions)
– ieeexplore.ieee.org/xpl/tocresult.jsp?isNumber=24594

Augmented Reality Website
– www.augmented-reality.org

MagicBook
– www.hitl.washington.edu/magicbook/

Virtual Showcase
– http://virtual-showcase.com/
FYP Project LYU0304:
“Monster Battle”: A Prototype of
Augmented Reality Card Game
LYU0304: “Monster Battle”: A Prototype of
Augmented Reality Card Game
• Enhance the joy of playing by re-construct the
virtual battle at real-time for battle type card
game (遊戲王)
–
–
–
–
–
Head mount device or monitor based AR
Multiple AR markers tracking
Network playing for two persons
Game rules design
3D animation for monsters and virtual battle
Multiple Objects Tracking (movie)
Interaction and Animation (movie)
References
• International Symposium on Mixed and Augmented
Reality, ISMAR 1999-2002
– Can be downloaded from IEEE website using Campus
network (IP address restrictions)
– ieeexplore.ieee.org/xpl/tocresult.jsp?isNumber=24594
• Augmented Reality Website
– www.augmented-reality.org
• MagicBook
– www.hitl.washington.edu/magicbook/
• Virtual Showcase
– virtual-showcase.com/