Transcript Synchronous Text Messaging Telepresence for Wireless Handheld

Synchronous Text
Messaging
Telepresence For
Wireless Handhelds
Adesemowo A. Kayode
Supervise by – W. D. Tucker
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
1
Global View
Handheld Fast-track Feedback IM
Text Messaging
SIMPLE
Telepresence
Mobile IP Data Network
Analysis
Summary
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
2
Abstract
• HFFIM rubberize plastic text-messaging for telepresence.
• Why?
To enable text chat for online aware.
telepresence ‘conversation’ for 3G packet network.
• Technical Overview:
Fast-track Hotkeys feedback IM on
SIMPLE platform.
• HOW?
Deploy HFFIM SIMPLE network on 802.11b
WLAN and analyse User satisfaction and Usability with Slater’s PQ.
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
3
Introduction
Handheld Fast-track Feedback IM
Text messaging evolution from asynchronous near extinct paging to SMS and
synchronous instant messaging has followed the trend of being interactive and
telepresence centric. As mobile devices become more data-centric, textmessaging telepresence requires further extension for better interactive
discussion. The SIP extension for Instant Messaging and Presence Leverage
further extends IM telepresence as well as specialized embedded event trigger
applications.
The paper presents a work in progress that seeks to overcome fundamental text
chat interracial problems with a SIMPLE-based fast-track feedback approach
to IM applications. The SIP client IM application (User Agent) running on the
Handheld connect via mobile link to the IP based SIMPLE network where SIP
co-ordinates clients messaging sessions. Slater’s (UCL, UK) presence
questionnaire for VR environment will be adapted for comparative analysis of
user satisfaction and usability of the handheld fast-track feedback system.
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
4
Background
SMS – Short Messaging Services
Handheld Fast-track Feedback IM
Text Messaging
•
Trend of messaging either traditional (mail  carrier pigeon  telegraph 
telex  SWIFT), electronic (chat, web-board, MUD, paging, SMS, IM, MMS)
have always been pressed into instant interactive service.
•
Text messaging took an overture in the early nineties from the alphanumeric
paging texting to a more enriched SMS deployable on a common Global
System Mobile GSM Network
•
SMS had a fast inroad into the upstream vertical market where it is being put
into specialized trigger applications
•
Rapid adoption attributed to its fast, private, cost effective, low bandwidth
communication yet lacking interactivity
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
5
Background
IM – Instant Messaging
Handheld Fast-track Feedback IM
Text Messaging
• Instant Messsaging IM – extends SMS for interactive ‘talk’
– Exchange of rich content between a set of participants in near real time
coupled with presence and buddy lists
– Support online collaboration
• Handicapped in turn-taking conversation and Feedbacks
• Facial expressions in a face-to-face conversation are being provided in
a voice chat by expressive gesture for approval and presence effect.
This are lacking in text messaging
• Aim to enable text chat for online aware telepresence ‘conversation’
for 3G packet network.
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
6
Background
Handheld Text Messaging
Handheld Fast-track Feedback IM
Text Messaging
• Handheld suffers from restricted input output entry as well as
limited screen space
• IM on handheld requires facilitated text input for prompt gesture
in an interactive ‘talk’ session
• Build client UA IM on handheld capable of supporting turntaking conversation with feedback
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
7
Background
Telepresence
Handheld Fast-track Feedback IM
Telepresence
•
Voice chat responsive gesture reproduce face-to-face chat facial expressions. This
interrupts are being presented in IM by fast-tracking gesture like messages as
shown in fig 1 that denotes other party responsiveness.
•
In another concept as seen in native IM presence, other party (buddy) online-offline
status are presented by subscribing to a presence tracking server which shows
availability of other clients rather than ‘presentivity’. This related aspect of
presence that is an integral part of SIMPLE provides functionality for keeping an
eye on who is on and who is not.
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
8
Background
Fast-track Layer
Handheld Fast-track Feedback IM
Telepresence
• Fig 1:
2D, 3D Emoticons
Fast-track hierarchical layer
User Defined Hotkey
T9 Predictive Text
On keydown
typing event
Fast-track feedback
July 21, 2015
'
ACK
MEDIA, messages
Buddy list
Presence tracking
method = “MESSAGE”
INVITE
Online
presence
Package header event =
“presence”
OK
SUBCRIBE, NOTIFY
Synchronous Text Messaging Telepresence For Wireless Handhelds
9
Background
Presence
Handheld Fast-track Feedback IM
Telepresence
•
Presence as the subjective experience of being in one place or environment, even
when one is physically situated in another.
•
As applied to IM, presence refers to experiencing the facial expressive gestured
environment rather than the plastic physical locale.
•
Yet, the concept of presence in a virtual environment VR raises the question
(debate) of the meaning of ‘presence’ with respect to real world experiences.
•
Rather than looking into the ontological questions about the nature of existence, we
narrow down to a factor
– The possibility of the individual being able to navigate through and interact in the VE,
including interaction with other actors which may spontaneously react to the individual
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
10
Background
Slater PQ
Handheld Fast-track Feedback IM
Telepresence
•
Rather than looking into the ontological questions about the nature of existence, we
narrow down to a factor
– The possibility of the individual being able to navigate through and interact in the VE,
including interaction with other actors which may spontaneously react to the individual
•
This factor explain our adaptation of Slater’s ‘reality test’ based Presence
Questionnaire PQ.
•
The PQ in hinged on three themes: the sense of being there (in a discussion), extent
to which the IM VE becomes the dominant reality, and the extent to which the IM
VE is remembered as a ‘place’.
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
11
Background
SIMPLE
Handheld Fast-track Feedback IM
SIMPLE
•
SIP IM Presence Leverage Extension provides a platform for supporting IM and
presence applications on a SIP network.
•
Messages are not treated as short pager like messages but as a data transfer in a
session established pipe.
•
We’ll look into the details of the SIP method and header extension later in this
paper.
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
12
Background
MobileIP
Handheld Fast-track Feedback IM
MobileIP
•
An inescapable facet of technological progress is the convergence of packetswitched (Internet) and circuit-switched telecommunication network.
•
This continue to shift from cellular network (GSM) to packet switch mobile
network 2.5G (GPRS)  3G (UMTS, CDMA2000)  3.5/4G (mobileIP).
•
Network connectivity is also following on with wireless connectivity seen in
802.11b WLAN, blue tooth hotspot centers.
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
13
Technical Architecture
SIP OVERVIEW
Handheld Fast-track Feedback IM
SIMPLE
• SIP
– Signaling protocol – real-time calls
– IETF RFC 2543, Colombia university SIP group
• Architecture – UA’s, Redirect, Proxy, Location and Registrar
• Textual based exposing methods for call properties and service
information much like HTTP
• SIP message defined payloads transport media (text, voice) via
SDP
– SIP by itself provides mechanisms that are useful for presence applications,
and for session-oriented communication application but not IM
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
14
Technical Architecture
Visual Overview
Handheld Fast-track Feedback IM
SIP coordinate, clients’
messaging sessions.
IP backbone
Networks
Fast-track
Feedback
IP
IP
IP
SIP SERVERS
IP
SIMPLE
NETWORK
Fast-track
Feedback
User Agent on handheld
July 21, 2015
'
User Agent on handheld
Synchronous Text Messaging Telepresence For Wireless Handhelds
15
Technical Architecture
Visual Brief
Handheld Fast-track Feedback IM
•
•
•
•
The limited 2D emoticons expressive gesture in instant messaging and SMS
are further extended in this research work for fast track telepresence feedback.
Fast tracking are provide by tieing handset numeric keypad to user-defined
gesture as done with speed dialing and clickable menus in event driven
programs.
On_click, on_keypress events provides event driven progress tracker allowing
other party(ies) to know who is composing a messaging at the moment much
like the turn-taking effect in a voice conversation.
The SIP client IM application (User Agent) running on the Handheld connect
via mobile link to the IP based SIMPLE network where SIP co-ordinates
clients messaging sessions.
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
16
Technical Architecture
SIMPLE
Handheld Fast-track Feedback IM
SIMPLE
• Project built on SIMPLE Network (SIP IM and Presence
Leverage Extension)
• SIMPLE extends Session Initiation Protocol, SIP
– SDP media type extended with “MESSAGE” method to allow SIP
messaging stream to be established
– method = “MESSAGE 5060 sip sip:btucker@uwc:5060;transport=tcp”
– Enabling SIP to handle continuous session as against make and break data
chunk transfer
– MESSAGE requests differ from other sorts of SIP requests in that they carry
media (text in our case), in the form of Ims, as payload. Conventional SIP
payloads carry signaling information about media, but not media itself
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
17
Technical Architecture
INVITE message flow
Handheld Fast-track Feedback IM
SIMPLE
• IM session – Contact: sip:user2@uwc;method=“MESSAGE”
1: SUBCRIBE user2@uwc
User Agent
Client
(UAC)
MESSAGE sip:[email protected] SIP/2.0
Via: SIP/2.0/UDP user1pc.uwc.com
From: sip:[email protected]
To: sip:[email protected] Call-ID:
[email protected]
CSeq: 1 MESSAGE
Content-Type: text/plain
Content-Length: 18
User Agent
Server
(UAS)
2: 200 OK
3: ACK
MEDIA MESSAGE FLOW
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
18
Technical Architecture
Telepresence
Handheld Fast-track Feedback IM
• Fast-track hierarchical layer
2D, 3D Emoticons
User Defined Hotkey
T9 Predictive Text
On keydown
typing event
Fast-track feedback
July 21, 2015
'
ACK
MEDIA, messages
Buddy list
Presence tracking
method = “MESSAGE”
INVITE
Online
presence
Package header event =
“presence”
OK
SUBCRIBE, NOTIFY
Synchronous Text Messaging Telepresence For Wireless Handhelds
19
Technical Architecture
Fast-tracking
Handheld Fast-track Feedback IM
• 2D and 3D Emoticons – chat-i-tude
– IM standard define shortcut keys in similitude to ANSI key codes
– Shortcut keys input translated into 2D and 3D emotion/gesture icons
– As well as slide menu selectable options
• User Defined Hotkeys
– User prefer gestures tied to handheld buttons, selectable menus
– T9 predictive text input system enhances predefined word entries
• Event Driven Online Awareness
– On click, on keydown event method interrupt signals
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
20
Technical Architecture
Fast-tracking…
Handheld Fast-track Feedback IM
• Presence Indicator
– Historically on-line and off-line
– Subscriptions to and notifications of user presence (communication state
changes)
– Event package within SIP event notification framework
– Extended with “Event: presence” event package in Register SUBCRIBE request
– Handle by SIP SUBCRIBE and NOTIFY methods in logical Presence Agent
Client/Server, PA/PS
• Fast-track data stream to/fro on underlining
message SDP initiated TCP message flow
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
21
Technical Architecture
SUBCRIBE message flow
Handheld Fast-track Feedback IM
• SUBCRIBE message flow
1:
TELEPRESENCE
SUBSCRIBE watcher->uwc.com server
Presence
User Agent
Client
SUBSCRIBE sip:[email protected] SIP/2.0
Via: SIP/2.0/UDP watcherhost.uwc.com;
branch=z9hG4bKnashds7
To:
<sip:[email protected]>
From: <sip:[email protected]>;tag=xfg9
Call-ID: [email protected]
CSeq: 17766 SUBSCRIBE
Max-Forwards: 70
Event: presence
Accept: application/cpim-pidf+xml
Contact: <sip:[email protected]>
Expires: 600
Content-Length: 0
Presence
User Agent
Server
(PAC)
NOTIFY
(PAS)
200 OK
2: OK, 3: NOTIFY 4: OK 5: NOTIFY 6: OK
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
22
Technical Architecture
Fast-track Implementation
Handheld Fast-track Feedback IM
TELEPRESENCE
• Each fast-track component get sent across
with a pre-assigned higher priority index in
the message flow as shown in the prioritised
message structure.
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
23
Technical Architecture
Prioritised message flow
Handheld Fast-track Feedback IM
• IM session – Contact: sip:user2@uwc;method=“MESSAGE”
Header Field
where
proxy
Content-Type
MESSAGE
*
CSeq
c
r
m
From
c
r
m
Priority
R
ar
o
To
c(1)
r
m
Via
R
amr
m
Prioritised Message looks like:
MESSAGE sip:[email protected] SIP/2.0
Via: SIP/2.0/UDP user1pc.domain.com
From: sip:[email protected]
To: sip:[email protected] Call-ID: [email protected]
CSeq: 1 MESSAGE
Content-Type: text/plain
Priority: 1
Content-Length: 20
Hey Bill, looks good
July 21, 2015
'
Fast-tracks feedback
tied-in to hotkeys,
emotion and events
signal as Tags or Text
embedded
Synchronous Text Messaging Telepresence For Wireless Handhelds
24
Methodology
Research Question
Handheld Fast-track Feedback IM
• Does fast-track feedback increase textbased messaging presence
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
25
Methodology
Analysis
Handheld Fast-track Feedback IM
• We adapts Mel Slater’s PQ for VR environment to
measure presence for our ‘real’ fast-track IM
environment against standard non fast-track IM
environment.
• We will run trials in an 802.11b WLAN environment as
a proxy mobileIP network with a focus on User’s
Satisfaction and Usability.
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
26
Methodology
Proposed Network
Handheld Fast-track Feedback IM
• WLAN Wireless “HotSpot”
– Cisco Aironet 350 Access Point with Antennae
– Cisco Aironet 350 Series PC Card for handheld.
• Hand held type
– Compaq iPAQ Pocket PC H3870
• Compaq iPAQ PC Card Expansion Pack and WL 110 Wireless PC Card
• Microsoft’s messenger SDK running on a
Pocket 2002 OS powered iPAQ
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
27
Conclusion
Handheld Fast-track Feedback IM
• A function fast-track IM on a WLAN is easily
scalable to a cellular mobileIP network
• An IP-based application like the SIP based fasttrack IM provide bridging across various
smartphones, PDAs, handsets and other IPendpoints including fixed IP phones
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
28
Conclusion Statement
Handheld Fast-track Feedback IM
• A fast-track feedback system could be generalised
for other types of media (voice, video and virtual
reality) build on a SIMPLE network.
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
29
Handheld Fast-track Feedback IM
Q&A
July 21, 2015
'
Synchronous Text Messaging Telepresence For Wireless Handhelds
30