Transcript TimelyBid
TimelyBid.com
Provide an integration between eBay
and Google Calendar for quick and
easy visualization of timely data
regarding eBay bids.
By Katie Varland, Josh Smith, Sean Humpherys
MIS-510B with thanks to Dr. Chen & Xin Li
customer
Timely Bid Organization
Registers
Spider
API calls
Spider & MySQL DB
Timelybid.com
API calls
Update AI models
Analyze & DM
Flash MX
Dynamic reports
Data miner with DM
computer
Novelty
IDEA
Integrate bid data into Google Calendar from eBay real time
DATA MINING
VISUALIZATION
AWOL risk assessment using three distinct AI algorithms
Improved visualization of eBay data
Dynamic flash-based charts
Visualization of data mining predictions
LEVERAGE OPEN SOURCE
Joomla & Joomla CMS modules
YALE/WEKA for data mining
XML/SWF Charts for dynamic charts
DATA ACQUISITION
KNOWLEDGE DISCOVERY
extracting data using prebuilt
& shared resource
compiling, augmenting, and creating knowledge
q
q
q
q
q
News feeds, RSS
Search Engines,
crawlers
Forums (web mining)
Websites (web mining)
API/Web Service
Providers
XML/XQL
Widgets & gadgets
MULTI-SOURCE DATA
COMBINATION:
integrate data from multiple,
distinct sources
KNOWLEDGE DISCOVERY:
discover new knowledge through
data mining & machine learning
Data
store
q
q
communicating knowledge in novel
ways
Model
DB
EXTERNAL DATA:
acquire data from external
sources such as
ENTERPRISE DATA:
gather data from internal
sources such as
q
q
q
q
Internal databases
Intranet website
Knowledge Repository
Employee blogs
KNOWLEDGE
PRESENTATION
TEXTUAL & NUMERIC
PRESENTATION
tables, charts, text
SPATIAL
REPRESENTATION
maps, virtual world
TEMPORAL
REPRESENTATION
timeline, comm. garden
RELATIONSHIP
REPRESENTATION
network diagrams, SOM
Logic/Process Facilitation:
streamline processes of multiple,
related tasks
USER-SPECIFIC
CUSTOMIZATION
customized portals
End Users
Open Source and Other Tools
Joomla CMS
Customized user registration module
Available Virtuemart for Pay Pal integration
$39.95
Apache/Linux/Php/MySQL
eBay API
Google Calendar API
RapidMinger (YALE) / Weka for data mining
XML/SWF Charts for dynamic charts (limited
version free or full license $45)
Demo RapidMiner
RapidMiner formerly YALE
www.rapidminer.com
Download the OWN-free version for easy
off-line mining
Download GPL version if you desire to
dynamically link the system into your
program
AI Avatars for AWAL Risk
Assessment
AI Avatar Joseph is our risk
adverse assessor using C4.5
AI Avatar Julie is an moderate
risk assessor using AD Tree
algorithm
AI Avatar Scott is our risk
seeking assessor using
REP Tree.
Data Mined
Data collected from eBay for
mining purposes
isRegistered as dependent
variable
userID
Lifetime Positive Feed Back%
Feed Back Score
All Positive FB
Member Since
Location
# Items for Sale
# of SubCategories
# of Main Categories
# of One Month Positive
Feedback
# of Six Months Positive FB
# of Twelve Months Positive
FB
# of One Month Negative FB
# of Six Months Negative FB
# of Twelve Months Negative
FB
# of Positive FB
# of Negative FB
# FB Withdrawn# Bids
Retracted
Code for Avatars
if($userArray['twelveMoNeg'] < 1.5)
{
if ($userArray['twelveMoPos'] < 0.5)
{
if ($userArray['numPosFB'] < 46.5) {$vote = true;}
else if ($userArray['numPosFB'] >= 46.5)
{
if($userArray['posFB'] < 97.55) {$vote = false;}
else if($userArray['posFB'] >= 97.55)
{
if ($userArray['allPosFB'] < 23450.5)
{
if ($userArray['allPosFB'] < 13578.5) {$vote = false;}
else if ($userArray['allPosFB'] >= 13578.5) {$vote = true;}
}
else if ($userArray['allPosFB'] >= 23450.5) {$vote = false;}
}
}
}
else if ($userArray['twelveMoPos'] >= 0.5)
AWOL Risk Assessment
Collected nearly 150,000 records on eBay
users
In experimental phase, used up to 80,000
records for training. Resulted in overlearning but identified important attributes.
In production phase, used 13,000 specially
selected records to train and 50,000 to test.
Achieved between 95% and 98% accuracies
on predicting if the user became
unregistered in the last thirty days.
How to Chart Data
XML/SWF Charts
Charts.swf
PHP Demo
<!-- Data actual -->
<chart_data>
<row>
<null/>
<string>
<?php mysql_data_seek($MaxBidByBidder,0); ?>
<?php while ($row_MaxBidByBidder = mysql_fetch_assoc($MaxBidByBidder)){ ?>
<?php echo $row_MaxBidByBidder['BidderID']; ?>
<?php } ?>
</string>
</row>
<row>
<string></string>
<string>
<?php mysql_data_seek($MaxBidByBidder,0); ?>
<?php while ($row_MaxBidByBidder = mysql_fetch_assoc($MaxBidByBidder)){ ?>
<?php echo $row_MaxBidByBidder['MaxBidAmount']; ?>
<?php } ?>
</string>
</row>
</chart_data>