Transcript kouyama
The LAC/UIC experiences through JGN2/APAN during SC04 Katsushi Kouyama and Kazumi Kumazoe Kitakyushu JGNⅡ Research Center / NiCT Robert L. Grossman, Yunhong Gu, Xinwei Hong, Michal Sabala, and David Handley University of Illinois of Chicago Outline Introduction of NCDM / LAC Introduction of UDT Demos of UDT in SC2004 Request and Comment for JGN2 / APAN on SC2004 Introduction to NCDM/LAC NCDM: National Center for Data Mining – UIC: University of Illinois of Chicago – Standard development, Data Mining and Predictive modeling – organized into laboratories LAC: Laboratory for Advanced Computing LAC/UIC activities – data intensive computing – distributed computing – high performance computing and networking : UDT TCP and AIMD TCP has been very successful in the Internet – AIMD (Additive Increase Multiplicative Decrease) Fair: max-min fairness Stable: globally asynchronously stable But, inefficient and not scalable – over high-speed wide area network RTT bias UDT – UDP-based Data Transfer Protocol Application level transport protocol built above UDP Reliable data delivery Congestion control mechanisms General transport API; not a (file transfer) tool. Open source UDT - Objectives Goals – Easy to install and use – Efficient for bulk data transfer – Fair – Friendly to TCP Non-goals – TCP replacement – Messaging service UDT Architecture Pkt. Scheduling Timer Sender Sender DATA DATA ACK Receiver Retransmission Timer Rate Control Timer ACK2 ACK Timer NAK NAK Timer Receiver Demos of UDT in SC2004 Network Configuration 10Gbps 10Gbps SC04 Tokyo JGN2/APAN Tokyo StarLight Abilene Pittsburgh (SC04) Amsterdam SURFnet Amsterdam Demos of UDT in SC2004 Tokyo -------------- SC04 – Disk-to-Disk Transmission (1.5 Terabytes) – Sloan Digital Sky Survey (SDSS) data – Two Pair of machines SC04 --------------- Amsterdam/Tokyo – Memory-to-Memory Transmission – Pseudo data – Parallel flows Results of Demos in SC2004 1.6Gbps real data file transfer between Pittsburgh and Tokyo. 16Gbps memory data transfer in and out Pittsburgh from/to Tokyo and Amsterdam. Winner of one of the bandwidth challenge awards – Best replacement of FedEx / UDP fairness award JGN2 Link Request and Comment for usage of network on SC2004 Introduction of the Reservation System via web (not via e-mail) We appreciate for the strong support and cooperation during SC2004 and our ongoing collaboration work. Thank you ... Related URLs UDT Project: http://udt.sf.net NCDM: http://www.ncdm.uic.edu Kitakyushu JGNII Research Center: http://www.kyushu.jgn2.jp