Transcript Servers may be used for storage and Pre-processing

Central Logic Board (CLB)
Peter Jansweijer
Mesfin Gebyehu
Nikhef
Amsterdam
ElectronicsTechnology
Readout 31 TDC’s with 1 ns resolution
“Knowledge” of absolute time (1 ns resolution)
Data pushed from PMTs to Shore Station
I2C: PMT-HV, Threshold, Compass, Tilt
Other IO: Temp, Nano beacon, Acoustics
Firmware must be reconfigurable
Low Power
Low Cost
Part of a scalable system (with respect to the
complete detector)
 Highly reliable









January 29, 2013
KM3NeT, Marseille
1
Central Logic Board (CLB)
Tx_data2buf
Tx Stream
Select
Tx_pkt2mac
Flags
Time Slice Start
Management
& Config.
Pause Frame
TxPacket
Buffer
32KB
RxPort_m
TxPort 1
TxPort 2
TxPort_m
TDC
0
Fifo
TDC
30
S
31 PMTs
Fifo
Management
& Control
ADC
Fifo
S
S
Management
& Control
Nano
Beacon
M
M
M
S WB Crossbar
M
(1x7)
M
M
M
M
M
M
2nd CPU
LM32
M WB Crossbar
Peter Jansweijer Xilinx
MEM S
S
M
Mesfin GebyehuKintex-7
Nikhef
Data
UTC time & Clock (PPS, 125 MHz)
Amsterdam
ElectronicsControl
Point to Point interconnection
Technology
Wishbone bus
(3x2)
S
S
S
UART
I2C
Debug
RS232
Temp
January 29, 2013
S
I2C
KM3NeT, Marseille
Debug
LEDs
S
GPIO
Compass
Hydrophone
Flags
RxPort 1
RxPort 2
31 TDCs
State Machine
Rx_mac2buf
RxPacket
Buffer
64KB
Rx_buf2data
Rx Stream
Select
IP/UDP Packet Buffer
Stream Selector (IPMUX)
Start Time Slice UTC &
Offset counter since
Tilt
2
Shore Station
Server1
Server2
Server n
192.16.x.1
192.16.x.2
192.16.y.z
Servers may be
used for storage and
Pre-processing
Switch
Server
GPS
10MHz
PPS
Server
Buffers
Server
WR Switch
DOM
1
DOM
2
Server
WR Switch
DOM
16
DOM
12798
DOM
12799
DOM
12800
1.
Each DOM synchronizes to the absolute time (using White Rabbit)
Time Slice
IP Address
IP
2.
Each DOM receives a look up table with IP addresses while configuring the
detector.
Time1Slice
192.16.x.1
IP
2
192.16.x.2
All DOMs start at an absolute point in time which was communicated via a
command over the White Rabbit network.
:
:
n
192.16.y.z
3.
Peter Jansweijer
Mesfin Gebyehu
4.
Nikhef
5.
Amsterdam
ElectronicsTechnology
6.
All DOMs start their first time-slice at exactly the same time.
All data is IP/UDP formatted and passed to the IP number corresponding to the
time slice
After ‘n’ time slices, first PC is again selected to process the data
January 29, 2013
KM3NeT, Marseille
3
To be studied: Network Broadcast
Reference
Clock
Start
PTP
Broadcast
Buffer
Buffer
Buffer
Buffer
t4 Stop1
t4 Stop2
t4 Stop3
Peter Jansweijer
Mesfin Gebyehu
Nikhef
Amsterdam
ElectronicsTechnology
t4 Stop4
Shore Station interface
Tx
Time
Stamp t1
Time
Stamp t4
Time
Stamp t4
Time
Stamp t4
Time
Stamp t4
SFP
DOM
SFP
Optical
Network
Rx
j: DDMTD
SFP
DOM
SFP
DOM
SFP
DOM
Rx
j: DDMTD
Rx
j: DDMTD
Rx
j: DDMTD
January 29, 2013
Main Electrical Optical Cable
(MEOC)
May be 100 Km long…
KM3NeT, Marseille
4
Shore Station broadcast concerns:
1.
2.
Peter Jansweijer
Mesfin Gebyehu
Nikhef
Amsterdam
ElectronicsTechnology
3.
PTP timestamp t1 is common for all
CLBs. It resides in the outgoing port and
needs to be redistributed in hardware in
order to be able to run PTP.
Routing table needs to be changed;
outgoing packets will be routed via the
broadcast port.
Ethernet flow control (pause frames) is
based on a point to point link.
January 29, 2013
KM3NeT, Marseille
5