Transcript Talk by Andrew B. Kahng()

A Metrics System for Continuous
Improvement of Design Technology
Andrew B. Kahng and Stefanus Mantik
DARPA
Current Status
Complete prototype of METRICS with industry standard
components (Oracle, Java, XML, HTML, etc.)
Metricized Place and Route runs on 100+ designs, seeking
access to Synopsys regression suite data
Complete metricization of Cadence system-level timing
flow
Metricization of synthesis and verilog simulation tools
Initial feedback from industry on METRICS standards
Attempting to spec Intel requirements for METRICS system
06/04/00
2
COM-Based Alternative
EDA tools:

provide COM interface for capturing internal information

add information collections (“counters”) inside the tools
METRICS transmitter:

get information via the COM interface

format the data in XML, encrypt the message, and send it to the
server
Benefit:

06/04/00
allow independent development for transmitter and tools
3
Current Results
CPU_TIME = 12 + 0.027 NUM_CELLS (correlation = 0.93)
More plots are accessible at
http://xenon.cs.ucla.edu:8080/metrics
06/04/00
4
Data Mining Results
Cubist [Release 1.07] Sun Jun 4 02:56:59 2000
Target attribute `CPU_TIME'
Read 200 cases (98 attributes) from 2.data
Model:
 Rule 1: [101 cases, mean 334.3, range 64 to 3881, est err 276.3]
if ROW_UTILIZATION <= 76.15 then
CPU_TIME = -249 + 6.7 ROW_UTILIZATION + 55 NUM_ROUTING_LAYER - 14 NUM_LAYER
 Rule 2: [168 cases, mean 365.7, range 20 to 5352, est err 281.6]
if NUM_ROUTING_LAYER <= 4 then
CPU_TIME = -1153 + 192 NUM_ROUTING_LAYER + 12.9 ROW_UTILIZATION - 49 NUM_LAYER
 Rule 3: [16 cases, mean 795.8, range 126 to 1509, est err 1069.4]
if NUM_ROUTING_LAYER > 4 and ROW_UTILIZATION > 76.15 then
CPU_TIME = -33 + 8.2 ROW_UTILIZATION + 55 NUM_ROUTING_LAYER - 14 NUM_LAYER
Evaluation on training data (200 cases):
Average |error|
275.0
Relative |error|
0.78
Correlation coefficient
0.20
06/04/00
Evaluation on test data (200 cases):
Average |error|
852.3
Relative |error|
0.96
Correlation coefficient
0.30
5
Ongoing Works
DAC-2000 Birds-of-a-Feather meeting

present and obtain feedback on existing METRICS infrastructure

solicit participation in a standardization effort for open-source
METRICS infrastructure

establish a community to realize METRICS, design process
optimization, and the associated growth opportunities for EDA
tools and design services industries
Add installation scripts

ease the setup for the METRICS system on any design house

integrate the METRICS system with available tools
Provide the ability to interact with COM interface
06/04/00
6
DAC 00 Birds of a Feather Attendees
 Bill Bell, Texas Instrument
 Andy Brotman, Director, Custom Design Automation, Conexant Systems Inc.
 Mojy C. Chian, Conexant Systems Inc.
 Dan Clein, PMC-Sierra
 Thomas Harms, SoCDT - Marketing & Applications Europe, Motorola
 Shannon Johnston, Senior Manager, Microelectronics IP, Nortel Networks
 Jeff Jussel, Director of Strategic Marketing and Business Development, Mentor
Graphics
 Thomas Kropf, Robert Bosch GmbH
 Brian Lambert, Design Flow Methodology Manager, Philips
 Anil Mankar, Director, Hardware Systems Engineering, Conexant Systems, Inc.
 Tom Moxon, Sr. Director, Design Methodology, Toolwire, Inc.
06/04/00
7