Transcript RowID - machinelearning123

KNIME Quick explanation #1
Lance Norskog
June 25, 2010
Makes pdf/html
• Simple PDF&HTML generator for tables
Konstantz Information Miner
KNIME
• http://www.knime.org/
• Open source project with backing
company
– KNIME
• Business seems to be drug chemistry
assay software
Query Plot
• Sample data CSV file
• Header with field names
• Query text + response time
–
–
–
–
query,time
apple,1
apple,2
pear,3
Query Plot Project
• Two nodes in a KNIME project
– File Reader node loads CSV file
– Creates table with field names
– Scatter Plot node creates the chart
Query Plot Display
• Add separate color for each query value
Cross-correlate benchmark
• Task: Join 2 tables
– Query time table
– Query Result Cache size table
– One common timestamp (first one)
Cross-correlate benchmark
• KNIME visual node program
– Read 2 files
– Join on timestamp
– Do scatter matrix plot
Cross-correlate benchmark
• Three fields: timestamp, query time, cache size
• Yeah, I know – it does make SVG files
Pipe-fitting
• Knime works hard to be easy to use
• Has lots of metadata for the table
connectors
• Still needs some pipe-fitting nodes
• The previous node program is not the real
one!
– I stripped something out for clarity
Pipe-fitting
•
•
•
•
The real one also has RowID nodes
Table metadata includes unique id for each row
Join works against RowID, not data column
RowID processor nodes move timestamp into and out of row id
values
Pipe-fitting
• Interactive Table?
– Need this to view output of last RowID
– This should be the default “view” for all non-display nodes
Base code
• Based on Eclipse app toolkit
• Can run workflows from command line
• File output
– PDF
– Csv
– Svg
– html
Now you know as much as me
• Only after this class do I know what the
various tools do
• And it’s time to learn more
Lance Norskog
[email protected]