Transcript ppt
CS 728
Advanced Database Systems
Chapter 18
Database File Indexing Techniques, BTrees, and B+-Trees
1
Indexes as Access Paths
A single-level index is an auxiliary file that makes
it more efficient to search for a record in the data
file.
The index is usually specified on one field of the
file (although it could be specified on several
fields)
One form of an index is a file of entries <field
value, pointer to record>, which is ordered by
field value
The index is called an access path on the field.
2
Indexes as Access Paths (cont.)
The index file usually occupies considerably less
disk blocks than the data file because its entries are
much smaller
A binary search on the index yields a pointer to the
file record
Indexes can also be characterized as dense or
sparse
dense index
has index entry for every record in the file.
sparse (nondense) index
has index entries for only some of the search-key
values.
3
Sparse Vs. Dense Indices
Id
Name
Dept
Sparse primary
index sorted
on Id
Ordered file sorted on Id
4
Dense secondary
index sorted
on Name
Sparse Vs. Dense Indices
Ashby, 25, 3000
22
Basu, 33, 4003
25
Bristow, 30, 2007
30
Ashby
33
Cass
Cass, 50, 5004
Smith
Daniels, 22, 6003
40
Jones, 40, 6003
44
Sparse primary
index on Name
44
Smith, 44, 3000
50
Tracy, 44, 5004
Dense secondary
Ordered file on Name index on Age
5
Sparse Indices
Sparse index contains index records for only some
search-key values.
Some keys in the data file will not have an entry
in the index file
Applicable
when records are sequentially ordered
on search-key (ordered files)
Normally
keeps only one key per data block
Less space (can keep more of index in memory)
Less maintenance overhead for insertions and
deletions.
6
Sparse Indices
Ordered File
Sparse/Primary Index
10
20
10
30
50
70
30
40
90
110
130
150
50
60
70
80
90
100
170
190
210
230
7
Example
Given the following data file EMPLOYEE(NAME, SSN, ADDRESS,
SAL)
Suppose that:
record size R=150 bytes
block size B=512 bytes
r=30000 records
blocking factor Bfr= B/R=512/150=3 records/block
number of file blocks b=(r/Bfr)=(30000/3)=10000 blocks
For an index on the SSN field, assume the field size VSSN=9 bytes, assume
the record pointer size PR=7 bytes. Then:
index entry size RI=(VSSN+ PR)=(9+7)=16 bytes
index blocking factor BfrI= B/RI= 512/16= 32 entries/block
number of index blocks b= (r/BfrI)=(30000/32)=938 blocks
binary search needs log2bI= log2938= 10 block accesses
This is compared to an average linear search cost of:
(b/2)= 30000/2= 15000 block accesses
If the file records are ordered, the binary search cost would be:
log2b= log230000= 15 block accesses
8
Types of Single-Level Indexes
primary index:
is specified on the ordering key field of an ordered file,
where every record has a unique value for that field.
The index has the same ordering as the one of the file.
clustering index:
is specified on the ordering field of an ordered file.
The index has the same ordering as the one of the file.
An ordered file can have at most one primary index or one
clustering index, but not both.
secondary index:
is specified on any nonordering field of the file.
The index has different ordering than the one of the file.
A file can have several secondary indices in addition to its
primary/clustering index.
9
Primary Indices
Defined on an ordered data file
The data file is ordered on a key field
Includes one index entry for each block in the data
file; the index entry has the key field value for the
first record in the block, which is called the block
anchor
A similar scheme can use the last record in a block.
Finding a record is efficient – do a binary search
A primary index is a nondense (sparse) index, since
it includes an entry for each disk block of the data
file and the keys of its anchor record rather than for
every search value.
10
Primary Index on the Ordering Key Field
11
Clustering Indices
Defined on an ordered data file
The data file is ordered on a non-key field unlike primary
index, which requires that the ordering field of the data file
have a distinct value for each record.
Includes one index entry for each distinct value of the
clustering field (rather than for every record).
Sparse index (nondense)
The index entry points to the first data block that contains
records with that field value.
A file can have at most one primary index or one clustering
index, but not both.
12
Clustering Indices
A clustering index on the
DEPNo ordering nonkey
field of an EMPLOYEE
file.
13
Clustering Indices
Clustering index with
a separate block cluster
for each group of
records that share the
same value for the
clustering field.
14
Secondary Indices
Secondary index:
is specified on any nonordering field of the file.
Non-ordering field can be a key (unique) or a non-key
(duplicates)
The index has different ordering than the one of the
file.
A file can have several secondary indices in addition to
its primary index.
there is one index entry for each data record
index record points either to the block in which the
record is stored, or to the record itself
Hence, such an index is dense
15
Secondary Indices
A secondary index usually needs more storage space and
longer search time than does a primary index.
It has larger number of entries.
Sequential scan using primary index is efficient, but a
sequential scan using a secondary index is expensive
each record access may fetch a new block from disk
The index is an ordered file with two fields.
The first field is of the same data type as some nonordering field of the data file that is an indexing field.
The second field is either a block pointer or a record
pointer.
16
Example of a Dense Secondary Index
A dense secondary index (with block
pointers) on a nonordering KEY field.
17
Example of a Secondary Index
A dense secondary index (with
record pointers) on a non-ordering
non-key field.
18
Index Types and Indexing Fields
Data file ordered
by indexing field
Indexing field is key
Indexing field is nonkey
Primary Index
Clustering Index
19
Data file not
ordered by
indexing field
Secondary index
(Key)
Secondary index
(NonKey)
Multi-Level Indexes
Because a single-level index is an ordered file, we can
create a primary index to the index itself;
In this case, the original index file is called the firstlevel index and the index to the index is called the
second-level index.
We can repeat the process, creating a third, fourth, ..., top
level until all entries of the top level fit in one disk block
A multi-level index can be created for any type of first-level
index (primary, secondary, clustering) as long as the firstlevel index consists of more than one disk block
20
A Two-Level
Primary Index
21
Multi-Level Indexes
Such a multi-level index is a form of search tree
However, insertion and deletion of new index
entries is a severe problem because every level of
the index is an ordered file.
A Node in a search tree with pointers to subtrees below
it.
22
23
Dynamic Multilevel Indexes Using B-Trees
and B+-Trees
Most multi-level indexes use B-tree or B+-tree data
structures because of the insertion and deletion problem
This leaves space in each tree node (disk block) to
allow for new index entries
These data structures are variations of search trees that
allow efficient insertion and deletion of new search values.
In B-Tree and B+-Tree data structures, each node
corresponds to a disk block
Each node is kept between half-full and completely full
24
Dynamic Multilevel Indexes Using B-Trees
and B+-Trees (cont.)
An insertion into a node that is not full is quite
efficient
If a node is full the insertion causes a split into
two nodes
Splitting may propagate to other tree levels
A deletion is quite efficient if a node does not
become less than half full
If a deletion causes a node to become less than half
full, it must be merged with neighboring nodes
25
Difference between B-tree and B+-tree
In a B-tree, pointers to data records exist at all
levels of the tree
In a B+-tree, all pointers to data records exists at the
leaf-level nodes
A B+-tree can have less levels (or higher capacity
of search values) than the corresponding B-tree
26
B-tree Structures
27
B+-Tree Index
A B+-tree, of order f (fan-out --- maximum node capacity),
is a rooted tree satisfying the following:
All paths from root to leaf are of the same length
(balanced tree)
Each non-leaf node (except the root) has between f/2
and up to f tree pointers (f-1 key values).
A leaf node has between f/2 and f-1 data pointers
(plus a pointer for sibling node).
If the root is not a leaf, it has at least 2 children.
If the root is a leaf (that is, there are no other nodes in
the tree), it can have between 0 and f-1 values.
28
The Nodes of a B+-tree
29
B+-Tree Non-leaf Node Structure
Ki are the search-key values, K1 K2 K3 … Kf-1
all keys in the subtree to which P1 points are K1.
all keys in the subtree to which Pf points are Kf-1.
for 2 i f-1, all keys in the subtree to which Pi points
have values Ki-1 and Ki.
Pi are pointers to children nodes (tree nodes).
30
B+-Tree Leaf Node Structure
for i = 1, 2, …, f-1, pointer Pri is a data pointer, that either
points to a
file record with search-key value Ki, or
block of record pointers that point to records having
search-key value Ki. (if search-key is not a key)
Pnext points to next leaf node in search-key order.
Within each leaf node, K1 K2 K3 … Kf-1
If Li, Lj are leaf nodes and i j, then
Li’s search-key values Lj’s search-key values
31
57
81
95
To record
with key 57
To record
with key 81
To record
with key 95
Sample Leaf Node
32
From non-leaf node
to next leaf
in sequence
95
81
57
to keys
57
Sample Non-Leaf Node
to keys
57 k 81
to keys
81 k 95
33
to keys
95
34
110
130
179
11
35
Root
180
200
150
156
179
120
130
100
101
110
30
35
3
5
11
Example of a B+-Tree
f=4
Number of pointers/keys for B+-Tree
Non-leaf
30
Leaf
30
35
min. node
120
150
180
Full node
3
5
11
f=4
35
Observations about B+-Trees
In a B+-tree, data pointers are stored only at the
leaf nodes of the tree
hence, the structure of leaf nodes differs from
the structure of internal nodes.
The leaf nodes have an entry for every value of the
search field, along with a data pointer to the
record.
Some search field values from the leaf nodes are
repeated in the internal nodes.
36
B+-Trees: Search
Let a be a search key value and T the pointer to the
root of the tree that has f pointer.
Search(a, T)
If T is non-leaf node:
for the first i that satisfy a Ki, 1 i f-1
call Search(a, Pi),
else call Search(a, Pf).
Else
//T is a leaf node
if no value in T equals a, report not found.
else if Ki in T equals a, follow pointer Pri to
read the record/block.
37
B+-Trees: Search
In processing a query, a path is traversed in the tree
from the root to some leaf node.
If there are n search-key values in the file,
the path is no longer than log f/2(n) (worst
case).
With 1 million search key values and f = 100, at
most log50(1000000) = 4 nodes are accessed in a
lookup.
Contrast this with a balanced binary tree with 1
million search key values -- around 20 nodes are
accessed in a lookup.
38
B+-Trees: Insertion
Find the leaf node in which the search-key value
would appear
If the search-key value is found in the leaf node,
add the record to main file and if necessary
add to the block a pointer to the record
If the search-key value is not there,
add the record to the main file and then:
If there is room in the leaf node, insert (keyvalue, pointer) pair in the leaf node
Otherwise, split the node along with the new
(key-value, pointer) entry
39
B+-Trees: Insertion
Splitting a node:
take the f (search-key value, pointer) pairs
(including the one being inserted) in sorted order.
place the first (f+1)/2 in the original node x, and
the rest in a new node y.
let k be the largest key value in x.
insert (k, y) in the parent node in their correct
sequence.
If the parent is full
the entries in the parent node up to Pj, where j =
(f+1)/2 are kept, while the jth search value is
moved to the parent, no replicated.
A new internal node will hold the entries from
Pj+1 to the end of the entries in the node.
40
B+-Trees: Insertion
The splitting of nodes proceeds upwards till a node
that is not full is found.
In the worst case the root node may be split
increasing the height of the tree by 1.
41
42
B+-Trees: Deletion
Find the record to be deleted, and remove it from
the main file and from the bucket (if present).
Remove (search-key value, pointer) from the leaf
node.
If the node has too few entries due to the removal,
and the entries in the node and a sibling fit into a
single node, then
Insert all the search-key values in the two nodes
into a single node (the one on the left), and
delete the other node.
43
B+-Trees: Deletion
Delete
the pair (Ki-1, Pi), where Pi is the pointer to
the deleted node, from its parent, recursively
using the above procedure.
Otherwise, if the node has too few entries due to the
removal, and the entries in the node and a sibling
DO NOT fit into a single node, then
Redistribute the pointers between the node and a
sibling such that both have more than the
minimum number of entries.
Update the corresponding search-key value in the
parent of the node.
44
B+-Trees: Deletion
The node deletions may cascade upwards till a node
which has f/2 or more pointers is found.
If the root node has only one pointer after deletion, it
is deleted and the sole child becomes the root.
45
Example of a
Deletion in a
B+-tree
46
Extra Reading
Read Examples 1 to 7.
47