算法导论 第八章 线性时间排序

1
2
3
4
5
1
2
3
4
A: B:
4 1
1 2
3
3
4 3
4 5
C:
1
1 3
5 2
Counting-sort example
1
2
3
4
5
1
2
3
4
A: B:
4 1
1 2
3
3
4 3
4 5
C:
1
1 3 1
5
Counting-sort example
1
2
3
4
5
1
2
3
4
A: B:
4 1
1 2
3
3
4 3
4 5
C:
1
1 3 1
5
Counting-sort example
1
2
3
4
5
1
2
3
4
A: B:
4 1
1 2
3
3
4 3
4 5
C:
1
1 3
5
3
Counting-sort example
1
2
3
4
5
1
2
3
4
A: B:
4 1
1 2
3
3
4 3
4 5
C:
1
1 2 3
5
3
Counting-sort example
1
2
3
4
5
1
2
3
4
Sorting in linear time （线性时 间排序）
（一种算法设计技术）
主要内容
• lower bound for sort排序算法下界
•Counting sort计数排序 •Radix sort基数排序 •Bucket sort桶排序
Sorting in linear time
• All the sorting algorithms we have seen so far are comparison sorts: only use comparisons to determine the relative order of elements比较排序算法 --E.g., insertion sort, merge sort, quicksort, heapsort. --The best worst-case running time that we’ve seen for comparison sorting is O(n lgn). • Q: Is O(n lgn) the best we can do?
A: B:
4 1
1 2
3
3
4 3
4 5
C:
1
1 2 1
5
3
Counting-sort example
1
2
3
4
5
1
2
3
4
A: B:
4 1
1 2
3
3
4 3
4 5
C:
1
1 2
5
3
4
Counting-sort example
1
2
3
4
5
1
2
3
4
A: B:
4 1
1 2
3
3
4 3
4 5
C:
1
1 2
4 5
3
4
Counting-sort example
4
5
1
2
3
4
A: B:
4 1
1 2
3
3
4 3
4 5
C:
0
0 0
0
Counting-sort example
1
2
3
4
5
1
2
3
4
A: B:
4 1
1 2
3
3
4 3
4 5
C:
0
0 0
0
Counting-sort example
1
2
3
4
5
1
2
3
4
A: B:
4 1
1 2
3
3
4 3
4 5
C:
0
0 0
1 0
Counting-sort example
Decision-tree example
• Sort <a1,a2, a3>=<9,4,6>
1:2
• A decision tree can model the execution of any comparison sort: --One tree for each input size n. --View the algorithm as splitting whenever it compares two elements. -- The tree contains the comparisons along all possible instruction traces. --The running time of the algorithm = the length of the path taken. -- Worst-case running time = height of tree.
Counting Sort
Counting-sort example
n=5,k=4
1
2
3
4
5
1
2
3
4
A: B:
4 1
1 2
3
3
4 3
4 5
C:
Counting-sort example
1
2
3
4
5
1
2
3
4
A: B:
4 1
1 2
3
3
4 3
4 5
C:
Counting-sort example
1
2
3
2 1
Counting-sort example
1
2
3
4
5
1
2
3
4
A: B:
4 1
1 2
3
3
4 3
4 5
C:
1
0 2 1
2
Counting-sort example
1
2
3
4
5
1
2
3
4
A: B:
4 1
1 2
3
3
4 3
4 5
C:
1
0 2 1
2
Counting-sort example
1
2
3
4
5
1
2
1:2
2:3
1:3
123
1:3
213
2:3
132
312
231
321
• Each internal node is labelled i:j for i,j∈{1,2,…,n} --The left subtree shows subsequent comparisons if ai≤aj --The right subtree show subsequent comparisons if ai>aj
Decision-tree example
• Sort <a1,a2, a3>=<9,4,6>
1:2 9>4
2:3
1:3
123
1:3
213
2:3
132
312
231
321
• Each internal node is labelled i:j for i,j∈{1,2,…,n} --The left subtree shows subsequent comparisons if ai≤aj --The right subtree show subsequent comparisons if ai > aj
Any comparison sort
1:2
• Can be turned into a Decision tree
2:3
1:3
123
1:3
213
2:3
132
312
231
321
Lower Bound for decision-tree Sorting
• Theorem. Any comparison sorting algorithm requires Ω(n lgn) comparisons in the worst case • Proof. Worst case dictated by tree height h --n! different orderings --One (or more) leaves corresponding to each ordering --Binary tree with n! leaves must have height
3
4源自文库
A: B:
4 1
1 2
3
3
4 3
4 5
C:
1 0 2
2
Counting-sort example
1
2
3
4
5
1
2
3
4
A: B:
4 1
1 2
3
3
4 3
4 5
C:
1 1 2 0
2
Counting-sort example
1
2
3
4
5
1
2
3
4
A: B:
4 1
1 2
3
3
4 3
4 5
C:
1
1 3 2
2
Counting-sort example
lg is mono. increasing ∴ h ≥ lg (n!) Stirling’s formula ≥ lg (n/e)n = n lg n - n lg e =Ω(n lg n)
Lower Bound for Comparison Sorting
• Corollary. Heapsort and merge sort are asymptotically optimal comparison sorting algorithms.
Decision-tree example
• Sort <a1,a2, a3>=<9,4,6>
1:2
2:3
1:3 9>6
123
1:3
213
2:3
132
312
231
321
• Each internal node is labelled i:j for i,j∈{1,2,…,n} --The left subtree shows subsequent comparisons if ai≤aj --The right subtree show subsequent comparisons if ai>aj


Put the 1st in position 18, 2nd in position 19,3rd in position 20,…

How if there are 17 elements not greater than x in A? (值为ｘ的元素可能不唯一)

Put the last one in position 17, the penultimate one in position 16,…
Decision-tree example
• Sort <a1,a2, a3>=<9,4,6>
1:2
2:3
1:3
123
1:3
213
2:3
132
312
231
321
• Each internal node is labelled i:j for i,j∈{1,2,…,n} --The left subtree shows subsequent comparisons if ai≤aj --The right subtree show subsequent comparisons if ai>aj
1
2
3
4
5
1
2
3
4
A: B:
4 1
1 2
3
3
4 3
4 5
C:
1
1 2 1
4
3
4
Counting-sort example
1
2
3
4
5
1
2
3
4
A: B:
2:3
1:3
123
1:3
213
2:3
132
312
231 4≤6≤9
321
• Each leaf contains a permutation <π(1), π(2),…, π(n)>to indicate that the ordering aπ(1)≤ aπ(2)≤…≤ aπ(n) has been established.
Decision-tree example
• Sort <a1,a2, a3>=<9,4,6>
1:2
2:3
1:3
123
1:3
213
2:3 4≤6
132
312
231
321
• Each internal node is labelled i:j for i,j∈{1,2,…,n} --The left subtree shows subsequent comparisons if ai≤aj --The right subtree show subsequent comparisons if ai>aj
Sorting Lower bound
• Is there a faster algorithm? • How if using a different model of computation, …

Counting Sort计数排序 Counting sort: No comparisons between elements

Input: A[1..n], where A[j] ∈{1,2,…,k} Output: B[1..n], sorted Auxiliary storage: C[1..k]

For x in A, if there are 17 elements less than x in A, then x belongs in output position 18(值为ｘ的元素唯一) How if several elements in A have the same value? (值为 ｘ的元素不唯一)
• A: Yes, as long as we use comparison sorts
• TODAY: Prove any comparison sort has Ω(n lgn) worst case running time.
Decision-tree example决策树/判定树
• Sort <a1,a2,…,an>
1
2
3
4
5
1
2
3
4
A: B:
4 1
1 2
3
3
4 3
4 5
C:
0 1
0 0
1
Counting-sort example
1
2
3
4
5
1
2
3
4
A: B:
4 1
1 2
3
3
4 3
4 5
C:
1
0 0 1
1
Counting-sort example
1
2
3
4
5
1
2
3
4
A: B:
4 1
1 2
3
3
4 3
4 5
C:
1
0 1