深入了解Spark Shuffle的原理,分别对Spark Shuffle过程和Spark Shuffle过程做了比较深入的讲解
课程内容如下:
1、课程内容
2、MapOutputTracker
3、HashShuffleWriter
4、SortShuffleWriter
5、UnsafeShuffleWriter
6、BypassMergeSortShuffleWriter
7、ShuffleReader
8、ShuffleManager+MemoryManager+StorageManager