BlockStoreClient¶

BlockStoreClient is an abstraction of block clients that can fetch blocks from a remote node (an executor or an external service).

BlockStoreClient is a Java Closeable.

Contract¶

Fetching Blocks¶

void fetchBlocks(
  String host,
  int port,
  String execId,
  String[] blockIds,
  BlockFetchingListener listener,
  DownloadFileManager downloadFileManager)

Fetches blocks from a remote node (using DownloadFileManager)

Used when:

• BlockTransferService is requested to fetchBlockSync
• ShuffleBlockFetcherIterator is requested to sendRequest

Shuffle Metrics¶

MetricSet shuffleMetrics()

Shuffle MetricsSet

Default: (empty)

Used when:

• BlockManager is requested for the Shuffle Metrics Source

Implementations¶

• BlockTransferService
• ExternalBlockStoreClient