edu.iu.harp.partition

Class PartitionUtil

java.lang.Object

edu.iu.harp.partition.PartitionUtil

public class PartitionUtil
extends java.lang.Object

Utils used on partitions, including receive, regroup, rotate, gather, allgather operations and etc.

Field Summary

Fields

Modifier and Type	Field and Description
static int	FAIL_TO_REGROUP_PARTITION_SET The status indicates the failure of regrouping partition set

Constructor Summary

Constructors

Constructor and Description
PartitionUtil()

Method Summary

Modifier and Type	Method and Description
static <P extends Simple> void	addPartitionsToTable(java.util.List<Transferable> partitions, Table<P> table) Add a list of partitions to table in parallel
static <P extends Simple> boolean	allgatherPartitionSet(java.lang.String contextName, java.lang.String operationName, Table<P> table, java.util.List<Transferable> recvPSet, DataMap dataMap, Workers workers) Allgather the PartitionSet among workers
static int[]	createSendOrder(Workers workers) Define the order of workers to send.
static <P extends Simple> boolean	gatherPartitionSet(java.lang.String contextName, java.lang.String operationName, Table<P> table, java.util.List<Transferable> recvPSets, DataMap dataMap, Workers workers) Gather the PartitionSet from workers
static <P extends Simple> IntArrayList	getPartitionSet(Table<P> table) Get the partition ID set from the table
static <P extends Simple> boolean	receivePartitions(java.lang.String contextName, java.lang.String operationName, Table<P> table, int numRecvPartitions, IntArrayList rmPartitionIDs, DataMap dataMap)
static <P extends Simple> boolean	regroupPartitionCount(java.lang.String contextName, java.lang.String operationName, Table<P> table, java.util.List<Transferable> recvPCounts, Int2IntOpenHashMap partitionMap, Partitioner regroupPartitioner, DataMap dataMap, Workers workers)
static <P extends Simple> int	regroupPartitionSet(java.lang.String contextName, java.lang.String operationName, Table<P> table, java.util.List<Transferable> recvPSets, Int2IntOpenHashMap partitionMap, Partitioner regroupPartitioner, DataMap dataMap, Workers workers)
static <P extends Simple> boolean	rotatePartitionCount(java.lang.String contextName, java.lang.String operationName, Table<P> table, java.util.List<Transferable> recvPCounts, int destID, DataMap dataMap, Workers workers)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

FAIL_TO_REGROUP_PARTITION_SET

public static int FAIL_TO_REGROUP_PARTITION_SET

The status indicates the failure of regrouping partition set

Constructor Detail

PartitionUtil

public PartitionUtil()

Method Detail

receivePartitions

public static <P extends Simple> boolean receivePartitions(java.lang.String contextName,
                                                           java.lang.String operationName,
                                                           Table<P> table,
                                                           int numRecvPartitions,
                                                           IntArrayList rmPartitionIDs,
                                                           DataMap dataMap)

addPartitionsToTable

public static <P extends Simple> void addPartitionsToTable(java.util.List<Transferable> partitions,
                                                           Table<P> table)

Add a list of partitions to table in parallel

Parameters:

partitions - the list of partitions

table - the table to be added partitions

regroupPartitionCount

public static <P extends Simple> boolean regroupPartitionCount(java.lang.String contextName,
                                                               java.lang.String operationName,
                                                               Table<P> table,
                                                               java.util.List<Transferable> recvPCounts,
                                                               Int2IntOpenHashMap partitionMap,
                                                               Partitioner regroupPartitioner,
                                                               DataMap dataMap,
                                                               Workers workers)

rotatePartitionCount

public static <P extends Simple> boolean rotatePartitionCount(java.lang.String contextName,
                                                              java.lang.String operationName,
                                                              Table<P> table,
                                                              java.util.List<Transferable> recvPCounts,
                                                              int destID,
                                                              DataMap dataMap,
                                                              Workers workers)

getPartitionSet

public static <P extends Simple> IntArrayList getPartitionSet(Table<P> table)

Get the partition ID set from the table

Parameters:

table - a Table

Returns:

the partition ID set

regroupPartitionSet

public static <P extends Simple> int regroupPartitionSet(java.lang.String contextName,
                                                         java.lang.String operationName,
                                                         Table<P> table,
                                                         java.util.List<Transferable> recvPSets,
                                                         Int2IntOpenHashMap partitionMap,
                                                         Partitioner regroupPartitioner,
                                                         DataMap dataMap,
                                                         Workers workers)

allgatherPartitionSet

public static <P extends Simple> boolean allgatherPartitionSet(java.lang.String contextName,
                                                               java.lang.String operationName,
                                                               Table<P> table,
                                                               java.util.List<Transferable> recvPSet,
                                                               DataMap dataMap,
                                                               Workers workers)

Allgather the PartitionSet among workers

Parameters:

contextName -

operationName -

table -

recvPSet -

dataMap -

workers -

Returns:

true if succeeded, false if failed

gatherPartitionSet

public static <P extends Simple> boolean gatherPartitionSet(java.lang.String contextName,
                                                            java.lang.String operationName,
                                                            Table<P> table,
                                                            java.util.List<Transferable> recvPSets,
                                                            DataMap dataMap,
                                                            Workers workers)

Gather the PartitionSet from workers

Parameters:

contextName -

operationName -

table -

recvPSets -

dataMap -

workers -

Returns:

true if succeeded, false if failed

createSendOrder

public static int[] createSendOrder(Workers workers)

Define the order of workers to send.

Parameters:

workers - Workers

Returns:

the order of sending operation