WORK IN PROGRESS

Haven't handled the decimals etc

Spark Memory Calculator

Get the max partition size your executors can handle

No. of nodes in cluster

Cores per node

RAM per node (GB)

Executors per node

Executors for job

Max Partition Size

1272mb

Cores per executor

1

RAM per executor

1272mb

Parallel tasks for job

30

Total job memory

3000 GB

Parallel tasks in cluster

30,000

Total Cluster memory

3000 GB