c6id.32xlarge on Databricks
c6id.32xlarge is a compute optimized AWS worker type with 128 vCPUs and 256 GB of memory. On Databricks it uses 22.25 DBUs an hour, so 1 node on Jobs Compute in US East (N. Virginia) costs $9.79 an hour: $3.34 for the DBUs and $6.45 to AWS for the machine.
AWS · Compute optimized · c6id
c6id.32xlarge at a glance
- vCPUs
- 128
- Memory
- 256 GB
- Own SSD
- 7,600 GB
- DBUs an hour
- 22.25
- Classic compute
- With Photon
- 64.53
- DBUs an hour, Jobs Compute
- 1 node an hour
- $9.79
- Jobs Compute, US East (N. Virginia)
1 node an hour on each kind of compute
In US East (N. Virginia) on the Premium plan. Databricks charges the DBUs, AWS the machine. A cluster pays this for every worker and for the driver.
| Compute | DBUs an hour | A DBU | Databricks | Machine | An hour |
|---|---|---|---|---|---|
| Jobs Compute | 22.25 | $0.15 | $3.34 | $6.45 | $9.79 |
| Jobs Compute + Photon | 64.53 | $0.15 | $9.68 | $6.45 | $16.13 |
| All-Purpose Compute | 22.25 | $0.55 | $12.24 | $6.45 | $18.69 |
| All-Purpose Compute + Photon | 44.5 | $0.55 | $24.48 | $6.45 | $30.93 |
| Lakeflow pipelines Core | 22.25 | $0.20 | $4.45 | $6.45 | $10.90 |
| Lakeflow pipelines Core + Photon | 64.53 | $0.20 | $12.91 | $6.45 | $19.36 |
| Lakeflow pipelines Pro | 22.25 | $0.25 | $5.56 | $6.45 | $12.01 |
| Lakeflow pipelines Pro + Photon | 64.53 | $0.25 | $16.13 | $6.45 | $22.58 |
| Lakeflow pipelines Advanced | 22.25 | $0.36 | $8.01 | $6.45 | $14.46 |
| Lakeflow pipelines Advanced + Photon | 64.53 | $0.36 | $23.23 | $6.45 | $29.68 |
In each region
1 node an hour on Jobs Compute, Premium, cheapest first.
| Region | Machine | An hour |
|---|---|---|
| US East (N. Virginia) | $6.45 | $9.79 |
| US East (Ohio) | $6.45 | $9.79 |
| US West (Oregon) | $6.45 | $9.79 |
| Canada (Central) | $7.12 | $10.46 |
| Europe (Ireland) | $7.32 | $10.66 |
| Asia Pacific (Seoul) | $7.39 | $10.73 |
| Europe (Frankfurt) | $7.46 | $10.80 |
| Asia Pacific (Singapore) | $7.53 | $10.86 |
| Europe (London) | $7.73 | $11.07 |
| Europe (Paris) | $7.73 | $11.07 |
| Asia Pacific (Tokyo) | $8.20 | $11.54 |
| Asia Pacific (Sydney) | $8.47 | $11.80 |
| South America (São Paulo) | $10.01 | $13.35 |
Other compute optimized sizes
- c6id.xlarge4 vCPUs, 8 GB, 0.7 DBUs an hour
- c6id.2xlarge8 vCPUs, 16 GB, 1.39 DBUs an hour
- c6id.4xlarge16 vCPUs, 32 GB, 2.78 DBUs an hour
- c6id.8xlarge32 vCPUs, 64 GB, 5.56 DBUs an hour
- c6id.12xlarge48 vCPUs, 96 GB, 8.34 DBUs an hour
- c6id.16xlarge64 vCPUs, 128 GB, 11.13 DBUs an hour
- c6id.24xlarge96 vCPUs, 192 GB, 16.69 DBUs an hour
- c6id.32xlarge128 vCPUs, 256 GB, 22.25 DBUs an hour
Questions
- How many DBUs does c6id.32xlarge use on Databricks?
- c6id.32xlarge uses 22.25 DBUs an hour on Databricks classic compute without Photon. With Photon it uses 64.53 DBUs an hour on Jobs Compute and 44.5 on All-Purpose Compute, as Databricks' price list gives them.
- How much does c6id.32xlarge cost an hour on Databricks?
- In US East (N. Virginia), 1 c6id.32xlarge node on Jobs Compute costs $9.79 an hour: $3.34 to Databricks for 22.25 DBUs at $0.15 each, and $6.45 to AWS for the machine. On All-Purpose Compute the same node costs $18.69 an hour, and on Lakeflow pipelines Core $10.90. A cluster pays this for every worker and for the driver.
- Does Photon cost more on c6id.32xlarge?
- Yes, by the hour: with Photon, 1 c6id.32xlarge node on Jobs Compute in US East (N. Virginia) costs $16.13 an hour instead of $9.79, because it uses 64.53 DBUs an hour instead of 22.25. It saves money only when the job finishes fast enough to make up the difference.
- Which region is cheapest for c6id.32xlarge on Databricks?
- US East (N. Virginia), at $9.79 an hour for 1 node on Jobs Compute, against $13.35 in South America (São Paulo), the dearest of the 13 regions listed here that offer it. Databricks charges the same for a DBU of Jobs Compute in every AWS region listed, so the gap is the machine. US West (N. California), Asia Pacific (Mumbai) and Asia Pacific (Jakarta) do not offer it.
- What is the same size as c6id.32xlarge on the other clouds?
- The nearest worker types of the same kind are Standard_D96ds_v5 on Azure and n2-highcpu-80 on Google Cloud. Each cloud gives its own DBUs an hour for its types, so compare what a cluster costs in the calculator, not the DBUs alone.
- What is the next size down from c6id.32xlarge?
- c6id.32xlarge is the largest size of its family listed here. One size down is c6id.24xlarge, at 16.69 DBUs an hour.
Sources
Where each fact comes from
- 1Databricks: pricing calculator and instance types (the DBUs an hour of each worker type, with and without Photon)
- 2Databricks: pricing on AWS (the price of a DBU for each kind of compute and plan)
- 3AWS: Amazon EC2 on-demand pricing
- 4Databricks: compute configuration reference (the driver is the workers' type by default)
- 5Databricks: Photon
- 6AWS: c6id sizes