r6id.16xlarge on Databricks
r6id.16xlarge is a memory optimized AWS worker type with 64 vCPUs and 512 GB of memory. On Databricks it uses 16.32 DBUs an hour, so 1 node on Jobs Compute in US East (N. Virginia) costs $7.29 an hour: $2.45 for the DBUs and $4.84 to AWS for the machine.
AWS · Memory optimized · r6id
r6id.16xlarge at a glance
- vCPUs
- 64
- Memory
- 512 GB
- Own SSD
- 3,800 GB
- DBUs an hour
- 16.32
- Classic compute
- With Photon
- 47.33
- DBUs an hour, Jobs Compute
- 1 node an hour
- $7.29
- Jobs Compute, US East (N. Virginia)
1 node an hour on each kind of compute
In US East (N. Virginia) on the Premium plan. Databricks charges the DBUs, AWS the machine. A cluster pays this for every worker and for the driver.
| Compute | DBUs an hour | A DBU | Databricks | Machine | An hour |
|---|---|---|---|---|---|
| Jobs Compute | 16.32 | $0.15 | $2.45 | $4.84 | $7.29 |
| Jobs Compute + Photon | 47.33 | $0.15 | $7.10 | $4.84 | $11.94 |
| All-Purpose Compute | 16.32 | $0.55 | $8.98 | $4.84 | $13.81 |
| All-Purpose Compute + Photon | 32.64 | $0.55 | $17.95 | $4.84 | $22.79 |
| Lakeflow pipelines Core | 16.32 | $0.20 | $3.26 | $4.84 | $8.10 |
| Lakeflow pipelines Core + Photon | 47.33 | $0.20 | $9.47 | $4.84 | $14.30 |
| Lakeflow pipelines Pro | 16.32 | $0.25 | $4.08 | $4.84 | $8.92 |
| Lakeflow pipelines Pro + Photon | 47.33 | $0.25 | $11.83 | $4.84 | $16.67 |
| Lakeflow pipelines Advanced | 16.32 | $0.36 | $5.88 | $4.84 | $10.71 |
| Lakeflow pipelines Advanced + Photon | 47.33 | $0.36 | $17.04 | $4.84 | $21.88 |
In each region
1 node an hour on Jobs Compute, Premium, cheapest first.
| Region | Machine | An hour |
|---|---|---|
| US East (N. Virginia) | $4.84 | $7.29 |
| US East (Ohio) | $4.84 | $7.29 |
| US West (Oregon) | $4.84 | $7.29 |
| Asia Pacific (Mumbai) | $5.08 | $7.52 |
| Europe (Ireland) | $5.38 | $7.82 |
| Asia Pacific (Sydney) | $5.57 | $8.02 |
| Europe (London) | $5.68 | $8.13 |
| Europe (Frankfurt) | $5.81 | $8.26 |
| Asia Pacific (Seoul) | $5.81 | $8.26 |
| Asia Pacific (Singapore) | $5.85 | $8.29 |
| Asia Pacific (Tokyo) | $5.85 | $8.29 |
Other memory optimized sizes
- r6id.xlarge4 vCPUs, 32 GB, 1.02 DBUs an hour
- r6id.2xlarge8 vCPUs, 64 GB, 2.04 DBUs an hour
- r6id.4xlarge16 vCPUs, 128 GB, 4.08 DBUs an hour
- r6id.8xlarge32 vCPUs, 256 GB, 8.16 DBUs an hour
- r6id.12xlarge48 vCPUs, 384 GB, 12.24 DBUs an hour
- r6id.16xlarge64 vCPUs, 512 GB, 16.32 DBUs an hour
- r6id.24xlarge96 vCPUs, 768 GB, 24.48 DBUs an hour
- r6id.32xlarge128 vCPUs, 1,024 GB, 32.64 DBUs an hour
Questions
- How many DBUs does r6id.16xlarge use on Databricks?
- r6id.16xlarge uses 16.32 DBUs an hour on Databricks classic compute without Photon. With Photon it uses 47.33 DBUs an hour on Jobs Compute and 32.64 on All-Purpose Compute, as Databricks' price list gives them.
- How much does r6id.16xlarge cost an hour on Databricks?
- In US East (N. Virginia), 1 r6id.16xlarge node on Jobs Compute costs $7.29 an hour: $2.45 to Databricks for 16.32 DBUs at $0.15 each, and $4.84 to AWS for the machine. On All-Purpose Compute the same node costs $13.81 an hour, and on Lakeflow pipelines Core $8.10. A cluster pays this for every worker and for the driver.
- Does Photon cost more on r6id.16xlarge?
- Yes, by the hour: with Photon, 1 r6id.16xlarge node on Jobs Compute in US East (N. Virginia) costs $11.94 an hour instead of $7.29, because it uses 47.33 DBUs an hour instead of 16.32. It saves money only when the job finishes fast enough to make up the difference.
- Which region is cheapest for r6id.16xlarge on Databricks?
- US East (N. Virginia), at $7.29 an hour for 1 node on Jobs Compute, against $8.29 in Asia Pacific (Tokyo), the dearest of the 11 regions listed here that offer it. Databricks charges the same for a DBU of Jobs Compute in every AWS region listed, so the gap is the machine. US West (N. California), Canada (Central), South America (São Paulo), Europe (Paris) and Asia Pacific (Jakarta) do not offer it.
- What is the same size as r6id.16xlarge on the other clouds?
- The nearest worker types of the same kind are Standard_E64ds_v5 on Azure and n2-highmem-64 on Google Cloud. Each cloud gives its own DBUs an hour for its types, so compare what a cluster costs in the calculator, not the DBUs alone.
- What is the next size up or down from r6id.16xlarge?
- One size down is r6id.12xlarge, at 12.24 DBUs an hour; one size up is r6id.24xlarge, at 24.48. Within a family, DBUs and the machine price grow with the vCPUs, so 2 nodes of a size cost about what 1 node of twice the size costs.
Sources
Where each fact comes from
- 1Databricks: pricing calculator and instance types (the DBUs an hour of each worker type, with and without Photon)
- 2Databricks: pricing on AWS (the price of a DBU for each kind of compute and plan)
- 3AWS: Amazon EC2 on-demand pricing
- 4Databricks: compute configuration reference (the driver is the workers' type by default)
- 5Databricks: Photon
- 6AWS: r6id sizes