Standard_D16ds_v5 on Databricks
Standard_D16ds_v5 is a general purpose Azure worker type with 16 vCPUs and 64 GB of memory. On Databricks it uses 4 DBUs an hour, so 1 node on Jobs Compute in East US costs $2.10 an hour: $1.20 for the DBUs and $0.904 to Azure for the machine.
Azure · General purpose · Ddsv5
Standard_D16ds_v5 at a glance
- vCPUs
- 16
- Memory
- 64 GB
- Own SSD
- 600 GB
- DBUs an hour
- 4
- Classic compute
- With Photon
- 10
- DBUs an hour, Jobs Compute
- 1 node an hour
- $2.10
- Jobs Compute, East US
1 node an hour on each kind of compute
In East US on the Premium plan. Databricks charges the DBUs, Azure the machine. A cluster pays this for every worker and for the driver.
| Compute | DBUs an hour | A DBU | Databricks | Machine | An hour |
|---|---|---|---|---|---|
| Jobs Compute | 4 | $0.30 | $1.20 | $0.904 | $2.10 |
| Jobs Compute + Photon | 10 | $0.30 | $3.00 | $0.904 | $3.90 |
| All-Purpose Compute | 4 | $0.55 | $2.20 | $0.904 | $3.10 |
| All-Purpose Compute + Photon | 8 | $0.55 | $4.40 | $0.904 | $5.30 |
| Lakeflow pipelines Core | 4 | $0.30 | $1.20 | $0.904 | $2.10 |
| Lakeflow pipelines Pro | 4 | $0.38 | $1.52 | $0.904 | $2.42 |
| Lakeflow pipelines Advanced | 4 | $0.54 | $2.16 | $0.904 | $3.06 |
In each region
1 node an hour on Jobs Compute, Premium, cheapest first.
| Region | Machine | An hour |
|---|---|---|
| East US | $0.904 | $2.10 |
| East US 2 | $0.904 | $2.10 |
| West US 2 | $0.904 | $2.10 |
| West US 3 | $0.904 | $2.10 |
| Sweden Central | $0.96 | $2.16 |
| Central India | $0.976 | $2.18 |
| Canada Central | $1.01 | $2.21 |
| North Europe | $1.01 | $2.21 |
| Central US | $1.02 | $2.22 |
| UK South | $1.05 | $2.25 |
| France Central | $1.06 | $2.26 |
| West Europe | $1.09 | $2.29 |
| Germany West Central | $1.09 | $2.29 |
| Southeast Asia | $1.13 | $2.33 |
| Australia East | $1.14 | $2.34 |
| Japan East | $1.17 | $2.37 |
| Brazil South | $1.44 | $2.64 |
Other general purpose sizes
- Standard_D4ds_v54 vCPUs, 16 GB, 1 DBUs an hour
- Standard_D8ds_v58 vCPUs, 32 GB, 2 DBUs an hour
- Standard_D16ds_v516 vCPUs, 64 GB, 4 DBUs an hour
- Standard_D32ds_v532 vCPUs, 128 GB, 8 DBUs an hour
- Standard_D48ds_v548 vCPUs, 192 GB, 12 DBUs an hour
- Standard_D64ds_v564 vCPUs, 256 GB, 16 DBUs an hour
- Standard_D96ds_v596 vCPUs, 384 GB, 24 DBUs an hour
Questions
- How many DBUs does Standard_D16ds_v5 use on Databricks?
- Standard_D16ds_v5 uses 4 DBUs an hour on Databricks classic compute without Photon. With Photon it uses 10 DBUs an hour on Jobs Compute and 8 on All-Purpose Compute, as Databricks' price list gives them.
- How much does Standard_D16ds_v5 cost an hour on Databricks?
- In East US, 1 Standard_D16ds_v5 node on Jobs Compute costs $2.10 an hour: $1.20 to Databricks for 4 DBUs at $0.30 each, and $0.904 to Azure for the machine. On All-Purpose Compute the same node costs $3.10 an hour, and on Lakeflow pipelines Core $2.10. A cluster pays this for every worker and for the driver.
- Does Photon cost more on Standard_D16ds_v5?
- Yes, by the hour: with Photon, 1 Standard_D16ds_v5 node on Jobs Compute in East US costs $3.90 an hour instead of $2.10, because it uses 10 DBUs an hour instead of 4. It saves money only when the job finishes fast enough to make up the difference.
- Which region is cheapest for Standard_D16ds_v5 on Databricks?
- East US, at $2.10 an hour for 1 node on Jobs Compute, against $2.64 in Brazil South, the dearest of the 17 regions listed here that offer it. Databricks charges the same for a DBU of Jobs Compute in every Azure region listed, so the gap is the machine.
- What is the same size as Standard_D16ds_v5 on the other clouds?
- The nearest worker types of the same kind are m6id.4xlarge on AWS and n2-standard-16 on Google Cloud. Each cloud gives its own DBUs an hour for its types, so compare what a cluster costs in the calculator, not the DBUs alone.
- What is the next size up or down from Standard_D16ds_v5?
- One size down is Standard_D8ds_v5, at 2 DBUs an hour; one size up is Standard_D32ds_v5, at 8. Within a family, DBUs and the machine price grow with the vCPUs, so 2 nodes of a size cost about what 1 node of twice the size costs.
Sources