0.18.17

On-prem AMD GPU support

dstack now supports SSH fleets with AMD GPUs. Hosts should be pre-installed with Docker and AMDGPU-DKMS kernel driver (e.g. via native package manager or AMDGPU installer).

Elastic Fabric Adapter support

dstack now automatically enables AWS EFA if it is supported by the instance type, no extra configuration needed. The following EFA-enabled instance types are supported: p5.48xlarge, p4d.24xlarge, g4dn.12xlarge, g4dn.16xlarge, g4dn.8xlarge, g4dn.metal, g5.12xlarge, g5.16xlarge, g5.24xlarge, g5.48xlarge, g5.8xlarge, g6.12xlarge, g6.16xlarge, g6.24xlarge, g6.48xlarge, g6.8xlarge, gr6.8xlarge.

Improved apply plan

Previously, dstack apply showed a plan only for run configurations. Now it shows a plan for all configuration types including fleets, volumes, and gateways. Here's a fleet plan showing configuration parameters and the offers that will be tried for provisioning:

✗ dstack apply -f .dstack/confs/fleet.yaml
 Project        main                           
 User           admin                          
 Configuration  .dstack/confs/fleet.yaml       
 Type           fleet                          
 Fleet type     cloud                          
 Nodes          2                              
 Placement      cluster                        
 Backends       aws                            
 Resources      2..xCPU, 8GB.., 100GB.. (disk) 
 Spot policy    on-demand                      

 #  BACKEND  REGION        INSTANCE   RESOURCES                   SPOT  PRICE    
 1  aws      eu-west-1     m5.large   2xCPU, 8GB, 100.0GB (disk)  no    $0.107   
 2  aws      eu-central-1  m5.large   2xCPU, 8GB, 100.0GB (disk)  no    $0.115   
 3  aws      eu-west-1     c5.xlarge  4xCPU, 8GB, 100.0GB (disk)  no    $0.192   
    ...                                                                          
 Shown 3 of 82 offers, $40.9447 max

Fleet my-cluster-fleet does not exist yet.
Create the fleet? [y/n]: 

Volumes UI

Server administrators and regular users can now see volumes in the UI.

What's Changed

• Dstack version on UI by @olgenn in #1742
• Fix restarting gateway connections by @jvstme in #1746
• Fix Handle KeyboardInterrupt in CLI when getting run plan #1626 by @IshuSinghSE in #1756
• Add AMD support on on-prem fleets by @un-def in #1754
• Implement fleet apply plan by @r4victor in #1765
• chore: update provisioning.py by @eltociear in #1768
• Fix use all available runpod regions by default by @IshuSinghSE in #1757
• Implement apply plan for gateways and volumes by @r4victor in #1774
• Fix connection to ssh instance on non-standard ssh port by @un-def in #1766
• Fix docker SSH commands by @un-def in #1771
• Add Llama3.2 Vision Model Example by @Bihan in #1770
• Disable backend autoconfig via default creds by @r4victor in #1778
• Set backends requests timeouts by @r4victor in #1793
• Add UI for volumes #1683 by @olgenn in #1785
• UI for volumes 1683 by @olgenn in #1795
• [Docs] Add AMD GPU info to ssh fleets section by @un-def in #1779
• [shim] Use DockerRootDir to detect free disk space by @un-def in #1802
• Add AWS EFA support by @un-def in #1801

New Contributors

• @IshuSinghSE made their first contribution in #1756
• @eltociear made their first contribution in #1768

Full Changelog: 0.18.16...0.18.17