Regional Services attached to proxiML jobs can now use HTTP/2 (including gRPC) in addition to HTTPS, so you can connect workers to private APIs and backends that speak those protocols. For background on how services attach to jobs, see the CloudBender reference and the Regional Services announcement.
NVIDIA L4 GPU instance are now available for deployment with CloudBender in AWS and GCP regions.
Job log parsing has been improved for Node.js and Python applications to consolidate log messages with newline into a single log line.
proxiML Endpoints can now be configured to attach multiple Regional Services at the same time.
Previously, proxiML jobs had to be restarted to reflect updates made to Data Connectors or other deployed private services they were using. Now these updates will automatically be deployed to any running job without any interruption to the job itself.
New job environments based on Python 3.12 are now available for all frameworks.
proxiML Endpoints can now be configured to automatically restart themselves if the workload exits unexpectedly.
proxiML Projects can now be configured to override the types of jobs that can be created and the configuration options they can use to further protect customer data.
Physical CloudBender nodes can now be deployed on VMWare ESXi clusters in addition to bare-metal servers.
CloudBender users can now granually configure access to regional datastores, data connectors, and services on a per project basis.