akash-network / support

Akash Support and Issue Tracking
5 stars 3 forks source link

Portion of Providers Not Bidding on GPU Workloads When Model Specified #106

Closed chainzero closed 11 months ago

chainzero commented 1 year ago

Summary

When an order is created for a GPU enabled SDL which includes a list of requested models - only a portion of providers with available, relevant inventory create bids. The providers that have available inventory but that are not creating a bid show insufficient capacity for reservation in provider logs despite having sufficient capacity.

If the explicit GPU models are removed from the SDL the affected providers create bid successfully. Identical SDL used in successful attempt with only the GPUs model list removed.

Other providers create bids on order receipt with GPU model list in SDL. Thus this is a sporadic issue but appears consistent on affected providers. Some providers never bid when model list is included. Other providers bid without issue when GPU models are included.

Details

Provider Attributes

provider-services query provider get akash143ypn84kuf379tv9wvcxsmamhj83d5pg2rfc8v
attributes:
- key: host
  value: akash
- key: tier
  value: community
- key: capabilities/gpu/vendor/nvidia/model/3090
  value: "true"
host_uri: https://provider.shimpa.org:8443
info:
  email: ""
  website: ""
owner: akash143ypn84kuf379tv9wvcxsmamhj83d5pg2rfc8v
andy108369 commented 11 months ago

provider 0.3.2-rc4 fixes that