Rate Limit Settings
Here you can configure rate limit settings for model requests.
Example of group rate limit:
{
"default": [200, 100],
"vip": [0, 1000]
}
Here you can configure rate limit settings for model requests.
Example of group rate limit:
{
"default": [200, 100],
"vip": [0, 1000]
}