esendex/TokenBucket - Githubissues

Introduction

This library provides an implementation of a token bucket algorithm which is useful for providing rate limited access to a portion of code. The implementation provided is that of a "leaky bucket" in the sense that the bucket has a finite capacity and any added tokens that would exceed this capacity will "overflow" out of the bucket and be lost forever.

In this implementation the rules for refilling the bucket are encapsulated in a provided IRefillStrategy instance. Prior to attempting to consume any tokens the refill strategy will be consulted to see how many tokens should be added to the bucket

We use AppVeyor for build verification.

Usage

Using a token bucket is incredibly easy and is best illustrated by an example. Suppose you have a piece of code that polls a website and you would only like to be able to access the site once per second:

// Create a token bucket with a capacity of 1 token that refills at a fixed interval of 1 token/sec.
ITokenBucket bucket = TokenBuckets.Construct()
  .WithCapacity(1)
  .WithFixedIntervalRefillStrategy(1, TimeSpan.FromSeconds(1))
  .Build();

// ...

while (true)
{
  // Consume a token from the token bucket.  If a token is not available this method will block until
  // the refill strategy adds one to the bucket.
  bucket.Consume(1);

  Poll();
}

As another example suppose you wanted to rate limit the size response of a server to the client to 20 kb/sec but want to allow for a periodic burst rate of 40 kb/sec:

// Create a token bucket with a capacity of 40 kb tokens that refills at a fixed interval of 20 kb tokens per second
ITokenBucket bucket = TokenBuckets.Construct()
  .WithCapacity(40960)
  .WithFixedIntervalRefillStrategy(20480, TimeSpan.FromSeconds(1))
  .Build();

// ...

while (true) {
  String response = PrepareResponse();

  // Consume tokens from the bucket commensurate with the size of the response
  bucket.Consume(response.Length);

  Send(response);
}

NuGet

Install from NuGet

Install-Package Esendex.TokenBucket

License

Licensed under the Apache Software License, Version 2.0: http://www.apache.org/licenses/LICENSE-2.0.