how to achieve app level load balancing?

[MrSpark2591]

Thanks for such wonderful proxy module. I am using this module for our gateway implementation and it works really well. but I am stuck in a situation. Suppose there is one application named XYZ and it contains APIs lets say api1, api2, api3. so I want to implement something like this. proxy .all('\XYZ\*') .balance(serverList) so this will be used for load balancing. and can also register individual APIs as: proxy .get('\XYZ\api1') .useForward(middleware) for custom logic on individual API.

how can I achieve this?

[tomas-fp]

• You can't combine multiple routes with different behaviours at rocky API level (you can achieve that, however, writing your own middleware function).
• You must declare the specific route first.
• Then declare the generic one with the wildcard.

You code might look like:

proxy.get('/XYZ/api1/*') .balance(serverList).useForward(middleware)
// GET /XYZ/api1/* HTTP requests won't never reach the route below:
proxy.all('/XYZ/*') .balance(serverList)

[MrSpark2591]

but here if we define balance at individual API, Case will be:
take a scenario I have app. XYZ which has two API api1, api2. whenever I receive request for any of these I have to load balance on application level not API level. example: (suppose XYZ has two instances running xyz1 , xyz2) in case of proxy.all('/XYZ/*') .balance(serverList) request sequence: api1 -> hits xyz1 api2 -> hits xyz2 api1 -> hits xyz1 api2 -> hits xyz2 in the case of individual load balance: api1 -> hits xyz1 api2 -> hits xyz1 api1 -> hits xyz2 api2 -> hits xyz2

i want 1st case not second

[tomas-fp]

The just register multiple routes that you want to balance independently:

proxy.all('/XYZ/api1/*') .balance(serverList)
proxy.all('/XYZ/api2/*') .balance(serverList2)

[MrSpark2591]

this is what i am doing right now which leads

//here server list is xyz1.com, xyz2.com
proxy.all('/XYZ/api1/*') .balance(serverList)
proxy.all('/XYZ/api2/*') .balance(serverList)

which leads : api1 -> xyz1 api2 -> again xyz1 but i want it to go on xyz2 because it should load balace on application level api1 -> xyz2 // even if this is 3rd hit to same application because of api level balancing it will go to xyz2 and so on.

[tomas-fp]

The current, pretty simple, balancer implementation relies on object mutability. This is not good. In order to fix it from package consumer perspective, you can do:

proxy.all('/XYZ/api1/*') .balance(Array.from(serverList))
proxy.all('/XYZ/api2/*') .balance(Array.from(serverList))

[MrSpark2591]

thank you, I tried that but not working as well. can we change target URL in middleware ?

[tomas-fp]

Yes, you can change whatever you want via middleware. See: https://github.com/h2non/rocky#request

[MrSpark2591]

woha , i am your fan now. Thank you so much 💃 implemented manual round robin on server array using middleware. 💯