How exactly does a python program scale? If you're at the point of receiving 10s of thousands of requests/minute, do you basically have a ton of python containers or vm's all running that a load balancer evenly divides work to?
There’s two ways to scale, you either make what you have faster (vertical scale) so you can handle the load, or you add more machines and load balance them (horizontal scale).
Vertical scale is acceptable as the MUCH cheaper option.
Async adds capacity to the machine (vertical scale) so you can either continue to run everything on one server for longer, or reduce the the number of machines you need to run your high traffic service in the long run.
-28
u/higherorderbebop Sep 09 '22
What is the purpose of non blocking and the added complexity due to async if it doesn't lead to better peformance?