This article explores when concurrency in Golang is beneficial, and when there are diminishing returns. The author uses the Dispatcher -> Worker -> Job pattern to benchmark and compare results in different scenarios to determine when this pattern operates optimally under different types of loads.
The author concludes that the overhead required for managing the goroutines outweighs the benefits of more concurrent workers at some point. An application must be optimized for the number of cores in the environment to ensure maximum efficiency.
Takeaways:
- Concurrency can improve performance for CPU-bound jobs.
- Keep in mind memory usage when increasing concurrent workers.
- An application must be optimized for the number of cores in the environment to ensure maximum efficiency.
- The overhead required for managing the goroutines outweighs the benefits of more concurrent workers at some point.
