Concurrent Downloader

Demonstrates concurrent downloads in Go via a worker pattern. The number of workers is parameterized. Based on the Go by Example Worker Pools example

Generates a workload by generating random search queries to google and generates an MD5 hash of the response contents. The number of parallel workers are spawned and start processing the jobs as they are sent in via channels.

main.go is the entrypoint

Running

$ go run main.go

runs as script

Build and Run

$ go build
$ ./concurrent-downloader

Install

$ go install

resulting concurrent-downloader binary in $GOPATH/bin