Phill Sparks sparksp

Exercise: Web Crawler

In this exercise you'll use Go's concurrency features to parallelize a web crawler.

Modify the Crawl function to fetch URLs in parallel without fetching the same URL twice.

Hint: you can keep a cache of the URLs that have been fetched on a map, but maps alone are not safe for concurrent use!

I hereby claim:

I am sparksp on github.
I am monkeyphill (https://keybase.io/monkeyphill) on keybase.
I have a public key whose fingerprint is E1F6 9C04 2276 70D9 B93A 128E 769F DBA7 278B 84A9

To claim this, I am signing this object:

	module Html.Events.UnlessKeyed exposing (onClick)

	{-\|

	@docs onClick

	-}

	import Html
	import Html.Events

	{-\| Remove the indexed item from the Array

	Array.fromList [1, 2, 3, 4]
	\|> arrayRemove 2
	== Array.fromList [1, 2, 4]

	-}
	arrayRemove : Int -> Array a -> Array a
	arrayRemove index array =
	Array.append

	module Option exposing (getOr)

	getOr : a -> Maybe a -> a
	getOr x val =
	case val of
	Just v ->
	v

	Nothing ->
	x

	/* Background */ .chroma { background-color: #fff; color: #000 }

	/* LineTableTD */ .chroma .lntd { vertical-align: top; padding: 0; margin: 0; border: 0; }
	/* LineTable */ .chroma .lntable { border-spacing: 0; padding: 0; margin: 0; border: 0; width: 100%; overflow: auto; display: block; }
	/* LineHighlight */ .chroma .hl { background-color: #ffffcc; display: block; width: 100% }
	/* LineNumbersTable */ .chroma .lnt { margin-right: 0.4em; padding: 0 0.4em 0 0.4em; display: block; }
	/* LineNumbers */ .chroma .ln { margin-right: 0.4em; padding: 0 0.4em 0 0.4em; }

	/* Whitespace */ .chroma .w {}
	/* Error */ .chroma .err {}