Skip to content

Instantly share code, notes, and snippets.

@angelyordanov

angelyordanov/curl_webpage.sh

Created December 23, 2019 10:27
Show Gist options
  • Save angelyordanov/83bff5a202e7d5fdef0bb1aa9eb27bb5 to your computer and use it in GitHub Desktop.
Save angelyordanov/83bff5a202e7d5fdef0bb1aa9eb27bb5 to your computer and use it in GitHub Desktop.
Download ZIP
cUrl get webpage html every 2 seconds
Raw
curl_webpage.sh
while :; \
do \
curl 'https://google.com/' \
-H 'Connection: keep-alive' \
-H 'Upgrade-Insecure-Requests: 1' \
-H 'User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36' \
-H 'Sec-Fetch-User: ?1' \
-H 'Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9' \
-H 'Sec-Fetch-Site: none' -H 'Sec-Fetch-Mode: navigate' -H 'Accept-Encoding: gzip, deflate, br' -H 'Accept-Language: en-US,en;q=0.9,bg;q=0.8' \
--compressed \
--output $(date +"%Y%d%m%H%M%S").html; \
sleep 2; \
done
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment