Created
August 6, 2013 18:36
-
-
Save psykidellic/6167276 to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
-- Run script that dumps DB data into csv over S3 | |
-- Run EMR script to while will process the data - maybe executed as cron from our ec2? | |
-- Saves processed data in CSV over s3 | |
-- Scripts runs and puts the data from CSV into PGSQL DB. | |
-- Remove old CSV, new CSV and close the EMR instance. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment