This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This is a test 123! |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
val num = "27" | |
val measurementData = sqlContext.read.parquet("/workspace/midgar/prod/ws/measurements/base") | |
val mData = measurementData.filter($"dateday" > "2016-05-31" && $"dateday" < "2016-06-10") | |
val mDataSubset = mData.select("customer_id", "channel", "group", "impression", "view", "click", "path_event_type", "dateday") | |
val salesOrderData = sqlContext.table("marketplace.sales_order_snapshot")//.filter($"created_at" < "2016-04-01" || $"created_at" > "2016-03-01") | |
val salesOrderData2 = salesOrderData.filter(!$"title".contains("Recharge")).filter(!$"title".contains("Bill Payment")) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
val num = "27" | |
val measurementData = sqlContext.read.parquet("/workspace/midgar/prod/ws/measurements/base") | |
val mData = measurementData.filter($"dateday" > "2016-05-31" && $"dateday" < "2016-06-10") | |
val mDataSubset = mData.select("customer_id", "channel", "group", "impression", "view", "click", "path_event_type", "dateday") | |
val salesOrderData = sqlContext.table("marketplace.sales_order_snapshot")//.filter($"created_at" < "2016-04-01" || $"created_at" > "2016-03-01") | |
val salesOrderData2 = salesOrderData.filter(!$"title".contains("Recharge")).filter(!$"title".contains("Bill Payment")) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
create external table larkin_workspace.afp_flat_2015_08_19 | |
( | |
created_at string, | |
title string, | |
customer_id bigint, | |
email string, | |
phone string, | |
remote_ip string, | |
subtotal int, | |
order_discount int, |