Skip to content

Instantly share code, notes, and snippets.

@rasha-salim

rasha-salim/uploading_data_hub.py

Last active May 12, 2021 19:49
Show Gist options
  • Save rasha-salim/21e10a29206abe8a2f4f92234ee0971c to your computer and use it in GitHub Desktop.
Save rasha-salim/21e10a29206abe8a2f4f92234ee0971c to your computer and use it in GitHub Desktop.
Download ZIP
Passing our images to hub Dataset object and upload it to server
Raw
uploading_data_hub.py
# I just extracted the input, rgb, and segmentation to separate arrays for convenience
inputs = []
masks = []
rgb_inputs = []
for pairs in images_target:
inputs.append(pairs['input'])
masks.append(pairs['mask'])
rgb_inputs.append(pairs['input_rgb'])
# Pass the data to our Dataset instance we created earlier
for i in range(len(masks)):
ds["masks"][i] = masks[i]
ds["inputs"][i] = inputs[i]
ds["rgb_inputs"][i] = rgb_inputs[i]
# Upload the data to hub
ds.flush()
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment