Skip to content

Instantly share code, notes, and snippets.

@RealYukiSan

RealYukiSan/data_manipulation.md

Created August 9, 2024 04:35
Show Gist options
  • Save RealYukiSan/727b4da813ca1828175841149cb19744 to your computer and use it in GitHub Desktop.
Save RealYukiSan/727b4da813ca1828175841149cb19744 to your computer and use it in GitHub Desktop.
Download ZIP
XLSX, SQL and CSV
Raw
data_manipulation.md

When working on automation workflow, it's often easier to work with CSV format because it's easy to use and easy to parse.

you can export xlsx file to csv too and play around with it.

for example you have line-separated data like

username;password;email
reakl yuki;qwerty;yuki@mail.com

you can filter to just show the email only: sed '1d' | awk -F';' '{print $3}' filename > manipulated.txt

@RealYukiSan
Copy link
Author

RealYukiSan commented Aug 9, 2024 •
edited
Loading

and if you perform batch update on your database, make sure to use transaction if possible, in order to make the operation safety.

@RealYukiSan
Copy link
Author

reference:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment