You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
5. Add your Starburst Galaxy password as a config variable
% vim great_expectations/uncommitted/config_variables.yml
...
starburst_pass: s0meSw33tPassw0rd
6. Add your Starburst Galaxy cluster as a new datasource
% great_expectations datasource new
Select 2 for "Relational database" and hit <enter/return>
Select 6 for "other" and hit <enter/return>
Edit the jupyter notebook that was just opened
In cell 2, change the datasource_name from "my_datasource" to something else (i.e. "starburst_sample")
In cell 3, change the connection_string from "YOUR_CONNECTION_STRING" to the connection string you constructed above
Remember to substitute your password with ${starburst_pass} (i.e. "trino://you%40email.com:${starburst_pass}@yourdomain-sample.galaxy.starburst.io:443/sample")
Run all notebook cells
In cell 5 when running context.test_yaml_config(...), you should see the two "data asset names" are detected (i.e. "demo.astronauts" and "demo.missions")
After the last cell has run, you can check that the great_expectations/great_expectations.yml file was updated
7. Create an Expectation Suite
% great_expectations suite new
Select 3 create automatically using a profiler and hit <enter/return>
Select 1 to use the "demo.astronauts" data asset and hit <enter/return>
Enter a name for the new Expectation Suite (i.e. astro-suite) and hit <enter/return>)
Select y to proceed and hit <enter/return>
Edit the jupyter notebook that was just opened
In cell 1, you can edit the batch_request, but this is not required
In cell 2, comment out some column names that you don't want excluded (i.e. nationality, total_number_of_missions, total_hrs_sum)
Run all notebook cells
8. Edit the suite as needed
% great_expectations suite edit astro-suite
Select 2 to interactively edit with a sample batch of data and hit <enter/return>
Adjust any Expectations
Run all notebook cells for the jupyter notebook that was just opened