Paulo Alencar palencar
Shavvimal
/ graphrag_umap_visualisation.py
Created
September 3, 2024 20:38
Demonstrates how to visualize a knowledge graph generated using GraphRAG with UMAP embeddings. The script loads entity and relationship data from parquet files and then visualizes the graph using networkx and matplotlib.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import pandas as pd | |
| import networkx as nx | |
| import matplotlib.pyplot as plt | |
| import graspologic as gc | |
| # Load environment variables | |
| from dotenv import load_dotenv | |
| _ = load_dotenv() | |
| # Define paths |
jsyi
/ cwl-last-used.sh
Last active
August 6, 2024 08:47
Use AWS CLI to query AWS CloudWatch Logs and determine the most recent entry into a Log Group
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| aws logs describe-log-groups | jq ".logGroups[].logGroupName" | grep -E "homeplus|mcdonalds" | xargs -n 1 -t aws logs describe-log-streams --query "logStreams[*].lastEventTimestamp" --log-group | jq "max/1000|floor" | xargs -t -n 1 date -r | |
| # aws logs describe-log-groups | jq ".logGroups[].logGroupName" | |
| # Get LogGroup names | |
| # grep -E "homeplus|mcdonalds" | |
| # (Optional) Filter LogGroup names | |
| # xargs -n 1 -t aws logs describe-log-streams --query "logStreams[*].lastEventTimestamp" --log-group | jq "max/1000|floor" | |
| # Get last event timestamp for each LogGroup. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/usr/bin/env python | |
| from datetime import datetime | |
| from json import loads | |
| from time import gmtime, mktime, strptime | |
| # LevelDict é um wrapper usando dicionário para LevelDB | |
| # https://github.com/maurobaraldi/leveldict | |
| from leveldict import LevelJsonDict | |
| from requests import get |