Skip to content

Instantly share code, notes, and snippets.

View dbist's full-sized avatar

Artem Ervits dbist

View GitHub Profile

Exploring Real-Time Data Ingestion into Snowflake Using CockroachDB, Redpanda, and Kafka Connect


This article serves as a follow-up to previous discussions on data ingestion into Snowflake, specifically focusing on the complexities and efforts involved in integrating Change Data Capture (CDC) data with Snowflake in real time.


Previous Articles on Snowflake

@dbist
dbist / cockroachdb-redpanda-snowflake.md
Last active August 15, 2024 14:09
cockroachdb-redpanda-snowflake.md

Tour of Snowflake ingestion using CockroachDB and Redpanda Connect


This is an exploratory article delving into various ways to ingest real-time data into Snowflake. The premise of the article is to examine the level of difficulty and effort required to ingest change data capture (CDC) data into Snowflake.


Previous articles on Snowflake

@dbist
dbist / snowflake-trino.md
Last active March 16, 2024 13:38
Integrating Trino with Snowflake

Integrating Snowflake with Trino


In today's discourse, we delve into the intricacies of accessing Snowflake via the Trino project. This article illuminates the seamless integration of Trino with Snowflake, offering a comprehensive analysis of its benefits and implications.


Previous articles

@dbist
dbist / cockroachdb-pgbench.md
Last active November 30, 2023 21:00
Optimizing PgBench for CockroachDB Part 3

Optimizing pgbench for CockroachDB Part 3


This is a long anticipated third article on optimizing pgbench for CockroachDB. I've been wanting to write a follow up ever since I learned about new improvements in the next release of CockroachDB.


Previous articles

Emitting Protocol Buffers with CockroachDB CDC Queries


As of this writing, CockroachDB does not have official support for protobuf payload as part of change data capture. Today, I am going to demonstrate a feature that may or may not land in CockroachDB proper. The product team is looking into viability of the feature before we can officially support it.


Previous articles on CockroachDB CDC

Using DuckDB with CockroachDB


This is a fun experiment using DuckDB to parse CockroachDB Change Data Capture output and querying CockroachDB with DuckDB.



CockroachDB TIL: Volume 13


This is my series of articles covering short "Today I learned" topics as I work with CockroachDB. Today, we're diagnosing cert issues, looking at client verification of server certificates differences in the cockroach and the psql clients, and checking the node and the CA certificate expiration programmatically.


Previous articles

Reducing network latency and improving read performance with CockroachDB and PolyScale.ai


Today, I am looking at a database caching product called PolyScale.ai.


Motivation

Load balancer high availability with CockroachDB and HAProxy


I've been experimenting with CockroachDB high availability scenarios and fault domains. CockroachDB relies on load balancer to provide client fault tolerance. Today, I'd like to look at a load balancer as the single point of failure. To my knowledge, load balancer high availability is not discussed in any of the existing CockroachDB documentation.


Checkout my previous article where I discuss connection pool high availability