Skip to content

Instantly share code, notes, and snippets.

View nihil0's full-sized avatar

Neelabh Kashyap nihil0

5 followers · 2 following
  • Helsinki, Finland
View GitHub Profile
@nihil0
nihil0 / post.md
Last active July 30, 2024 09:34
Deploying Databricks Workflows with Serverless Compute using Terraform

Deploying Databricks Workflows with Serverless Compute using Terraform

Introduction

Serverless compute for workflows enables you to run your Databricks jobs without the need for configuring and deploying infrastructure. This allows you to focus solely on implementing your data processing and analysis pipelines. Databricks takes care of managing compute resources, including optimizing and scaling them for your workloads. With autoscaling and Photon automatically enabled, you can be assured of efficient resource utilization.

Additionally, serverless compute for workflows features auto-optimization, which selects the appropriate resources such as instance types, memory, and processing engines based on your workload. It also automatically retries failed jobs, ensuring smooth and efficient execution of your data workflows.

On 15.7.2024, [Serverless Compute for Notebooks, Workflows, and Delta Live Tables went into GA](https://www.databricks.com/blog/announcing-general-availability-serverless-compute-notebo

@nihil0
nihil0 / rpi4-iot-edge.md
Last active May 16, 2024 21:34
What I did to get Azure IoT Edge installed on my Raspberry Pi 4

How to install Azure IoT Edge on a stock RaspberryPi 4

This weekend I decided to jump into the world of IoT by getting myself a thing, connecting it to the internet and hopefully make it do something useful with Microsoft's IoT Edge service. I decided to write everything down so I remember how to do this again when I inevitably brick my Rpi.

What I bought

  1. Raspberry Pi 4 Model B with 2GB of RAM
@nihil0
nihil0 / vagrant debug
Created July 19, 2018 20:14
vagrant debug log 2.1.2
INFO global: Vagrant version: 2.1.2
INFO global: Ruby version: 2.4.4
INFO global: RubyGems version: 2.6.14.1
INFO global: VAGRANT_EXECUTABLE="C:\\HashiCorp\\Vagrant\\embedded\\gems\\2.1.2\ \gems\\vagrant-2.1.2\\bin\\vagrant"
INFO global: VAGRANT_INSTALLER_EMBEDDED_DIR="C:\\HashiCorp\\Vagrant\\embedded"
INFO global: VAGRANT_INSTALLER_ENV="1"
INFO global: VAGRANT_INSTALLER_VERSION="2"
INFO global: VAGRANT_LOG="info"
WARN global: resolv replacement has not been enabled!
INFO global: Plugins:
@nihil0
nihil0 / .tmuxrc
Created January 17, 2016 16:44
TMUX config
# Setting the prefix from `C-b` to `C-a`.
# By remapping the `CapsLock` key to `Ctrl`,
# you can make triggering commands more comfottable!
set -g prefix C-a
# Free the original `Ctrl-b` prefix keybinding.
unbind C-b
# Ensure that we can send `Ctrl-a` to other apps.
bind C-a send-prefix
@nihil0
nihil0 / .vimrc
Last active January 14, 2016 10:32
" Backspace
set bs=2 " make backspace behave like normal again
" Map ESC key to jj
imap jj <ESC>
" bind Ctrl+<movement> keys to move around the windows, instead of using Ctrl+w + <movement>
" Every unnecessary keystroke that can be saved is good for your health :)
map <c-j> <c-w>j