Não use UUID
como PK nas tabelas do seu banco de dados.
from pyspark.serializers import PickleSerializer, AutoBatchedSerializer | |
def _to_java_object_rdd(rdd): | |
""" Return a JavaRDD of Object by unpickling | |
It will convert each Python object into Java object by Pyrolite, whenever the | |
RDD is serialized in batc h or not. | |
""" | |
rdd = rdd._reserialize(AutoBatchedSerializer(PickleSerializer())) | |
return rdd.ctx._jvm.org.apache.spark.mllib.api.python.SerDe.pythonToJava(rdd._jrdd, True) | |
def estimate_df_size(df): |
#!/bin/bash | |
# In honor of the remarkable Windson | |
#/bin/bash | |
namespace=$1 | |
if [[ -z "$namespace" ]]; then | |
echo "Use "$(basename "$0")" NAMESPACE"; | |
exit 1; | |
fi |
Alright! I'd like to apologize for the inactivity for over a year. Very embarrassingly, I totally dropped the good habit. Anyways, today I'd like to share a not so advanced and much shorter walkthrough on how to upgrade Kubernetes with kops.
At Buffer, we host our own k8s (Kubernetes for short) cluster on AWS EC2 instances since we started our journey before AWS EKS. To do this effectively, we use kops. It's an amazing tool that manages pretty much all aspects of cluster management from creation, upgrade, updates and deletions. It never failed us.
Okay, upgrading a cluster always makes people nervous, especially a production cluster. Trust me, I've been there! There is a saying, hope is not a strategy. So instead of hoping things will go smoothly, I always have bias that shit will hit the fan if you skip testing. Plus, good luck explaining to people
Live Table: https://diafygi.github.io/webcrypto-examples/
I couldn't find anywhere that had clear examples of WebCryptoAPI, so I wrote examples and made a live table with them. Pull requests welcome!
- generateKey | importKey |
#!/bin/bash | |
# | |
# Create Kubernetes user. Require cfssl. | |
# | |
# Usage: | |
# ./create-user.sh <kubernetes api host> <fulle name> <clusterrole> | |
# | |
# Example: | |
# ./create-user.sh k8s-api.my-domain.com "Jane Doe" my-project:admin |
# Function to convert python object to Java objects | |
def _to_java_object_rdd(rdd): | |
""" Return a JavaRDD of Object by unpickling | |
It will convert each Python object into Java object by Pyrolite, whenever the | |
RDD is serialized in batch or not. | |
""" | |
rdd = rdd._reserialize(AutoBatchedSerializer(PickleSerializer())) | |
return rdd.ctx._jvm.org.apache.spark.mllib.api.python.SerDe.pythonToJava(rdd._jrdd, True) | |
# Convert DataFrame to an RDD |
ⓘ This list is not meant to be exhaustive and is not guaranteed to be maintained. See the comments for updates and alternative options.
(Items in bold indicate possible concerns)
Keycloak | WSO2 Identity Server | Gluu | CAS | OpenAM | Shibboleth IdP | |
---|---|---|---|---|---|---|
OpenID Connect/OAuth support | yes | yes | yes | yes | yes | yes |
Multi-factor authentication | yes | yes | yes | yes | yes | yes |
Admin UI | yes | yes | yes | yes | yes | no |
OpenJDK support | yes | yes | partial² | yes |
- Alda Rocha: Mulheres que falam e palestram
- Alex Braha Stoll: Ruby + Rust
- Anderson Dias: 3B de jobs no Sidekiq
- Andre Luis Anastacio: Effective Rails Instrumentation
- Artur Caliendo Prado: Grafana, StatsD e InfluxDB
- Bruno Alves: Arquitetura de micro serviços
- Camila Campos: Como não escrever seus testes
- Charlotte Lorelei Oliveira: [Tolerância a falhas com supervisor trees em Elixir](https://docs.google.com/presentation/d/e/2PACX-1vT8eAiVAgK5_aHBduO-P2Cb1QbeaX4DyvHAsDbgfKOt0lDVBEl4Qm_KeCx7mNGn7PS16gMgZ-ffLkrO/pub?start=false&loop=fa
Most recently tested on macOS Sierra (10.12.6)
- Download the installation script;
curl https://bootstrap.pypa.io/get-pip.py -o ~/Downloads/get-pip.py
- Run the installation, appending the
--user
flag;python ~/Downloads/get-pip.py --user
. pip will be installed to ~/Library/Python/2.7/bin/pip - Make sure
~/Library/Python/2.7/bin
is in your$PATH
. Forbash
users, edit thePATH=
line in~/.bashrc
to append the local Python path; ie.PATH=$PATH:~/Library/Python/2.7/bin
. Apply the changes,source ~/.bashrc
. - Use pip! Remember to append
--user
when installing modules; ie.pip install <package_name> --user