Skip to content

Instantly share code, notes, and snippets.

View tatsunori-nishikori's full-sized avatar

nishikori tatsunori-nishikori

View GitHub Profile
@tatsunori-nishikori
tatsunori-nishikori / recommend_engine.md
Created June 19, 2017 06:39
レコメンドエンジン構築

レコメンドエンジン

協調フィルタリング

http://www.albert2005.co.jp/technology/marketing/c_filtering.html

ある対象者が商品をチェックまたは購入したデータと、対象者以外がチェックまたは購入したデータの両方を用い、 その購入パターンから人同士の類似性、または商品間の共起性をアソシエーション分析(相関分析)で解析し、 対象者個人の行動履歴を関連づけることでパーソナライズされた商品を提示することができる手法です。

@tatsunori-nishikori
tatsunori-nishikori / spark-submit.md
Last active June 19, 2017 04:57
spark submit help
[vagrant@spark-server ~]$ spark-submit -h
Usage: spark-submit [options] <app jar | python file> [app arguments]
Usage: spark-submit --kill [submission ID] --master [spark://...]
Usage: spark-submit --status [submission ID] --master [spark://...]
Usage: spark-submit run-example [options] example-class [example args]

Options:
  --master MASTER_URL         spark://host:port, mesos://host:port, yarn, or local.
  --deploy-mode DEPLOY_MODE   Whether to launch the driver program locally ("client") or
@tatsunori-nishikori
tatsunori-nishikori / snapshot.md
Last active June 27, 2017 07:44
ElasticSearch snapshot

1. elasticsearch.yml

# スナップショットを作成したいPathを指定する
path.repo: /usr/local/var/elasticsearch/snapshot

2. 設定読み込み

@tatsunori-nishikori
tatsunori-nishikori / mapping.md
Last active June 20, 2017 02:29
ElasticSearchでmappingの更新

ドキュメントどおりindexでPUTしたらエラーになる

{"error":{"root_cause":[{"type":"index_already_exists_exception","reason":"already exists","index":"rettrmt"}],"type":"index_already_exists_exception","reason":"already exists","index":"rettrmt"},"status":400}

すでにあるやつはUpdate出来ないっぽい

更新したいタイプがなければ下記のようにしたら良さそう

#!/bin/bash
ctags -R --tag-relative --sort=yes --append=no --exclude="tmp" --exclude="cache" --exclude="test" -f .git/tags
@tatsunori-nishikori
tatsunori-nishikori / list_operation.py
Created June 2, 2017 06:08
Python list operation
# -*- coding: utf-8 -*-
from itertools import groupby
score = [
{ "id": 1, "name": "アリス", "class": "1-A", "score": 92 },
{ "id": 2, "name": "カレン", "class": "1-B", "score": 43 },
{ "id": 3, "name": "しの", "class": "1-A", "score": 21 },
{ "id": 4, "name": "あやや", "class": "1-A", "score": 94 },
{ "id": 5, "name": "よーこ", "class": "1-A", "score": 38 }
]
@tatsunori-nishikori
tatsunori-nishikori / 0_reuse_code.js
Created December 27, 2016 04:06
Here are some things you can do with Gists in GistBox.
// Use Gists to store code you would like to remember later on
console.log(window); // log the "window" object to the console