Created
January 31, 2020 09:31
-
-
Save yoongi0428/c493385951edeacec2bc3fa390ec9a60 to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
0. PyTorch Tutorial | |
☆ - https://github.com/yunjey/pytorch-tutorial | |
- https://github.com/yoongi0428/dmlab_torch_tutorial | |
1. Word Embedding | |
1) 관련 논문 | |
- Word2Vec: https://www.aclweb.org/anthology/N13-1090.pdf | |
☆ - Skip-gram: https://papers.nips.cc/paper/5021-distributed-representations-of-words-and-phrases-and-their-compositionality.pdf | |
2) 블로그 | |
☆ - Jay Alammar "The Illustrated Word2Vec": http://jalammar.github.io/illustrated-word2vec/ | |
- ratsgo's Blog "Word2Vec 학습 방식": https://ratsgo.github.io/from%20frequency%20to%20semantics/2017/03/30/word2vec/ | |
- Beomsu Kim "Word2Vec 관련 이론 정리": https://shuuki4.wordpress.com/2016/01/27/word2vec-%EA%B4%80%EB%A0%A8-%EC%9D%B4%EB%A1%A0-%EC%A0%95%EB%A6%AC/ | |
- 윤기 "1.Word Vectorization" (참고만 하고 넘ㄱ..): https://yoongi0428.github.io/nlp%20story/2018/12/10/story2_1_word_vectirization.html | |
2. Basic NLP w/ RNN | |
1) 관련 논문 | |
☆ - Seq2Seq: https://papers.nips.cc/paper/5346-sequence-to-sequence-learning-with-neural-networks.pdf | |
2) 블로그 | |
3) 코드 및 자료 | |
- 네이버 영화 평 분류 데이터: https://github.com/e9t/nsmc | |
- 네이버 첼린지 코드: https://github.com/yoongi0428/Kor-Sentence-Classification | |
- Sentiment analysis w/ PyTorch: https://github.com/lukysummer/Movie-Review-Sentiment-Analysis-LSTM-Pytorch | |
3. Attention | |
1) 관련 논문 | |
☆ - Luong Attention: https://arxiv.org/pdf/1508.04025.pdf | |
☆ - Bahdanau Attention: https://arxiv.org/pdf/1409.0473.pdf | |
☆ - Self Attention: https://arxiv.org/pdf/1706.03762.pdf | |
2) 블로그 | |
☆ - Seq2Seq w/ Attention: http://jalammar.github.io/visualizing-neural-machine-translation-mechanics-of-seq2seq-models-with-attention/ | |
☆ - Transformer (Self-attention): http://jalammar.github.io/illustrated-transformer/ | |
4. BERT | |
1) 관련 논문 | |
☆ - BERT: https://arxiv.org/pdf/1810.04805.pdf | |
2) 블로그 | |
☆ - Annotated BERT: https://nlp.seas.harvard.edu/2018/04/03/attention.html | |
☆ - The Illustrated BERT: http://jalammar.github.io/illustrated-bert/ | |
3) 코드 | |
☆ - Hugging face BERT and friends: https://github.com/huggingface/transformers |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment