20분만에 끝내는 딥러닝

딥러닝 2.0

1 딥러닝 2.0

• Transformers
• Transfer Learning
• 딥러닝 하드웨어
• 딥러닝 프레임워크

유튜브 동영상: FourthBrain and Hugging Face demo on Building NLP Applications with Transformers 슬라이드: FourthBrain and Hugging Face demo on Building NLP Applications with Transformers Julien Simon, Chief Evangelist, Hugging Face

2 Transformers

Lewis Tunstall, Leandro von Werra, Thomas Wolf (2022), “Natural Language Processing with Transformers_ Building Language Applications with Hugging Face”, O’Reilly Media

2.1 구성요소

2.1.1 Attention

2.1.2 Scaled dot-product attention

2.1.3 인코더

2.1.4 디코더

2.2 연대기

2.3 아키텍쳐

2.4 라벨 데이터