#nlp
9 events tagged with this keyword
ELIZA: The First Chatbot
Joseph Weizenbaum develops ELIZA, one of the earliest natural language processing programs, capable of simulating a psychotherapist.
Watson Defeats Jeopardy Human Champions
IBM Watson defeats human champions in the quiz show Jeopardy, demonstrating breakthrough in natural language understanding.
Word2Vec: Word Embedding Revolution
Google's Tomas Mikolov releases Word2Vec, pioneering a new era of word embedding technology.
Transformer: The Attention Revolution
The paper "Attention Is All You Need" is published, introducing the Transformer architecture and revolutionizing NLP.
Attention Mechanism: New Approach to Sequence Alignment
Dzmitry Bahdanau and colleagues propose attention mechanism, solving long-range dependency problem in sequence-to-sequence models.
BERT: Bidirectional Language Understanding
Google proposes BERT, achieving breakthrough language understanding through bidirectional Transformers.
GPT-1: Generative Pre-Training
OpenAI releases GPT-1, first demonstrating the potential of generative pre-training on language understanding tasks.
GPT-2: Better Language Models
OpenAI releases GPT-2 in stages due to misuse concerns, demonstrating emergent capabilities of large models.
GPT-3: Scale is All You Need
OpenAI releases GPT-3 with 175 billion parameters, demonstrating emergent capabilities of large-scale language models.