Words of GPT-3

Описание: #words #GPT-3 #features
Generative Pre-trained Transformer 3
Autoregressive language model released in 2020
A decoder-only transformer network
2048-token-long context
175 billion parameters
800GB to store
Generative pre-training
OpenAI, a San Francisco-based artificial intelligence research laboratory
Thirty-one OpenAI researchers and engineers
Microsoft, had licensed "exclusive" use of GPT-3

인용 : https://en.wikipedia.org/wiki/GPT-3