Instruction Fine-Tuning and In-Context Learning of LLM (w/ Symbols)
Автор: Discover AI
Загружено: 2023-05-18
Просмотров: 12897
Описание:
New insights in "Instruction Fine-Tuning" and "In-Context Learning" of LLM: The evolution to "Symbol Fine Tuning" of LLMs. From FLAN-PaLM 8B to FLAN-PaLM 540B models.
This video summarizes four scientific pre-prints on Instruction fine-tuning LLM and prompt engineering (ICL in-context learning) of Large Language Models (LLMS):
In-Context Retrieval-Augmented Language Models
Ori Ram Yoav Levine Itay Dalmedigos Dor Muhlgay Amnon Shashua Kevin Leyton-Brown Yoav Shoham by AI21 Labs
https://arxiv.org/abs/2302.00083
What learning algorithm is in-context learning? Investigations with linear models
Ekin Akyurek Dale Schuurmans Jacob Andreas Tengyu Ma Denny Zhou
https://arxiv.org/abs/2211.15661
May 16, 2023
SYMBOL TUNING IMPROVES IN-CONTEXT LEARNING
IN LANGUAGE MODELS
Jerry Wei Le Hou Andrew Lampinen Xiangning Chen Da Huang
Yi Tay Xinyun Chen Yifeng Lu Denny Zhou Tengyu Ma Quoc V. Le
https://arxiv.org/pdf/2305.08298.pdf
March 9, 2023
LARGER LANGUAGE MODELS DO IN-CONTEXT
LEARNING DIFFERENTLY
Jerry Wei Jason Wei Yi Tay Dustin Tran Albert Webson
Yifeng Lu Xinyun Chen Hanxiao Liu Da Huang Denny Zhou
Tengyu Ma
https://arxiv.org/pdf/2303.03846.pdf
Повторяем попытку...
Доступные форматы для скачивания:
Скачать видео
-
Информация по загрузке:
