Four short links: 25 February 2020
Incident Management, NLP, Antifragile Ideas, and Blogging
- Dispatch — Netflix’s incident management framework. (via Netflix Tech Blog)
- Text-to-Text Transformer (Google) — In “Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer,” we present a large-scale empirical survey to determine which transfer learning techniques work best and apply these insights at scale to create a new model that we call the Text-To-Text Transfer Transformer (T5). We also introduce a new open source pre-training dataset called the Colossal Clean Crawled Corpus (C4). The T5 model, pre-trained on C4, achieves state-of-the-art results on many NLP benchmarks while being flexible enough to be fine-tuned to a variety of important downstream tasks. With code, notebook, and pre-trained models.
- Antifragile Ideas — a 2015 John Carmack internal talk at Facebook.
- fastpages — fast.ai’s blogging system designed to publish research outputs. SWEET. (via fast.ai)
