Peter & Boris β€” Fine-tuning OpenAI's GPT-3
Podcast |
Gradient Dissent
Publisher |
Lukas Biewald
Media Type |
audio
Categories Via RSS |
Technology
Publication Date |
Feb 10, 2022
Episode Duration |
00:43:39

Peter Welinder is VP of Product & Partnerships at OpenAI, where he runs product and commercialization efforts of GPT-3, Codex, GitHub Copilot, and more. Boris Dayma is Machine Learning Engineer at Weights & Biases, and works on integrations and large model training.

Peter, Boris, and Lukas dive into the world of GPT-3:

- How people are applying GPT-3 to translation, copywriting, and other commercial tasks

- The performance benefits of fine-tuning GPT-3-

- Developing an API on top of GPT-3 that works out of the box, but is also flexible and customizable

They also discuss the new OpenAI and Weights & Biases collaboration, which enables a user to log their GPT-3 fine-tuning projects to W&B with a single line of code.

The complete show notes (transcript and links) can be found here: http://wandb.me/gd-peter-and-boris

---

Connect with Peter & Boris:

πŸ“ Peter's Twitter: https://twitter.com/npew

πŸ“ Boris' Twitter: https://twitter.com/borisdayma

---

⏳ Timestamps:

0:00 Intro

1:01 Solving real-world problems with GPT-3

6:57 Applying GPT-3 to translation tasks

14:58 Copywriting and other commercial GPT-3 applications

20:22 The OpenAI API and fine-tuning GPT-3

28:22 Logging GPT-3 fine-tuning projects to W&B

38:25 Engineering challenges behind OpenAI's API

43:15 Outro

---

Subscribe and listen to our podcast today!

πŸ‘‰ Apple Podcasts: http://wandb.me/apple-podcasts​​

πŸ‘‰ Google Podcasts: http://wandb.me/google-podcasts​

πŸ‘‰ Spotify: http://wandb.me/spotify​

This episode currently has no reviews.

Submit Review
This episode could use a review!

This episode could use a review! Have anything to say about it? Share your thoughts using the button below.

Submit Review