Multimodal by Bakz T. Future

#28 - The Art of Prompt Design, OpenAI Codex, Fine Tuning and More with Author David Shapiro (daveshapautomator)

Welcome back to Multimodal!  Today's very special guest is David Shapiro.  He's an author, IT professional, and frequent OpenAI community forums contributor. 

In this wide ranging discussion, we discuss the art of prompt design, his thoughts on InstructGPT, OpenAI codex, his new book, the OpenAI community at large, and share thoughts on fine tuning and so much more.

 

Podcast Discussion Timestamps

00:00 - Intro
02:48 - How David heard about OpenAI's GPT-3
05:57 - David's first time trying GPT-3/his favourite use cases
10:38 - Did GPT-3 feel advanced to you?
15:00 - What are the keys to great GPT-3 prompt design?
18:34 - How do you become a better writer?
25:43 - GPT-3: The end of the socially awkward developer (?)
30:16 - Is GPT-3 Prompt Design Over? (Chatting About InstructGPT)
34:21 - Open Fine Tuning Lessons Learned
42:00 - OpenAI Codex / David's Billion Dollar Use Case Idea
50:00 - Which AI Models David is using currently
53:15 - David's Book - Natural Language Cognitive Architecture
1:01:25 - What is the pathway from now to true AGI?
1:08:41 - Thoughts/feedback about the OpenAI Community Forums
1:18:40 - My Feedback on OpenAI's Community Forums
1:22:00 - My Feedback on OpenAI's Community Forums II #hottake 
1:24:46 - Multimodal AI technology
1:27:43 - What would you do with Multimodal AI?
1:32:38 - Where do you see all of this stuff going? 5-10 years
1:35:24 - Closing thoughts

 

Show Notes/Links

OpenAI:

https://openai.com/blog/instruction-following/

https://openai.com/blog/openai-codex/

https://beta.openai.com/docs/guides/fine-tuning

Fine tuning notes:

https://bakztfuture.substack.com/p/openai-fine-tuning-feedbacknotes

GPT-3 navigates the New York subway by Mark Ryan:

https://www.youtube.com/watch?v=Xzb1Vc8dYAY

The Language Instinct: How the Mind Creates Language by Steven Pinker 

https://www.amazon.ca/Language-Instinct-How-Mind-Creates/dp/1491514981

My Biggest 2022 Prediction: GPT-3 will take over schools and college campuses

https://bakztfuture.substack.com/p/my-biggest-2022-prediction-gpt-3

GPT-3 - The End of the Socially Awkward Developer (?)

https://bakztfuture.substack.com/p/gpt-3-the-end-of-the-socially-awkward

GPT-3 Twitter Spaces Event:
https://twitter.com/bakztfuture/status/1491260407579054087?cxt=HHwWjsDU1ZHcgrIpAAAA

 

Follow David Shapiro (daveshapautomator):

 

https://www.davidkshapiro.com/home 

 

https://www.linkedin.com/in/dshap-automator/

 

https://github.com/daveshap 

 

https://community.openai.com/u/daveshapautomator/summary

 

Subscribe to the Multimodal Podcast!

 

Spotify - https://open.spotify.com/show/7qrWSE7ZxFXYe8uoH8NIFV

Apple Podcasts - https://podcasts.apple.com/us/podcast/multimodal-by-bakz-t-future/id1564576820

Google Podcasts -  https://podcasts.google.com/feed/aHR0cHM6Ly9mZWVkLnBvZGJlYW4uY29tL2Jha3p0ZnV0dXJlL2ZlZWQueG1s

Stitcher - https://www.stitcher.com/show/multimodal-by-bakz-t-future

Other Podcast Apps (RSS Link) - https://feed.podbean.com/bakztfuture/feed.xml

 

Connect with me:

YouTube - https://www.youtube.com/bakztfuture

Substack Newsletter - https://bakztfuture.substack.com​

Twitter - https://www.twitter.com/bakztfuture​

Instagram - https://www.instagram.com/bakztfuture​

Github - https://www.github.com/bakztfuture​

#27 - OpenAI’s New Embeddings API Endpoint, InstructGPT Announcement (Fine Tuning Research)

Welcome back to Multimodal!  We start off the podcast by talking about the current tense global geopolitical situation, the decline of google search results (and the GPT-3 opportunity as a result of this), OpenAI's new Embeddings API Endpoint, and the InstructGPT announcement which has significant implications for the language model space.

 

In this episode, I discuss a few topics:

00:00 - Intro

02:15 - Tense Geopolitical Situation between the USA, Russia, and Ukraine

08:14 - Why I sometimes use GPT-3 instead of Google Search

15:19 - OpenAI's New Embeddings API Endpoint

21:07 - InstructGPT Announcement, Fine Tuning Research

 

2022 Predictions Article:

https://bakztfuture.substack.com/p/gpt-3multimodalopenai-predictions

Tweet about Google Search results:

https://twitter.com/bakztfuture/status/1483590498396823557

OpenAI's embeddings endpoint:

https://openai.com/blog/introducing-text-and-code-embeddings/

Sam Altman Tweet about the future of search:

https://twitter.com/sama/status/1486557423674347525

Instruct GPT announcement:

https://openai.com/blog/instruction-following/

 

Subscribe to the Multimodal Podcast!

 

Spotify - https://open.spotify.com/show/7qrWSE7ZxFXYe8uoH8NIFV

Apple Podcasts - https://podcasts.apple.com/us/podcast/multimodal-by-bakz-t-future/id1564576820

Google Podcasts -  https://podcasts.google.com/feed/aHR0cHM6Ly9mZWVkLnBvZGJlYW4uY29tL2Jha3p0ZnV0dXJlL2ZlZWQueG1s

Stitcher - https://www.stitcher.com/show/multimodal-by-bakz-t-future

Other Podcast Apps (RSS Link) - https://feed.podbean.com/bakztfuture/feed.xml

 

Connect with me:

YouTube - https://www.youtube.com/bakztfuture

Substack Newsletter - https://bakztfuture.substack.com​

Twitter - https://www.twitter.com/bakztfuture​

Instagram - https://www.instagram.com/bakztfuture​

Github - https://www.github.com/bakztfuture​

#26 - GPT-3 Insurance Idea, Debating OpenAI’s Bring Your Own Key (BYOK) Policies

Welcome back to Multimodal!  We start off the podcast by talking about the pace/rhythm we're seeing so far in the GPT-3/multimodal space, then talking about very specific GPT-3 related topics such as language model insurance and OpenAI's policies around bringing your own API key.

 

In this episode, I discuss a few topics:

00:00 - Intro

01:48 - "we're not moving fast enough" tweet

07:48 - GPT-3/Large Scale Language Model Business Insurance Idea

20:03 - Discussing OpenAI's Bring Your Own Key Policy

 

"not moving fast enough" tweet:

https://twitter.com/bakztfuture/status/1481428332222853122

GPT-3/Large Scale Language Model Business Insurance:

https://bakztfuture.substack.com/p/gpt-3large-scale-language-model-business

Vova Zakharov:

https://twitter.com/vovahimself

 

Subscribe to the Multimodal Podcast!

 

Spotify - https://open.spotify.com/show/7qrWSE7ZxFXYe8uoH8NIFV

Apple Podcasts - https://podcasts.apple.com/us/podcast/multimodal-by-bakz-t-future/id1564576820

Google Podcasts -  https://podcasts.google.com/feed/aHR0cHM6Ly9mZWVkLnBvZGJlYW4uY29tL2Jha3p0ZnV0dXJlL2ZlZWQueG1s

Stitcher - https://www.stitcher.com/show/multimodal-by-bakz-t-future

Other Podcast Apps (RSS Link) - https://feed.podbean.com/bakztfuture/feed.xml

 

Connect with me:

YouTube - https://www.youtube.com/bakztfuture

Substack Newsletter - https://bakztfuture.substack.com​

Twitter - https://www.twitter.com/bakztfuture​

Instagram - https://www.instagram.com/bakztfuture​

Github - https://www.github.com/bakztfuture​

#25 - OpenAI GLIDE, 2022 Predictions, Github Copilot ＞ GPT-3 (?)

Happy new year!  In this episode, I discuss a few topics:

00:00 - Intro

01:54 - Podcast Housekeeping

5:28 - Personal Update for the 2022 New Year

8:20 - Note of Compassion about the current socio economic challenges of 2022

11:07 - OpenAI Glide Research Paper Announcement

16:40 - GPT-3/Multimodal/OpenAI Predictions for 2022

33:19 - More GPT-3 Predictions

35:41 - Github Copilot > GPT-3 (?)

 

Note of compassion tweet:

https://twitter.com/bakztfuture/status/1478380475425173512

OpenAI Glide:

https://github.com/openai/glide-text2im

https://arxiv.org/abs/2112.10741

DALL-E Discord Community:

https://discord.gg/FCJW2JAu

2022 Predictions:

https://bakztfuture.substack.com/p/gpt-3multimodalopenai-predictions

More Predictions Tweet:
https://twitter.com/bakztfuture/status/1476683313880264708

 

 

Subscribe to the Multimodal Podcast!

 

Spotify - https://open.spotify.com/show/7qrWSE7ZxFXYe8uoH8NIFV

Apple Podcasts - https://podcasts.apple.com/us/podcast/multimodal-by-bakz-t-future/id1564576820

Google Podcasts -  https://podcasts.google.com/feed/aHR0cHM6Ly9mZWVkLnBvZGJlYW4uY29tL2Jha3p0ZnV0dXJlL2ZlZWQueG1s

Stitcher - https://www.stitcher.com/show/multimodal-by-bakz-t-future

Other Podcast Apps (RSS Link) - https://feed.podbean.com/bakztfuture/feed.xml

 

Connect with me:

YouTube - https://www.youtube.com/bakztfuture

Substack Newsletter - https://bakztfuture.substack.com​

Twitter - https://www.twitter.com/bakztfuture​

Instagram - https://www.instagram.com/bakztfuture​

Github - https://www.github.com/bakztfuture​

#24 - OpenAI‘s GPT-3 is now Publicly Available! 🎉🎉🎉

In this episode, I discuss the OpenAI announcement today.  They announced that GPT-3 has been opened up to the public.  I share my personal story with GPT-3, my excitement for others to try out GPT-3, and share two predictions I have about how the community may evolve over the next few months.

 

Please note, you must be 18 years or older in order to use GPT-3 or the OpenAI platform, it is clearly mentioned in the OpenAI terms of service agreement. 

 

OpenAI signup:
https://beta.openai.com/signup

 

 

Subscribe to the Multimodal Podcast!

 

Spotify - https://open.spotify.com/show/7qrWSE7ZxFXYe8uoH8NIFV

Apple Podcasts - https://podcasts.apple.com/us/podcast/multimodal-by-bakz-t-future/id1564576820

Google Podcasts -  https://podcasts.google.com/feed/aHR0cHM6Ly9mZWVkLnBvZGJlYW4uY29tL2Jha3p0ZnV0dXJlL2ZlZWQueG1s

Stitcher - https://www.stitcher.com/show/multimodal-by-bakz-t-future

Other Podcast Apps (RSS Link) - https://feed.podbean.com/bakztfuture/feed.xml

 

Connect with me:

YouTube - https://www.youtube.com/bakztfuture

Substack Newsletter - https://bakztfuture.substack.com​

Twitter - https://www.twitter.com/bakztfuture​

Instagram - https://www.instagram.com/bakztfuture​

Github - https://www.github.com/bakztfuture​

#23 - OpenAI CEO Sam Altman‘s Worldcoin and Math GPT-3 Announcement Discussion

This week in the podcast, I'm discussing the latest research developments coming from OpenAI as well as the new cryptocurrency started by OpenAI CEO Sam Altman.

02:32 - OpenAI Codex last episode follow up
09:30 - Sam Altman's Worldcoin / Conspiracy Theory about the purpose of this cryptocurrency
17:54 - "Math GPT-3" Review

Carp:
https://arxiv.org/abs/2110.03111

GPT-3 vs OpenAI codex on Google trends:
https://trends.google.com/trends/explore/TIMESERIES/1634520000?hl=en-GB&tz=240&date=all&geo=CA&q=gpt-3,openai+codex&sni=3

Codex polls:
https://twitter.com/bakztfuture/status/1450814233231314948
https://www.youtube.com/user/bakztfuture/community

Worldcoin - https://worldcoin.org/

"Math GPT-3" blog post - https://openai.com/blog/grade-school-math/

 

Subscribe to the Multimodal Podcast!

 

Spotify - https://open.spotify.com/show/7qrWSE7ZxFXYe8uoH8NIFV

Apple Podcasts - https://podcasts.apple.com/us/podcast/multimodal-by-bakz-t-future/id1564576820

Google Podcasts -  https://podcasts.google.com/feed/aHR0cHM6Ly9mZWVkLnBvZGJlYW4uY29tL2Jha3p0ZnV0dXJlL2ZlZWQueG1s

Stitcher - https://www.stitcher.com/show/multimodal-by-bakz-t-future

Other Podcast Apps (RSS Link) - https://feed.podbean.com/bakztfuture/feed.xml

 

Connect with me:

YouTube - https://www.youtube.com/bakztfuture

Substack Newsletter - https://bakztfuture.substack.com​

Twitter - https://www.twitter.com/bakztfuture​

Instagram - https://www.instagram.com/bakztfuture​

Github - https://www.github.com/bakztfuture​

#22 - Is OpenAI Codex Fizzling Out?

Is OpenAI Codex fizzling out? Today, I explore potential reasons why this could be the case.

 

05:42 - GPT-3 product launch vs. OpenAI Codex product launch

09:30 - What do I believe may be the cause of OpenAI Codex fizzling out? Reason #1 ...

10:28 - Reason #2

12:15 - Reason #3

13:34 - OpenAI codex use cases

14:40 - The best use case for OpenAI Codex

18:31 - OpenAI Codex UI

20:50 - OpenAI Codex Javascript Sandbox is awesome

22:20 - Zero shot code generation

 

GPT-3 vs OpenAI codex on Google trends:
https://trends.google.com/trends/explore/TIMESERIES/1634520000?hl=en-GB&tz=240&date=all&geo=CA&q=gpt-3,openai+codex&sni=3

 

Subscribe to the Multimodal Podcast!

 

Spotify - https://open.spotify.com/show/7qrWSE7ZxFXYe8uoH8NIFV

Apple Podcasts - https://podcasts.apple.com/us/podcast/multimodal-by-bakz-t-future/id1564576820

Google Podcasts -  https://podcasts.google.com/feed/aHR0cHM6Ly9mZWVkLnBvZGJlYW4uY29tL2Jha3p0ZnV0dXJlL2ZlZWQueG1s

Stitcher - https://www.stitcher.com/show/multimodal-by-bakz-t-future

Other Podcast Apps (RSS Link) - https://feed.podbean.com/bakztfuture/feed.xml

 

Connect with me:

YouTube - https://www.youtube.com/bakztfuture

Substack Newsletter - https://bakztfuture.substack.com​

Twitter - https://www.twitter.com/bakztfuture​

Instagram - https://www.instagram.com/bakztfuture​

Github - https://www.github.com/bakztfuture​

#21 - Discussing GPT-3, OpenAI Codex, and Multimodal AI with YouTube Creator Sandra Kublik

Chatting about GPT-3, YouTube Content Creation, Codex, and Multimodal AI with my friend Sandra Kublik!

 

Podcast breakdown:

02:10 - discussing Sandra's latest (trippy) video

13:14 - Thoughts about GPT-3

22:08 - OpenAI Codex early impressions

31:35 - Thoughts on DALL-E

37:31 - Kairos Data Labs and Sandra's upcoming book on GPT-3

 

Sandra Kublik:

Linkedin https://www.linkedin.com/in/sandrakublik/

Youtube https://www.youtube.com/c/technocratic

Twitter https://twitter.com/sandra_kublik/

Instagram https://www.instagram.com/sandra_kublik/

 

Kairos Data Labs:

Linkedin https://www.linkedin.com/company/79707767/

Twitter https://twitter.com/KairosDataLabs

Nextgrid: https://nextgrid.ai/ https://www.meetup.com/pl-PL/Deep-Learning-Labs/

 

 

Subscribe to the Multimodal Podcast!

 

Spotify - https://open.spotify.com/show/7qrWSE7ZxFXYe8uoH8NIFV

Apple Podcasts - https://podcasts.apple.com/us/podcast/multimodal-by-bakz-t-future/id1564576820

Google Podcasts -  https://podcasts.google.com/feed/aHR0cHM6Ly9mZWVkLnBvZGJlYW4uY29tL2Jha3p0ZnV0dXJlL2ZlZWQueG1s

Stitcher - https://www.stitcher.com/show/multimodal-by-bakz-t-future

Other Podcast Apps (RSS Link) - https://feed.podbean.com/bakztfuture/feed.xml

 

Connect with me:

YouTube - https://www.youtube.com/bakztfuture

Substack Newsletter - https://bakztfuture.substack.com​

Twitter - https://www.twitter.com/bakztfuture​

Instagram - https://www.instagram.com/bakztfuture​

Github - https://www.github.com/bakztfuture​

#20 - GPT-X, DALL-E, and our Multimodal Future Closing Thoughts, Clubhouse Event, and more!

And that's a wrap!  All 19 videos of GPT-X, DALL-E, and our Multimodal Future have been released.

 

In this episode I talk about:

• the upcoming clubhouse event I'm throwing to discuss the future of AI and Creativity

• recap and expand on all the videos in this series

• talk about the future of this podcast

Check out the series at https://www.youtube.com/playlist?list=PLza3gaByGSXjUCtIuv2x9fwkx3K_3CDmw 

 

Clubhouse Free Event Link:
https://www.clubhouse.com/event/PN6bAp0l

Please note the event will now be at 1 PM EST not 4 PM EST like it was originally scheduled.

 

Subscribe to the Multimodal Podcast!

 

Spotify - https://open.spotify.com/show/7qrWSE7ZxFXYe8uoH8NIFV

Apple Podcasts - https://podcasts.apple.com/us/podcast/multimodal-by-bakz-t-future/id1564576820

Google Podcasts -  https://podcasts.google.com/feed/aHR0cHM6Ly9mZWVkLnBvZGJlYW4uY29tL2Jha3p0ZnV0dXJlL2ZlZWQueG1s

Stitcher - https://www.stitcher.com/show/multimodal-by-bakz-t-future

Other Podcast Apps (RSS Link) - https://feed.podbean.com/bakztfuture/feed.xml

 

Connect with me:

YouTube - https://www.youtube.com/bakztfuture

Substack Newsletter - https://bakztfuture.substack.com​

Twitter - https://www.twitter.com/bakztfuture​

Instagram - https://www.instagram.com/bakztfuture​

Github - https://www.github.com/bakztfuture​

#19 - Discussing Housing, Policy, and AI with Kemal Ahmed (York Centre NDP MP Candidate)

In today's episode, I took a break from discussing GPT-X, DALL-E, and our Multimodal Future to talk with my friend Kemal Ahmed who is a technologist running for office as the NDP Candidate for the York Centre riding.  Kemal may also be the first Canadian Politician ever to use GPT-3 as a part of his political campaign.

 

We discuss various topics like:

• Increased housing prices
• What it's like being a millenial nowadays in the Greater Toronto Area
• What he thinks about GPT-3, how he's using it in his political campaign
• His thoughts on AI and governance
• Why it's important for technologists to run for office in the future

Kemal Ahmed

 

https://kemalahmed.ca/

 

https://twitter.com/kemalahmedproud

 

https://kemalahmed.ca/volunteer/

 

 

Subscribe to the Multimodal Podcast!

 

Spotify - https://open.spotify.com/show/7qrWSE7ZxFXYe8uoH8NIFV

Apple Podcasts - https://podcasts.apple.com/us/podcast/multimodal-by-bakz-t-future/id1564576820

Google Podcasts -  https://podcasts.google.com/feed/aHR0cHM6Ly9mZWVkLnBvZGJlYW4uY29tL2Jha3p0ZnV0dXJlL2ZlZWQueG1s

Stitcher - https://www.stitcher.com/show/multimodal-by-bakz-t-future

Other Podcast Apps (RSS Link) - https://feed.podbean.com/bakztfuture/feed.xml

 

Connect with me:

YouTube - https://www.youtube.com/bakztfuture

Substack Newsletter - https://bakztfuture.substack.com​

Twitter - https://www.twitter.com/bakztfuture​

Instagram - https://www.instagram.com/bakztfuture​

Github - https://www.github.com/bakztfuture​