Summary

Getting Started

The quickest way to get up to date on what’s going on is probably to read OpenAI’s 2023-03-14 GPT-4 Announcement

• GPT-4 is a significant step up from GPT-3.5 (the original ChatGPT) and performs at human-level in many benchmarks
• Some more data is available in the “Technical Report”, primarily in the appendices: https://arxiv.org/pdf/2303.08774.pdf but if you’re doing further reading the “System Card” document is more interesting: https://cdn.openai.com/papers/gpt-4-system-card.pdf

News

It feels like there’s a year’s worth of announcements and launches per week, and it’s hard to keep up, but here are some ways to try…

News Site

• https://www.marktechpost.com/
• https://www.reddit.com/r/machinelearningnews/

Weekly Newsletters

• https://oneusefulthing.substack.com/
• https://lifearchitect.substack.com/
• https://aibreakfast.beehiiv.com
• https://linusekenstam.substack.com/

Leonard’s Firehose Feeds

• https://twitter.com/i/lists/1633321011394510848
• https://www.reddit.com/user/randomfoo2/m/ai

Products

Top

These are the things that are free and easy to try…

ChatGPT

• https://chat.openai.com/
• Free version has ChatGPT 3.5, paid version ($20/mo) has “priority” performance and 4.0 access
• Plugins just launched: https://openai.com/blog/chatgpt-plugins

Bing Chat

• https://www.bing.com/new
• GPT-4 w/ search (w/o fine-tuning)
• See: https://lifearchitect.ai/bing-chat/

Bing Image Creator

• https://www.bing.com/create
• Works well

Midjourney

• Free, but you sign in and interact via Discord (weird, I know)
• https://www.midjourney.com/showcase/recent/

Google Bard

• https://bard.google.com/
• Does not fare well vs Bing: https://www.youtube.com/watch?v=9ll_pth4Sss

Lists

• https://gpt3demo.com

• https://theresanaiforthat.com
• https://joinsuperhuman.notion.site/The-Ultimate-100-AI-Tools-568436f72af7490cadfc13338f245435
• https://www.youtube.com/watch?v=gpP_YEv_9jA
• https://github.com/radi-cho/awesome-gpt4

Custom Search

Libraria

• https://libraria.dev
• Custom AI assistants/embeds on custom data sets

Evidence Hunt

• https://evidencehunt.com
• Search and summarize PubMed

ChatPDF

• https://www.chatpdf.com
• Upload and query any PDF file

Text to Speech

Eleven Labs

• https://beta.elevenlabs.io/

Speechify

• https://speechify.com/
• Snoop!

NaturalReader

• https://www.naturalreaders.com/online/

  https://uberduck.ai/

• https://fakeyou.com/
• https://learn.microsoft.com/en-us/azure/cognitive-services/speech-service/how-to-custom-voice-create-voice?tabs=neural
• https://blog.paperspace.com/training-vall-e-from-scratch-on-your-own-voice-samples/
• https://developer.nvidia.com/blog/training-your-own-voice-font-using-flowtron/

Image Generation

Midjourney

Midjourney V5 is probably the most advanced/best quality AI image generator publicly available atm

• https://www.midjourney.com/

InvokeAI

Easiest way to run Stable Diffusion on your local computer

• https://github.com/invoke-ai/InvokeAI/releases

DiffusionBee

On Mac, you can also give this a try:

• https://diffusionbee.com/

Design Helpers

Adobe Firefly

https://www.adobe.com/sensei/generative-ai/firefly.html

Imgcreator

https://imgcreator.ai/

Video

RunwayML

Provides a suite of tools for video generation, modification, replacement, etc.

• https://runwayml.com/
• https://research.runwayml.com/gen2
• Examples
  • Image expansion: https://www.youtube.com/watch?v=4Q5qstYoYu0
  • https://aiff.runwayml.com/
  • https://twitter.com/TakuBeats/status/1625284449901641729
  • Budget Filming
    • https://twitter.com/stopsatgreen/status/1636042802168578058
    • https://twitter.com/karenxcheng/status/1627721862565482496
    • https://twitter.com/DonAllenIII/status/1629046101314600961
    • https://twitter.com/MartinNebelong/status/1631374504944345092
    • https://twitter.com/DonAllenIII/status/1624565256151535616

NeRF

Luma

https://lumalabs.ai/

Nvidia Instant NeRF

https://github.com/NVlabs/instant-ngp https://developer.nvidia.com/blog/getting-started-with-nvidia-instant-nerfs/ https://www.nvidia.com/en-us/research/ai-art-gallery/instant-nerf/

Coding

Github

• https://github.com/features/copilot
• https://github.com/features/preview/copilot-x
• Copilot Impact Assessment

Notes and Productivity

Notion AI

• https://www.notion.so/product/ai

Mem.ai

https://get.mem.ai/

Microsoft Loop

• https://www.microsoft.com/en-us/microsoft-loop
• https://www.microsoft.com/en-us/microsoft-365/blog/2023/03/22/new-microsoft-loop-app-is-built-for-modern-co-creation/

Microsoft 365 Copilot

• https://blogs.microsoft.com/blog/2023/03/16/introducing-microsoft-365-copilot-your-copilot-for-work/

Transcription

AssemblyAI

https://www.assemblyai.com/playground/source

Whisper

https://openai.com/research/whisper https://github.com/openai/whisper https://github.com/ggerganov/whisper.cpp

ORG

Music

• https://google-research.github.io/seanet/musiclm/examples/

• https://openai.com/research/musenet

• https://soundraw.io/

• https://boomy.com/

• https://www.shutterstock.com/discover/ampermusic

• Milo

• https://www.joinmilo.com/

• https://www.ycombinator.com/companies/milo

• Voice

• https://www.youtube.com/watch?v=EAowXV_hWks

• Lindy

• https://twitter.com/LinusEkenstam/status/1638706159963209729

• AI assistant that connects to your Calendar, Email

• Knowy

• https://twitter.com/KnowyAI

• NeRF

• https://twitter.com/LumaLabsAI/

• https://twitter.com/laanlabs

• https://docs.nerf.studio/en/latest/

• https://www.kiriengine.app

• Record Everything

  • https://www.rewind.ai/

Research

AGI

2023-03-22 Sparks of Artificial General Intelligence: Early experiments with GPT-4

• Microsoft research teams on their initial experiments with GPT-4 in a 152pg paper
• Additional commented out sections: https://threadreaderapp.com/thread/1638769434763608064.html

2023-02-04 Theory of Mind May Have Spontaneously Emerged in Large Language Models

• https://www.reddit.com/r/aipromptprogramming/comments/121m3zg/prompt_unraveling_the_mystery_of_theory_of_mind/

Projects

Self Hosted

Lists

• https://github.com/nichtdax/awesome-totally-open-chatgpt
• https://github.com/wsxiaoys/awesome-ai-coding

Web Scraping

ScrapeGhost

https://jamesturk.github.io/scrapeghost/ scrapeghost is an experimental library for scraping websites using OpenAI’s GPT.

Custom Search

Markprompt

https://markprompt.com/ https://github.com/motifland/markprompt Markprompt is a platform for building GPT-powered prompts. It scans Markdown, Markdoc and MDX files in your GitHub repo and creates embeddings that you can use to create a prompt, for instance using the companion Markprompt React component. Markprompt also offers analytics, so you can gain insights on how visitors interact with your docs.

Text Annotation

Potato

https://github.com/davidjurgens/potato

Video

Text2Video-Zero

ModelScope Text to Video Synthesis

https://huggingface.co/damo-vilab/modelscope-damo-text-to-video-synthesis https://modelscope.cn/models/damo/text-to-video-synthesis/summary https://twitter.com/_akhaliq/status/1639434628166459395 https://www.reddit.com/r/StableDiffusion/comments/120j6h8/barry_chuckle_absolutely_shredding_in_front_of_an/

Voice

VALL-E

• https://valle-demo.github.io/
• https://arstechnica.com/information-technology/2023/01/microsofts-new-ai-can-simulate-anyones-voice-with-3-seconds-of-audio/

Misc

• Training custom Stable Diffusion models
  • https://stable-diffusion-art.com/models/
  • https://huggingface.co/models?other=stable-diffusion
  • https://civitai.com/

AI Safety

https://cdn.openai.com/papers/gpt-4-system-card.pdf https://langchain.readthedocs.io/en/latest/modules/chains/examples/constitutional_chain.html https://www.alignmentforum.org/

https://twitter.com/goodside/status/1639136386404982784

Pre-2008: We’ll put the AI in a box and never let it out. Duh.
2008-2020: Unworkable! Yudkowsky broke out! AGI can convince any jail-keeper! 2021-2022: yo look i let it out lol
2023: Our Unboxing API extends shoggoth tentacles directly into your application [waitlist link]

https://twitter.com/lxrjl/status/1639397697084874752

"Why would you think AI might end up displaying [deception/power-seeking/other scary thing]?"
"People will design them to"
"But those theorems might not apply to the real wo.... WAIT WHAT?"
"People will design them to"

https://twitter.com/davidad/status/1639215289677017099

AGI

Time to AGI

https://www.metaculus.com/questions/3479/date-weakly-general-ai-is-publicly-known/ https://twitter.com/wintonARK/status/1639291591549681666

https://en.wikipedia.org/wiki/Existential_risk_from_artificial_general_intelligence https://www.lesswrong.com/posts/gEchYntjSXk9KXorK/uncontrollable-ai-as-an-existential-risk https://en.wikipedia.org/wiki/Superintelligence

https://www.anthropic.com/index/core-views-on-ai-safety

https://twitter.com/AnthropicAI/status/1603791161419698181

Sparks of AGI: https://www.youtube.com/watch?v=Mqg3aTGNxZ0

https://twitter.com/DV2559106965076/status/1638769434763608064

https://arxiv.org/abs/2303.12712

https://nlpurr.notion.site/Sparks-of-Artificial-General-Intelligence-Early-experiments-with-GPT-4-d10b39b0e65e40f2b7e23365dd5af59e

https://www.lesswrong.com/posts/azRwPDbZfpadoL7WW/an-appeal-to-ai-superintelligence-reasons-to-preserve

AI Tool Use

https://openai.com/blog/chatgpt-plugins https://www.reddit.com/r/dataengineering/comments/10ijsqy/i_built_an_llmpowered_tool_that_can_understand/ https://til.simonwillison.net/llms/python-react-pattern

Prompt Engineering

https://lifearchitect.ai/bing-chat/#prompt https://www.jailbreakchat.com/ https://www.reddit.com/r/aipromptprogramming/

Training Costs

https://simonwillison.net/2023/Mar/17/beat-chatgpt-in-a-browser/ https://simonwillison.net/2023/Mar/13/alpaca/

$30 https://twitter.com/alighodsi/status/1639251347777388544

https://twitter.com/neuralmagic/status/1638889340020625409

Examples

• AI Cover Letter Generator
  • https://www.careered.ai/tool/cover-letter
• Eminem Cat Rap
  • https://www.youtube.com/watch?v=jnQ0zEQPu_A

• “Her” demo
  • https://twitter.com/justLV/status/1637876167763202053
• Coding
  • https://twitter.com/charlierward/status/1637887392626384903
  • https://twitter.com/ammaar/status/1635754631228952576
• ChatGPT self-generating plugins
  • https://twitter.com/danielgross/status/1639040289816866818
• Understanding EY tweets
  • https://twitter.com/anthrupad/status/1639421396840316932
• Better Voice Cloning
  • https://www.youtube.com/watch?v=EAowXV_hWks

Fiction

• The Diamond Age https://en.wikipedia.org/wiki/The_Diamond_Age
• Somewhat related…
  • Llena https://qntm.org/mmacevedo

Learning

• LLM Introduction: Learn Language Models
  • “Bootstrap knowledge of LLMs ASAP. With a bias/focus to GPT. Avoid being a link dump. Try to provide only valuable well tuned information.”
• AI Notes: Top AI Reads
  • “notes for software engineers getting up to speed on new AI developments. Serves as datastore for lspace.swyx.io writing, and product brainstorming, but has cleaned up canonical references under the /Resources folder.”
• Simulators
  • “TL;DR: Self-supervised learning may create AGI or its foundation. What would that look like?”