I made a GPT that is up-to-date on the ChatGPT API, pricing, rate limits, etc.

The GPT is here if you want to mess around with it https://chat.openai.com/g/g-DcBbcauha-api-expert

I made it just to help myself as I’m messing around with the new APIs. It was annoying to not be able to ask ChatGPT about its own new versions since they came after its 2023 knowledge cutoff 😂

Fed into it are:

  • Manually copy pasted the entire contents of https://platform.openai.com/docs/overview into one file, with all sections expanded, all language examples, and all rate limit tiers. I’m sure I could have scraped it somehow but it loads content with JS and copy pasting was actually the easiest way even though it was annoying
  • https://openai.com/pricing which I used OCR to get all the text from and had chatgpt put that into neat tables
  • The openai-node api.md and readme.md
  • The openai-python api.md and readme.md

I want to add more but it limits you to 10 files. Also I wonder what the limitations are on files. I want to a/b test this against concatenating the entire repos for the openai-node and openai-python into single files and using those as one of the 10.

It actually only works rarely. You can tell they’re load balancing and GPTs mostly fall back to an older version of GPT-4 with a knowledge cutoff in 2022. One time though I asked it about using gpt 4 turbo and it really worked, gave me a UI that it was searching its knowledge, and it successfully used the up-to-date documentation I fed it.

Sometimes I would click into my GPT and get bounced out

Oddly I went back to edit it to see if maybe one of the files I uploaded was a problem, but the GPT was present in my list but with the edit button completely missing.

Mostly I’m getting answers like this

fail answer

But once it did successfully give me this!

Also interestingly I was unable to name the GPT anything with “OpenAI” in it as that seems to be reserved/restricted so I can’t name it something that specifies what API it’s for

Can’t name it anything with “OpenAI” in the name

Also worth noting that as a default when you make a GPT it says it was published by you with your full first and last name. They added an option to instead swap that with your domain if you verify the domain with a txt record, which I did and it worked immediately. Awesome.

I also had an idea of making a mini product to auto-update the assistant API when you git push to your own docs repo and if this ends up working I’m kind of considering this a proof of concept. So far not so good, they have a lot of things to work out.