Supposedly Leaked Internal Google Document Claims Open Source AI Will Outcompete Google and OpenAI
May 5th, 2023There will be closed and open source alternatives that will allow users to customize the models’ worldviews.
That didn’t take long. I thought it would take at least several months for them to attain something GPT3.5-like.
Nope.
I don’t know if this is real or not, but it makes for interesting reading.
Via: SemiAnalysis:
Open-source models are faster, more customizable, more private, and pound-for-pound more capable. They are doing things with $100 and 13B params that we struggle with at $10M and 540B. And they are doing so in weeks, not months.
…
People will not pay for a restricted model when free, unrestricted alternatives are comparable in quality. We should consider where our value add really is.
…
The more tightly we control our models, the more attractive we make open alternatives. Google and OpenAI have both gravitated defensively toward release patterns that allow them to retain tight control over how their models are used. But this control is a fiction. Anyone seeking to use LLMs for unsanctioned purposes can simply take their pick of the freely available models.