Leaked Google AI Documents Reveal Information on “Google and OpenAI”

– 💻 Google was seen as the top AI company until OpenAI emerged and dominated the field with its software, including GPT models.
– 📝 A leaked Google document admits that neither Google nor OpenAI have a competitive edge in AI, and that open source models are faster, more customizable, private, and capable than proprietary models.
– 🚀 Open source models have cultural impact, innovation, product integration, marketplace, and user interface advantages, and are advancing faster due to community contributions.
– 🔍 Low cost public involvement in fine-tuning AI models is enabled by a cheaper mechanism called low rank adaptation or Laura, resulting in faster innovation and iteration.
– 🤖 Large tech companies cannot compete with open source models due to impracticality of prosecuting individuals and the flexibility of data scaling laws.
– 💼 Facebook benefits from leaked models as most open source innovation is happening on top of their architecture, and they can incorporate it into their products.
– 📈 Google and OpenAI need to change their stance on control versus innovation if they want to keep up with open source alternatives.
– 🗓️ The leaked llama model was launched in February 2023, leaked to the public in March, and led to a flurry of community innovation and iteration resulting in low budget fine-tuning projects and the replication of the model by the community.