Welcome to Get The Gist, where every weekday we share an easy-to-read summary of the latest and greatest developments in AI—news, innovations, and trends—all delivered in under 5 minutes! ⏱

In today’s edition:

• Meta’s Ray-Ban Smart Glasses Get Advanced AI Capabilities

• Google Launches Gemini 1.5 Flash 8B Model

• OpenAI Unveils ChatGPT Canvas

• Microsoft’s New Copilot AI Vision Can See What You Browse

• And more AI news….

Top Developments

Meta

Meta’s Ray-Ban Smart Glasses Get Advanced AI Capabilities

The Gist: At the recent Meta Connect event, Mark Zuckerberg unveiled cool upgrades to Meta's Ray-Ban smart glasses, emphasizing their AI capabilities, including a feature that lets them "remember" things for you—like where you parked. The glasses aim to enhance user experience with ease of interaction and practical functions.

Key Details:

• The glasses can now "remember" where you parked, responding to prompts about your location in real-time.

• Users can activate the AI with a single prompt and have seamless follow-up interactions without repeating commands.

• A live translation feature will soon allow real-time conversations in multiple languages, syncing with a companion app for translations.

• The glasses' partnership with "Be My Eyes" helps blind users get assistance from volunteers by broadcasting what they see.

Gemini

Google Launches Gemini 1.5 Flash 8B Model

The Gist: Google has launched the Gemini 1.5 Flash 8B model, an affordable and fast AI tool designed for developers, slashing costs while maintaining strong performance across various applications like chat and transcription.

Key Details:

• The new model costs 50% less than its predecessor and offers 2x the rate limits at 4,000 requests per minute.

• It performs nearly at par with the original 1.5 Flash model, making it effective for long-context tasks and language translation.

• Pricing for using the model starts at $0.0375 per million tokens on prompts, significantly lowering the entry cost for developers.

• Developers can access it for free on Google AI Studio, with a paid tier launching on October 14th.

OpenAI

OpenAI Unveils ChatGPT Canvas!

The Gist: OpenAI has unveiled Canvas, a new interface designed to enhance collaboration between users and ChatGPT for writing and coding projects. This early beta feature aims to improve user experience with a more interactive approach.

Key Details:

• Canvas opens in a separate window, allowing for real-time collaboration on projects, making editing and revising much easier.

• The tool adapts to user needs by automatically launching when it detects a situation where it can enhance productivity, or by the prompt "use canvas."

• Users can directly edit text and code, set specific goals, and utilize shortcuts for quick adjustments, like changing writing length or debugging code.

• OpenAI is focused on making Canvas accessible to everyone after beta testing, with plans to roll it out to free user accounts after the trial phase.

Quick Gist

Microsoft launched updates to its AI assistant Copilot, introducing experimental features Copilot Labs and Copilot Vision for $20/month subscribers, enhancing problem-solving and browsing assistance while raising potential privacy concerns (Read More).

Google has rolled out its Gemini Q&A feature to Gmail on iOS, allowing users to ask questions about their inbox and summarize emails, but it is exclusively available to certain Google Workspace customers (Read More).

Google's Gemini Live AI chatbot is set to support over 40 languages soon, enabling users to engage in natural conversations and multi-language interactions on Android devices (Read More).

At Facebook Connect 2024, Meta unveiled Llama 3.2 along with the Llama Stack, a suite of reference APIs designed to simplify the development of AI applications for its large language models (Read More).

Google is enhancing its Chromebook lineup with a range of new AI-driven tools, including Live Translate and writing assistance features, signaling a major commitment to AI technology in its devices (Read More).

Google has integrated shopping ads into its AI Overview feature and plans to expand ad placements within Google Lens, enhancing advertising opportunities within its search tools (Read More).

Google is enhancing its search engine with more AI capabilities, allowing users to ask voice-activated questions about images and organizing search results into AI-generated summaries, despite prior issues with misinformation (Read More).

Tim Brooks, co-lead of OpenAI's video generator Sora, has left to join Google DeepMind, highlighting ongoing challenges and high-profile departures at OpenAI (Read More).

THAT’S IT FOR TODAY!