AI Community

VideoPrism: A Game Changer for Video Understanding Excited to share our latest research on VideoPrism, a powerful new model for understanding videos! Imagine unlocking the secrets hidden within millions of videos: from everyday moments to historical events and scientific observations. VideoPrism is here to make that possible! This groundbreaking ViFM tackles a wide range of tasks, including: - Classification:?Identifying objects and actions in videos.?? - Localization:?Pinpointing where things happen in videos. - Retrieval:?Finding videos based on text descriptions. - Captioning:?Generating captions that accurately describe videos.??? - Question Answering:?Answering questions about the content of videos. What makes VideoPrism unique? - Massive and diverse pre-training data:?We trained VideoPrism on a huge dataset of videos and text,?including high-quality captions and even noisy auto-generated transcripts. - Two-stage training:?This innovative approach helps the model learn from both the visual content and the accompanying text,?leading to a deeper understanding of videos. - State-of-the-art performance:?VideoPrism outperforms previous models on a wide range of benchmarks,?showing its exceptional capabilities. Beyond the benchmarks: - Combining with LLMs:?VideoPrism can be paired with language models to unlock even more powerful applications,?like video-text retrieval,?captioning,?and question answering. - Scientific applications:?VideoPrism is already showing promise in assisting scientists in various fields,?like ethology and ecology. Read more: https://lnkd.in/e4Zi9R73 #VideoUnderstanding #AI #Science #MachineLearning #Research

?? Take Privacy-Powered Typing Experience to New Heights with Gboard ???? In the fast-paced world of technology, Google Research is setting new standards for privacy and efficiency with its latest advancements in Gboard's language models (LMs). Powering features like next word prediction and Smart Compose, these on-device LMs are enhancing the user experience while prioritizing data privacy like never before. ???? ?? With the integration of federated learning (FL) since 2017 and the addition of formal differential privacy (DP) guarantees in 2022, Gboard is leading the way in private, collaborative model training directly on users' devices. This groundbreaking approach ensures user data remains on the device, offering both lower latency and superior privacy protection. ?? ??? Innovative Privacy Measures in Action: - Transparency and Control: Gboard users are informed about how their data is used and have easy access to configure these settings. - Data Minimization: By focusing solely on updates that enhance model performance, FL ensures that only necessary data is processed. - Anonymization through DP: Applying DP during server processing prevents the model from learning unique user information, offering quantifiable privacy measures. - Auditability: Google's commitment to openness is evident in its public disclosure of algorithmic approaches and privacy accounting. ?? A Leap Forward in Privacy Guarantees: Gboard's on-device LMs, now deployed in over 7 languages across 15+ countries, adhere to stringent (?, δ)-DP guarantees, marking a significant milestone in user-level DP deployment. The journey towards even stronger DP guarantees continues, with models for Portuguese in Brazil and Spanish in Latin America achieving an ε ≤ 1, setting a new standard for privacy in machine learning. Click here to read more: https://lnkd.in/djTmTJeY #GoogleResearch #Gboard #PrivacyInnovation #FederatedLearning #DifferentialPrivacy #AI #MachineLearning

Android Early Access Preview for On-Device Generative AI Gemini Nano runs on-device and enables features where the data should not leave the device, such as suggesting replies to messages in an end-to-end encrypted messaging app. https://lnkd.in/gDMB-jAR

Introducing Gemini: Google's largest and most capable AI model ???? Google Research is at the forefront of a groundbreaking shift in AI technology, promising to revolutionize the digital world even more profoundly than mobile or the web. As they navigate their eighth year as an AI-first company, the pace of innovation isn't just sustained - it's accelerating exponentially! ?? Millions are already harnessing the power of generative AI in daily life, from complex problem-solving to creative collaborations. Google's AI models and infrastructure are not just transforming user experiences; they're fueling the growth of startups and enterprises globally. ???? What's truly remarkable is that we're just beginning to unveil AI's full potential. Google Research's commitment to bold, responsible research is paving the way for AI technologies that promise enormous benefits while incorporating safeguards to address evolving risks. Their investment in cutting-edge tools, models, and infrastructure, adhering to their AI Principles, is guiding this transformative journey. ????? Introducing Gemini, Google's most advanced and versatile model yet, marks a significant milestone in this journey. Gemini 1.0, comprising Ultra, Pro, and Nano versions, showcases state-of-the-art performance across multiple benchmarks. This innovation is a testament to Google DeepMind's vision and represents one of the most significant science and engineering efforts in Google's history. ???? Gemini is more than just a model; it's a beacon of hope and opportunity, set to unlock new possibilities for people across the globe. With capabilities spanning text, code, audio, image, and video understanding, Gemini stands as a testament to the future of AI — a future where technology is not just a tool but a partner in advancing human creativity and productivity. ???? The road ahead is filled with untapped potential and uncharted territories. Google Research's commitment to exploring these realms responsibly and collaboratively sets a precedent for the future of AI, ensuring that the advancements we make today pave the way for a more informed, creative, and productive tomorrow. ???? https://lnkd.in/dAyySX2p #Google #GoogleAi #Gemini #AIRevolution #GoogleResearch #Innovation #Technology #GeminiModel #ArtificialIntelligence #FutureIsNow #GoogleDeepMind