Together AI

?? Announcing the launch of Llama 3.2 and Llama Stack on Together AI, in partnership with AI at Meta. ?? We are excited to offer free access to the Llama 3.2 vision model for developers to build and innovate with open source AI. Start building with the Llama-Vision-Free model today: ?? https://lnkd.in/gWxwdaVd ? What we are launching: - Free Llama 3.2 Vision Model (11B): Develop and experiment with our high-quality Llama-Vision-Free endpoint for multimodal tasks. -?Together Turbo Inference Endpoints (11B, 90B): High performance and accuracy for tasks like image captioning, visual question answering, and image-text retrieval. -?New Llama Stack APIs: Standardized APIs to simplify building agentic and retrieval-augmented generation (RAG) conversational apps. ? Unlock powerful use cases: -?Interactive Agents: Build AI agents that process both image and text inputs Image Captioning: Create high-quality image descriptions for e-commerce and digital accessibility -?Visual Search: Enable users to search via images, enhancing search efficiency for retail and e-commerce ? Industry applications: -?Healthcare: Accelerate medical image analysis for faster diagnostics Retail & E-commerce: Revolutionize shopping with image-based search and personalized recommendations -?Finance & Legal: Streamline workflows by analyzing visual and textual content to optimize contract reviews and audits ?? Check out napkins.dev: Our open-source demo app uses Llama 3.2 vision to transform sketches and wireframes into React code! Try it out at https://napkins.dev ?? Get started today: Experiment with the Llama-Vision-Free endpoint, or build for production with Llama 3.2 Together Turbo endpoints. ?? Read more in the blog https://lnkd.in/gDfmXxzu

?? FLUX Tools Now Available on Together AI Black Forest Labs' new ?? FLUX Tools suite is now on Together AI. This release includes three specialized models, each leveraging different techniques to give more precise control over AI image generation: ?? Canny: Preserves structural integrity using edge detection, allowing you to maintain composition while transforming style and content through text prompts. Perfect for design iterations and creative transformations. ?? Depth: Masters spatial relationships through depth mapping, ensuring generated variations maintain proper perspective and object positioning. Game-changing for architectural visualization and interior design. ?? Redux: Simplifies the variation process - input an image, get slight variants without needing prompts. Ideal for something like product photography.. ? Plus, we're making FLUX.1 [dev] available alongside these tools, offering higher quality image generation than the schnell model. ?? And speaking of schnell - we're still offering a free model endpoint for schnell until the end of the year! Read more about the new FLUX tools here: https://lnkd.in/gQ4v7-_4

A fantastic course on building generative AI games — emerging as a big category of applications built on Together AI platform. I am forever in awe of game designers — the cross section of talents required to build effective games seems daunting, but Niki Birkner and Nick Walton break it down elegantly in this course. Generative models are a great tool for building consistent worlds that players can immerse themselves in. The course shows how game creators can use AI models on Together to build an entirely new class of games or add new experiences to existing ones.

Time to play! Build an interactive game from scratch with LLMs in this new short course: Building an AI-Powered Game. Created with Together AI and AI Dungeon/Latitude, taught by Niki Birkner, Senior Product Manager at Together AI, and Nick Walton, CEO and Co-Founder of Latitude. This course shows you how to use large language models to create and power a text-based game that you can share with your friends and family. You’ll build a world with hierarchical content generation, a method that allows you to leverage LLMs to create a vast amount of content with a high level of control and consistency. For instance, if you were building a fantasy world with several kingdoms, in which each kingdom has multiple towns, and each town has several locations and residents, creating all this content from scratch can easily become tedious and difficult to track. With hierarchical content generation, you can create information about your world, shape its direction with a human-in-the-loop, and keep it consistent, with little effort based on your prompts. By the end of this course, you’ll know how to prompt engineer to create a layered and interwoven world and integrate it into an AI roleplay game that is interesting, interactive, and safe to share with anyone. In detail, you’ll:? - Learn to implement game mechanics using AI to parse text data into structured JSON output, enabling features like an inventory system. - Use game mechanics with story and state components that feed into one another to improve your game's memory, and gives the player a steady state of the world. - Learn to enforce safety and compliance for AI content generation and create custom policies using Llama Guard. With these techniques, you'll be equipped to build AI-powered applications, starting with your own game. Please sign up here:? https://lnkd.in/gwwkVUwj

I’m beyond excited to share a project that’s been in the works for months! I’ve collaborated with the creator of the famous game AI Dungeon (Nick Walton from Latitude) and one of the people I admire most in the AI industry, Andrew Ng, to bring to life an awesome course about how to build an AI powered game. In this course, you'll use Together AI’s platform to prompt engineer a layered world and integrate it into an AI roleplay game that is interesting, interactive, and safe to share with anyone. It’s incredible to see how far this industry has come and the possibilities it’s unlocking! ?? Check it out: https://bit.ly/4fxWHul

Announcing the Launch of Typhoon API Pro SCB 10X and Together AI are pleased to announce the launch of Typhoon API Pro, a production-ready API service powered by Together AI’s advanced serverless infrastructure. With flexible per-token pricing and enterprise-grade reliability, this release marks a significant milestone in making production-grade Thai language AI accessible for real-world use cases. Typhoon, the open-source large language models optimized for Thai language processing, developed by SCB 10X, is now available with infrastructure designed for business deployment. Typhoon API Pro delivers the performance, reliability, and scalability required for production environments. Key Features: - Enterprise-grade infrastructure powered by Together AI - Optimized inference performance - Scalable deployment options - Professional support and SLAs - Production-ready API endpoints - Per-token pricing Organizations can now leverage Typhoon's advanced Thai language capabilities with the assurance of professional infrastructure and support. This collaboration between SCB 10X and Together.ai represents our commitment to advancing Thai language AI technology while meeting enterprise requirements for reliability and performance. The models are available for testing at Together AI’s playground: ? Typhoon 1.5 8b instruct model: https://lnkd.in/guUEaq_t? ? Typhoon 1.5x 70b instruct awq model: https://lnkd.in/gets5gQG For more information about pricing, technical specifications, and implementation, please contact https://lnkd.in/g-vsFjKp

? Together AI is co-building a massive NVIDIA GB200 Cluster with 36K Blackwell GPUs, in partnership with Hypertec Group! ?? Key Highlights: - 36K Blackwell GPUs to supercharge AI workloads from Q1 2025. - Together Kernel Collection (TKC) for up to 24% faster training & 75% faster FP8 inference. - Ultra-efficient Grace CPUs, NVLink, and Infiniband for unbeatable scalability. - Seamless PyTorch integration for AI researchers and developers. ?? Partnering for Global Scale: Hypertec's expertise in data center operations helps us secure capacity for 100,000+ GPUs throughout 2025, enabling AI developers to focus on breakthroughs rather than infrastructure. ?? ?? "Together AI provides the performance and reliability we need for real-time, high-quality image and video generation at scale." - Victor Perez, Co-Founder, Krea ?? Learn more about our new GPU cluster and how it can transform your AI workloads: https://lnkd.in/evrWakBD ?? Request early access for GB200 cluster today: together.ai/hypertec

Introducing llama-ocr – a free + open source OCR tool! It takes unstructured documents (images for now) & outputs structured text in markdown. We've already had over 15,000 people try the demo in the last few days since we launched & 500+ developers installed the npm package too. Traditional OCR models usually can't handle complex documents and quickly fall apart in complex use cases. By using vision models though, we can unlock better OCR for more complex documents like receipts, PDFs with tables, charts, ect.. and extract information from these documents in a nice structured format. Feel free to check out the demo below or download the npm package today, it only takes 5 lines of code to do great OCR (and we have a free endpoint). ◆ demo: https://llamaocr.com/ ◆ npm package: https://lnkd.in/e8SVv_M8 For now, llama-ocr is a simple wrapper on top of Llama 3.2 vision (on Together AI) but we plan to add support for more documents soon like PDFs, JSON output, & more models! #ai #opensource #artificialintelligence

We're excited to announce that Together AI will be sponsoring SC Conference Series in Atlanta next week Nov 17-22! Stop by booth #661 to connect with our engineering team and dive into discussions on scaling compute clusters for high-performance AI workloads. We’d love to see you there!

New Cookbook: Summarizing and Evaluating Outputs with LLMs. In this notebook we: 1. Generate summaries using Llama 3.1 70B 2. Assess summary quality using BERTScore evaluated between original document chunks and the summary. Link Below: https://lnkd.in/gKemJpWU