IBM Research

Despite all their capabilities, large language models can struggle with long input sequences due to their limited memory capacity. To address this, several teams at IBM Research are working on solutions that make it easy to upgrade LLMs with additional memory without having to retrain the models. https://lnkd.in/ecE6huDh

In collaboration with NASA, IBM has released an open-source foundation model that can be customized for a variety of weather and climate-related applications and served from a desktop computer. Potential applications include creating targeted forecasts from local weather data, predicting extreme weather events, improving the spatial resolution of global climate simulations, and improving the representation of physical processes in conventional weather and climate models. Learn more! Blog post: https://ibm.co/3TDul9a Research paper: https://ibm.co/3TAILXG Download the foundation model on Hugging Face: https://ibm.co/3XPmhol

In this week's newsletter, we explore AI training and boosting your fantasy football performance. We share some of the highlights from the PyTorch Conference 2024, we look at how IBM researchers are making it easier to train AI models, and explain how AI can help you win Fantasy Football Read more on the latest news and subscribe here:

Dario Gil of IBM at our AI Summit this month: “I tell my enterprise clients, take your valuable assets, your data, make sure more of it is represented in foundational models that you will own, it will turn out to be one of your most valuable assets.”

At this year's PyTorch conference, scientists from IBM Research are presenting new advances that will make it easier than ever for developers to train AI models on the open-source platform. One of these achievements is a training milestone, which they reached with fully sharded data parallel (FSDP), a strategy to enable faster model training on fewer GPUs. The other is a PyTorch-native data loader that will help developers coordinate and reconfigure training workloads as needed, eliminating a common bottleneck in the model training pipeline. https://lnkd.in/ehmxrs2z

On this day in 1984, IBM announced volume production of the 256,000-bit memory chip. This 256-kilobit memory chip allowed for the assembly of more than 4 million characters of information on a single circuit card, making it the densest computer memory package ever offered to IBM customers at the time. The 256K-bit chip could store four times as much data and occupied only about twice the space of the IBM 64K-bit chip it replaced. The chip was manufactured using optical lithography techniques that produced circuit patterns, the smallest of which were geometric features just 1.5 micrometers wide. Increasing the storage density of computer memory chips was a big step in reducing the cost of component manufacturing, leading to lower costs for computer users during the burgeoning PC era. Stay tuned for more moments in IBM's research history. #IBMHistory?

The annual Quantum Industry Day in Switzerland, co-organised by IBM Research and hosted by Quantum Basel in Arlesheim, will take place this year on September 23, 2024. Join us there, registration is still open at the link below! IBM researchers will take part in several sessions meant to provide insights into various aspects of quantum computing and its impact on the industry sector. Dr. Heike Riel, IBM Fellow, Head Science of Quantum & Information Technology, will host the morning session with several keynote speakers including Cleveland Clinic’s Dr Lara Jehi, MD, MHCDS and Unesco’s Amal Kasry. She will also moderate a panel discussion with speakers from finance, science & technology, and the public sector. In addition, Marco Brenner, Quantum Safe Program Executive, will contribute to a Quantum-Safe Security session to talk about the cybersecurity implications of quantum computers. We hope to see you there! #IBM #IBMResearch #quantumcomputing #quantumsafe https://ibm.co/4gG77td

In this week's newsletter, we're sharing how IBM is making Granite AI models even easier to use. We take a special look inside the world of science at this year's Hudson Forum, showcase IBM's new demo site, Granite Playground, and we introduce the new Granite Docs site for developers. Read more on the latest news and subscribe here:

Last week, we were pleased to welcome this year's Hudson Forum hosted to our headquarters in New York. Leaders from across academia, industry, and government came together for a day of discussions diving into a range of deep scientific topics, jointly hosted by IBM, Duality Group, and the Simons Laufer Mathematical Sciences Institute. Talks and chats covered the state of AI, quantum computing, the future of gene editing, and neurotechnology — to name a few. Learn more about the Hudson Forum building the future with collaboration and math: https://ibm.co/47qVS3u

This week, IBM Research was on the ground at SEMICON India to share our latest advances in logic scaling, packaging technology, intelligent fab and more. As part of this engagement, Mukesh Khare, GM of IBM Semiconductors and VP of Hybrid Cloud Research, and Sandip Patel, Managing Director of IBM India, had the opportunity to demonstrate to Prime Minister Narendra Modi how IBM is a leader in AI through innovations like our geospatial AI model with NASA and IBM AIU Spyre chip. IBM also signed a memorandum of understanding with India semiconductor leader Larsen & Toubro to collaborate on designing advanced processors.