Intended to make it easier for developers to create AI-powered applications with world-class performance, NVIDIA and Google today announced three new collaborations at Google I/O ’24. Using TensorRT-LLM, NVIDIA is working with Google to optimize two new models it introduced at the event: Gemma 2 and PaliGemma. These models are built from the same research and […]

The post NVIDIA and Google DeepMind Collaborate on LLMs appeared first on High-Performance Computing News Analysis | insideHPC.

Amazon announced it has made its biggest-ever investment, $2.75 billion, in OpenAI/Chat-GPT competitor Anthropic, another indication that the generative AI phenomenon continues to heat up. Today’s news follows Amazon and Anthropic announcing an earlier $1.25 billion investment last September – the announcement today brings the total investment to $4 billion. “We have a notable history with […]

The post Amazon Adds $2.75B to Stake in GenAI Startup Anthropic appeared first on High-Performance Computing News Analysis | insideHPC.

London, 27 March 2024: Oriole Networks – a startup using light to train LLMs faster with less power – has raised £10 million in seed funding to improve AI performance and adoption, and solve AI’s energy problem. The round, which the company said is one of the UK’s largest seed raises in recent years, was co-led […]

The post Oriole Networks Raises £10m for Faster LLM Training appeared first on High-Performance Computing News Analysis | insideHPC.

Many industries are starting to run HPC in the cloud. Find out how GPU-accelerated compute, from AWS and NVIDIA, is helping organizations run HPC workloads and AI/ML jobs faster, in a more energy-efficient way.

The post Accelerated HPC for Energy Efficiency with AWS and NVIDIA appeared first on High-Performance Computing News Analysis | insideHPC.

Oct. 27, 2023 — Datasaur, a natural language processing (NLP) data-labeling platform, today launched LLM Lab, an interface designed for data scientists and engineers to build and train custom LLM models like ChatGPT. The product will provide a wide range of features for users to test different foundation models, connect to their own internal documents, […]

The post Datasaur Launches LLM Lab for ChatGPT and Similar Models appeared first on High-Performance Computing News Analysis | insideHPC.

Dell Technologies (NYSE: DELL) is collaborating with Meta in a partnership designed to make it easy to deploy Meta’s Llama 2 large language models on premises with Dell’s generative AI portfolio of IT infrastructure and client devices. Dell said the collaboration simplifies the on-prem AI environment by combining Dell’s infrastructure portfolio and Llama 2 AI models....

The post Dell and Meta in GenAI Pact with Llama 2 LLMs appeared first on High-Performance Computing News Analysis | insideHPC.

[Sponsored Guest Article] With the explosion of use cases such as Generative AI and ML Ops driving tremendous demand for the most advanced GPUs and accelerated computing platforms, there’s never been a better time to explore the “as-a-service” model to help get started quickly.  What could take months of shipping delays and massive CapEx investments can be yours on demand....

The post Federated GPU Infrastructure for AI Workflows appeared first on High-Performance Computing News Analysis | insideHPC.

HPC-AI industry analyst firm Hyperion Research said its new study on Large Language Models in the HPC community shows that interest in LLMs has exploded in the last six months driven by unique capabilities of the technology to answer queries, generate concise summaries, and even produce unique works of fiction....

The post Hyperion: HPC Community’s Interest in LLMs Has ‘Exploded,’ with Complexity, Cost Concerns appeared first on High-Performance Computing News Analysis | insideHPC.

“Lawyers who use AI will replace lawyers who don’t.” That was the coda of a presentation given at the recent HPC User Forum in Tucson by Arizona State University law professor Gary Marchant, a graduate of Harvard Law School and a professor at ASU since 1999. Marchant’s presentation at the Forum, hosted by Hyperion Research, was one of the conference's most talked-about sessions. In this interview, Marchant shares his observations on how generative AI and large language models....

The post HPC User Forum: ‘Lawyers Who Use AI Will Replace Lawyers Who Don’t’ appeared first on High-Performance Computing News Analysis | insideHPC.

Large language models fit the classic model of a red-hot technology in an early stage of commercial viability: there’s more talk about it than knowledge, and FOMO – the fear that your competitors are implementing it at your peril – is helping to drive explosive demand. There’s also an allure and mystery around LLMs: some of the awe-inspiring "zero shot" things they do surprise even the data scientists who trained the models (more on this below). Against this backdrop....

The post Large Language Models: The Largeness, the Power and the ‘Emergent’ Mystery appeared first on High-Performance Computing News Analysis | insideHPC.