The Parallel Universe Magazine
Intel’s quarterly magazine for software innovation helps you take your software development into the future with the latest tools, tips, and training to expand your expertise.
Issue 57, July 2024
Feature: AI PC Brings Larger LLM Development to Your Desk
This issue showcases a series of articles covering a variety of AI topics.
Download Issue 57 to find:
- How it's possible to do serious development more conveniently and securely on a local system instead of automatically defaulting to remote data center or cloud systems to develop large models.
- How to accelerate low-bit LLM inference while taking advantage of the GPT*-generated unified format.
- How to use the new SYCL* back end to run llama.cpp (a lightweight, high-performance LLM framework that is gaining popularity) on Intel® GPUs.
Contents
Explore how small form-factor PCs based on Intel® Core® Ultra processors can deftly run the Llama 3 70B parameter model locally and at a lower cost than a workstation.
Get the steps for running an open source Stable Diffusion* model on Intel® Gaudi® AI accelerators to create your own unique work of art.
The newly developed SYCL* in llama.cpp—a light, open source LLM framework—enables developers to deploy on the spectrum of Intel GPUs and GPUs from other vendors.
Explore techniques that combine the strengths of Intel® DSA with CPUs to boost performance using fewer CPU cores. The article includes STREAM benchmarks.
Introducing the low-precision quantized open LLM leaderboard, a new tool for finding high-quality models that can be deployed efficiently on a given client.
Learn how to convert a PyTorch* model to the GPT-Generated Unified Format (GGUF), a new binary file format that optimizes the efficiency of LLM storage and processing.
Learn about the architectural advantages of AADC (Algorithmic Adjoint Differentiation Compiler) and how it enhances the performance of resource-intensive financial computations.
Stay In the Know on All Things CODE
Sign up to receive the latest tech articles, tutorials, dev tools, training opportunities, product updates, and more, hand-curated to help you optimize your code, no matter where you are in your developer journey. Take a chance and subscribe. You can change your mind at any time.