Pinchflat

Do you need a whole PC to run a GPU?

Media Tasks
Actions

Raw Attributes

Source: Jeff Geerling
  • livestream: false
  • upload_date_index: 99
  • nfo_filepath: /downloads/Jeff Geerling/Season 2025/s2025e122099 - Do you need a whole PC to run a GPU？.nfo
  • description: Shop Micro Center Holiday Deals: https://micro.center/e787eb Check out Micro Center's Other Top Deals: https://micro.center/315b05 Shop Micro Center Bundles: https://micro.center/f7b037 Visit Micro Center News: https://micro.center/9b77f2 Can a Raspberry Pi match the performance of a modern desktop PC when it comes to GPU performance? Of course not, in a general sense. But there are specific use cases where you'd be surprised by how close the Pi comes, performance-wise. In some cases, the Pi is actually faster! Resources I mentioned in this video: - AI Benchmark results and methodology: https://github.com/geerlingguy/ai-benchmarks - Multi-GPU benchmark results: https://github.com/geerlingguy/ai-benchmarks/issues/44 - Use AMD GPUs on Pi: https://www.jeffgeerling.com/blog/2025/using-amd-gpus-on-raspberry-pi-without-recompiling-linux - Use Nvidia GPUs on Pi: https://www.jeffgeerling.com/blog/2025/nvidia-graphics-cards-work-on-pi-5-and-rockchip - Use Intel GPUs on Pi: https://www.jeffgeerling.com/blog/2025/all-intel-gpus-run-on-raspberry-pi-and-risc-v eGPU Setup (some links are affiliate links): - Minisforum DEG1 eGPU Dock: https://amzn.to/4s3gUz6 - Micro SATA Cables Oculink to M.2 adapter: https://amzn.to/49dKKcE - Super Flower 850W PSU: https://www.microcenter.com/product/684393/super-flower-leadex-iii-gold-up-850-watt-80-plus-gold-atx-fully-modular-power-supply-atx-31-compatible - AMD Radeon AI Pro R9700: https://www.microcenter.com/product/702853/xfx-amd-radeon-ai-pro-r9700-single-fan-32gb-gddr6-pcie-50-graphics-card Dual GPU Setup (some links are affiliate links): - chenyang PCIe 4.0 M.2 NGFF to SFF-8643: https://amzn.to/4pyqSqt - 10Gtek SFF-8644 to SFF-8643 Cable: https://amzn.to/3MKNbup - Dolphin PCIe HBA MXH932: https://dolphinics.com/products/MXH932.html - Dolphin 3 slot PCIe Backplane: https://dolphinics.com/products/IBP-G4X16-3.html HUGE thanks to Patrick from @ServeTheHomeVideo for helping me record at Micro Center in Phoenix :) Support me on Patreon: https://www.patreon.com/geerlingguy Sponsor me on GitHub: https://github.com/sponsors/geerlingguy Merch: https://www.redshirtjeff.com 2nd Channel: https://www.youtube.com/@GeerlingEngineering 3rd Channel: https://www.youtube.com/@Level2Jeff Contents: 00:00 - Pi vs PC 00:53 - Enough for Jellyfin? Local LLMs? 01:50 - 4 GPUs 1 Pi 02:16 - Comparing costs and energy use 03:07 - Gaming on haitus (for now) 03:39 - The setups 04:56 - ffmpeg and Jellyfin media transcoding 07:31 - 3D rendering with GravityMark 08:39 - LLMs on AMD 09:36 - LLMs on Nvidia 12:27 - Drivers, Vulkan, and CUDA 13:06 - Dual GPU - Setup 15:24 - Sharing memory and PCIe ACS 16:28 - llama.cpp performance - mixed Nvidia GPUs 17:08 - 52GB of VRAM on AMD 17:28 - Intel PC dual Nvidia GPU comparison 17:56 - Who wins?
  • id: 58875
  • uploaded_at: 2025-12-20T15:00:24Z
  • inserted_at: 2026-01-02T20:20:20Z
  • uuid: e829b23b-01da-4b5a-885b-d6bbf69f73be
  • last_error:
  • playlist_index: 4
  • short_form_content: false
  • predicted_media_filepath: /downloads/Jeff Geerling/Season 2025/s2025e122099 - Do you need a whole PC to run a GPU？.mp4
  • media_filepath: /downloads/Jeff Geerling/Season 2025/s2025e122099 - Do you need a whole PC to run a GPU？.mp4
  • original_url: https://www.youtube.com/watch?v=8X2Y62JGDCo
  • updated_at: 2026-01-03T01:58:39Z
  • media_redownloaded_at:
  • source_id: 8
  • title: Do you need a whole PC to run a GPU?
  • matching_search_term:
  • media_downloaded_at: 2026-01-03T01:58:30Z
  • prevent_download: false
  • thumbnail_filepath: /downloads/Jeff Geerling/Season 2025/s2025e122099 - Do you need a whole PC to run a GPU？-thumb.jpg
  • media_size_bytes: 225642582
  • duration_seconds: 1120
  • metadata_filepath: /downloads/Jeff Geerling/Season 2025/s2025e122099 - Do you need a whole PC to run a GPU？.info.json
  • media_id: 8X2Y62JGDCo
  • prevent_culling: false
  • subtitle_filepaths: en/downloads/Jeff Geerling/Season 2025/s2025e122099 - Do you need a whole PC to run a GPU？.en.srt
  • culled_at:
Worker
State
Scheduled At
Pinchflat.Downloading.MediaDownloadWorker completed