# Can't run GPU inference server - missing libnvidia-ml.so.1

**URL:** <https://discuss.roboflow.com/t/cant-run-gpu-inference-server-missing-libnvidia-ml-so-1/8934>\
**Category:** 🤝  Community Help\
**Created:** [March 7, 2025, 7:07pm UTC](https://discuss.roboflow.com/t/cant-run-gpu-inference-server-missing-libnvidia-ml-so-1/8934 "2025-03-07T19:07:31Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![LouNL](https://avatars.discourse-cdn.com/v4/letter/l/cab0a1/32.png) [@LouNL](https://discuss.roboflow.com/u/LouNL)\
**Post date:** [March 7, 2025, 7:07pm UTC](https://discuss.roboflow.com/t/cant-run-gpu-inference-server-missing-libnvidia-ml-so-1/8934/1 "2025-03-07T19:07:31Z")

</div>

I get the following error when trying to run the latest GPU version of inference server in Windows:

> Image roboflow/roboflow-inference-server-gpu:latest pulled.  
> Starting inference server container…  
> 400 Client Error for http+docker://localnpipe/v1.47/containers/796db12edaf3e3298640c04226f3a199ac9a686f45707999a8809c443cd9c5f2/start: Bad Request (“failed to create task for container: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error running hook #0: error running hook: exit status 1, stdout: , stderr: Auto-detected mode as ‘legacy’  
> nvidia-container-cli: initialization error: load library failed: libnvidia-ml.so.1: cannot open shared object file: no such file or directory: unknown”)

The CPU version works fine.

---

<div class="post-metadata">

**Author:** ![Grzegorz](https://yyz1.discourse-cdn.com/flex029/user_avatar/discuss.roboflow.com/grzegorz/32/2877_2.png) [@Grzegorz](https://discuss.roboflow.com/u/Grzegorz)\
**Post date:** [March 11, 2025, 11:47am UTC](https://discuss.roboflow.com/t/cant-run-gpu-inference-server-missing-libnvidia-ml-so-1/8934/2 "2025-03-11T11:47:47Z")

</div>

Hi @LouNL ,

Are you starting docker through WSL (Windows Subsystem for Linux)?

Thanks,  
Grzegorz

---

<div class="post-metadata">

**Author:** ![system](https://canada1.discourse-cdn.com/flex029/uploads/roboflow1/original/1X/bb6edbfa56d0cf2ee603f061e9e09103502cc8cc.png) [@system](https://discuss.roboflow.com/u/system)\
**Post date:** [April 1, 2025, 11:47am UTC](https://discuss.roboflow.com/t/cant-run-gpu-inference-server-missing-libnvidia-ml-so-1/8934/3 "2025-04-01T11:47:51Z")

</div>

This topic was automatically closed 21 days after the last reply. New replies are no longer allowed.