# Enable local inference, RF-DETR

**URL:** <https://discuss.roboflow.com/t/enable-local-inference-rf-detr/11813>\
**Category:** 🤝  Community Help\
**Created:** [February 2, 2026, 8:42am UTC](https://discuss.roboflow.com/t/enable-local-inference-rf-detr/11813 "2026-02-02T08:42:52Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![EE\_2026](https://avatars.discourse-cdn.com/v4/letter/e/ec9cab/32.png) [@EE\_2026](https://discuss.roboflow.com/u/EE_2026)\
**Post date:** [February 2, 2026, 8:42am UTC](https://discuss.roboflow.com/t/enable-local-inference-rf-detr/11813/1 "2026-02-02T08:42:52Z")

</div>

Hi Roboflow Support Team,

I’m on the Core Plan and having issues with local inference for my fine-tuned RF-DETR model. The cloud API works perfectly, but local inference finds 0 detections on the same images.

**Project Details:**

- Workspace: woodvision

- Project: rv-c2vdq

- Model: Version 10 (RF-DETR Medium)

- API Key: UyXXXXXXXXXXXXXXX

- Plan: Core ($79/mo)

**What Works:**

- Using Roboflow cloud API with the `roboflow` Python library - detections work perfectly

- Processing time: ~1500ms per image

**What Doesn’t Work:**

- Using local inference with `inference-gpu` library

- Same model, same images = 0 detections found

- Code: `model = get_model("rv-c2vdq/10", api_key=API_KEY)` then `model.infer(image_path, confidence=40)`

**Environment:**

- Python 3.11

- inference-gpu installed

- Windows with NVIDIA Quadro P520 GPU

- The model loads successfully (no errors), but predictions list is always empty

**Use Case:** I’m building a production lumber defect detection system that requires \<500ms inference time, which is why I need local inference instead of cloud API.

**Questions:**

1. Is there a deployment step I’m missing to enable local inference for RF-DETR models?

2. Does my Core Plan actually support local inference for fine-tuned RF-DETR models?

3. Are there any special configuration steps needed to make local inference work properly?

The console shows the model loads successfully but then finds 0 detections on images that clearly have defects (verified via cloud API).

Can you help me troubleshoot why local inference isn’t working?

Thanks, Erik

---

<div class="post-metadata">

**Author:** ![Patrick\_Nihranz](https://yyz1.discourse-cdn.com/flex029/user_avatar/discuss.roboflow.com/patrick_nihranz/32/8829_2.png) [@Patrick\_Nihranz](https://discuss.roboflow.com/u/Patrick_Nihranz)\
**Post date:** [February 11, 2026, 4:19pm UTC](https://discuss.roboflow.com/t/enable-local-inference-rf-detr/11813/2 "2026-02-11T16:19:32Z")

</div>

Hi @EE_2026 Thanks for the detailed report—this is really helpful for troubleshooting. I noticed a potential issue in your code that’s likely the root cause:

You have: model.infer(image\_path, confidence=40)

The confidence parameter expects a decimal (0-1), not a percentage. confidence=40 means 4000%, which would filter out everything.

Try this instead: model.infer(image\_path, confidence=0.40)

Let me know if the confidence fix resolves it, otherwise I have some troubleshooting steps we can go through!

---

<div class="post-metadata">

**Author:** ![system](https://canada1.discourse-cdn.com/flex029/uploads/roboflow1/original/1X/bb6edbfa56d0cf2ee603f061e9e09103502cc8cc.png) [@system](https://discuss.roboflow.com/u/system)\
**Post date:** [March 4, 2026, 4:20pm UTC](https://discuss.roboflow.com/t/enable-local-inference-rf-detr/11813/3 "2026-03-04T16:20:32Z")

</div>

This topic was automatically closed 21 days after the last reply. New replies are no longer allowed.