# Discrepancy between model weights and roboflow hosted inference?

**URL:** <https://discuss.roboflow.com/t/discrepancy-between-model-weights-and-roboflow-hosted-inference/10854>\
**Category:** 🛠️ Feature Reqs\
**Created:** [August 5, 2025, 11:26pm UTC](https://discuss.roboflow.com/t/discrepancy-between-model-weights-and-roboflow-hosted-inference/10854 "2025-08-05T23:26:20Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![mz0g](https://yyz1.discourse-cdn.com/flex029/user_avatar/discuss.roboflow.com/mz0g/32/5877_2.png) [@mz0g](https://discuss.roboflow.com/u/mz0g)\
**Post date:** [August 5, 2025, 11:26pm UTC](https://discuss.roboflow.com/t/discrepancy-between-model-weights-and-roboflow-hosted-inference/10854/1 "2025-08-05T23:26:20Z")

</div>

Hello, I trained an RF-DETR model on my own dataset. I then started testing it via the “Try This Model” feature. When I tried a test image via this feature it correctly identified all the objects. I then downloaded the model locally and ran inference on the same image using model = RFDETRBaseNano(finetuned\_path) and self.model.predict(image) and ran my prediction but I did not get the same results and the model missed a lot of the objects that it got when i used the try this model feature. Is there a preprocessing step or something im missing? I was very surprised to see this discrepancy.

---

<div class="post-metadata">

**Author:** ![mz0g](https://yyz1.discourse-cdn.com/flex029/user_avatar/discuss.roboflow.com/mz0g/32/5877_2.png) [@mz0g](https://discuss.roboflow.com/u/mz0g)\
**Post date:** [August 6, 2025, 4:28am UTC](https://discuss.roboflow.com/t/discrepancy-between-model-weights-and-roboflow-hosted-inference/10854/2 "2025-08-06T04:28:44Z")

</div>

update. I tried using the pipeline inference api and the detection matched with the “Try this Model” feature. Is the model available to download not the same weights as the one hosted? I’ve spent the last couple hours trying to debug this and I’m pretty confused.

---

<div class="post-metadata">

**Author:** ![Ford](https://yyz1.discourse-cdn.com/flex029/user_avatar/discuss.roboflow.com/ford/32/7747_2.png) [@Ford](https://discuss.roboflow.com/u/Ford)\
**Post date:** [August 6, 2025, 5:39pm UTC](https://discuss.roboflow.com/t/discrepancy-between-model-weights-and-roboflow-hosted-inference/10854/3 "2025-08-06T17:39:50Z")

</div>

Hi @mz0g!  
Unfortunately, I’m unable to support models implemented outside of the Roboflow environment because there are several confounding variables that could be causing the issue.

I strongly suggest deploying your model with [inference](https://inference.roboflow.com/), it is a fantastic option that will provide the easiest and quickest option to deploy your model into production.

---

<div class="post-metadata">

**Author:** ![mz0g](https://yyz1.discourse-cdn.com/flex029/user_avatar/discuss.roboflow.com/mz0g/32/5877_2.png) [@mz0g](https://discuss.roboflow.com/u/mz0g)\
**Post date:** [August 8, 2025, 6:05am UTC](https://discuss.roboflow.com/t/discrepancy-between-model-weights-and-roboflow-hosted-inference/10854/4 "2025-08-08T06:05:00Z")

</div>

ok cool. i will check it out. i took a look at the documentation and im a little confused how it works with the credits. I am running inference on a video on a local gpu. What type of service under roboflow’s offerings would this be considered?

---

<div class="post-metadata">

**Author:** ![Ford](https://yyz1.discourse-cdn.com/flex029/user_avatar/discuss.roboflow.com/ford/32/7747_2.png) [@Ford](https://discuss.roboflow.com/u/Ford)\
**Post date:** [August 11, 2025, 9:12pm UTC](https://discuss.roboflow.com/t/discrepancy-between-model-weights-and-roboflow-hosted-inference/10854/5 "2025-08-11T21:12:01Z")

</div>

Hi @mz0g!  
Great question! This is known as a “Self Hosted Deployment”, and you can find more information on its credit consumption here: [Roboflow Credits: Understanding Usage Based Pricing](https://roboflow.com/credits)