[Help Wanted] Deploying Roboflow Workflow with Qwen2.5-VL on RunPod + Gradio Interface

Community Help
1

Hi everyone,

I’m working on a vision-language AI project and looking to:

:white_check_mark: Deploy a Roboflow-trained workflow

:white_check_mark: Run inference using Qwen2.5-VL-7B on RunPod

:white_check_mark: Build a Gradio interface on top for user input (images/videos) and visual output

:white_check_mark: Optionally display system performance (GPU/CPU usage) within the interface

Key Questions:

  1. Is it possible to self-host a Roboflow workflow on RunPod, especially one that integrates a Qwen2.5-VL model?
  2. Can this be combined with a custom Gradio interface to allow users to upload videos or images and receive predictions?
  3. Is anyone here (or can recommend someone) who can help implement this setup from start to finish?

Let me know if this workflow is feasible, and feel free to reach out if you’re interested in helping out as a developer or consultant.

2

Hi! Glad to see you’re working on deploying Qwen :slight_smile:

We don’t have specific support for pipelines to deploy on RunPod or via Gradio. For cloud inference, we’d recommend using our cloud deployment directly and hooking that up to Gradio instead of going through RunPod.

Having said that, if you MUST use RunPod, the flow might look similar to their tutorial for using Ollama. In theory, you could spin up Roboflow Inference server and serve HTTP requests in the same way they talk about serving HTTP requests from Ollama. We don’t have specific experience with RunPod, this is just the closest we saw on a quick review of their documentation so your milage may vary :slight_smile:

There’s no reason why using a hosted backend couldn’t be made to work with Gradio!

We don’t generally provide implementation services outside of enterprise use cases, nor do we recommend third parties to implement pipelines.

All in all, it is feasible to use Roboflow cloud deployment with a Gradio frontend to server Roboflow-trained Qwen models to users, but it seems likely RunPod could be used as well by hosting our open source Inference package :slight_smile:

3

This topic was automatically closed 21 days after the last reply. New replies are no longer allowed.