# Can I deploy two different models to my jetson at the same time? **URL:** \ **Category:** 🤝 Community Help\ **Created:** [February 10, 2022, 3:02am UTC](https://discuss.roboflow.com/t/can-i-deploy-two-different-models-to-my-jetson-at-the-same-time/127 "2022-02-10T03:02:38Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![anon66594043](https://avatars.discourse-cdn.com/v4/letter/a/3e96dc/32.png) [@anon66594043](https://discuss.roboflow.com/u/anon66594043)\ **Post date:** [February 10, 2022, 3:02am UTC](https://discuss.roboflow.com/t/can-i-deploy-two-different-models-to-my-jetson-at-the-same-time/127/1 "2022-02-10T03:02:38Z")
I need to do two stage object detection at the edge. Can I deploy two different trained models from Roboflow onto the same device (Jetson performance allowing)? ---
**Author:** ![brad](https://yyz1.discourse-cdn.com/flex029/user_avatar/discuss.roboflow.com/brad/32/23_2.png) [@brad](https://discuss.roboflow.com/u/brad)\ **Post date:** [February 10, 2022, 3:32am UTC](https://discuss.roboflow.com/t/can-i-deploy-two-different-models-to-my-jetson-at-the-same-time/127/2 "2022-02-10T03:32:14Z")
Definitely! The [Roboflow Inference Server for NVIDIA Jetson](https://docs.roboflow.com/inference/nvidia-jetson) will handle loading and caching the weights in memory and using the correct ones based on the endpoint you call. ---
**Author:** ![Brian\_Egge](https://yyz1.discourse-cdn.com/flex029/user_avatar/discuss.roboflow.com/brian_egge/32/101_2.png) [@Brian\_Egge](https://discuss.roboflow.com/u/Brian_Egge)\ **Post date:** [February 17, 2022, 5:32pm UTC](https://discuss.roboflow.com/t/can-i-deploy-two-different-models-to-my-jetson-at-the-same-time/127/3 "2022-02-17T17:32:14Z")
I’ve not used the inference server on my 4GB Jetson Nano, as it doesn’t get the performance I’d expect from the device. I load three models: two 608x608x3 and one 608x608x1. I train a Yolov4 darknet model on Google Colab, then on the nano convert it to ONNX. I then compile the ONNX to TensorRT, and use the python bindings to pass opencv images to the tensorrt model. If you avoid TensorRT, you have a lot more flexability in terms of models, but the performance won’t be as optimized. ---
**Author:** ![brad](https://yyz1.discourse-cdn.com/flex029/user_avatar/discuss.roboflow.com/brad/32/23_2.png) [@brad](https://discuss.roboflow.com/u/brad)\ **Post date:** [February 17, 2022, 5:40pm UTC](https://discuss.roboflow.com/t/can-i-deploy-two-different-models-to-my-jetson-at-the-same-time/127/4 "2022-02-17T17:40:56Z")
What speeds do you see there compared to the inference server? ---
**Author:** ![Brian\_Egge](https://yyz1.discourse-cdn.com/flex029/user_avatar/discuss.roboflow.com/brian_egge/32/101_2.png) [@Brian\_Egge](https://discuss.roboflow.com/u/Brian_Egge)\ **Post date:** [February 17, 2022, 7:27pm UTC](https://discuss.roboflow.com/t/can-i-deploy-two-different-models-to-my-jetson-at-the-same-time/127/5 "2022-02-17T19:27:18Z")
Just the `context.execute_async(bindings=bindings, stream_handle=stream.handle)` section runs in 0.006s or about 166 fps, and I’m inferencing a single image. Potentially it could inference 8 images concurrently in the same time if using one model. The bulk of the time my program spends preprocessing the image and the apply nms to the result, using opencv and python. This brings it down to 0.07s or 14 fps. ---
**Author:** ![brad](https://yyz1.discourse-cdn.com/flex029/user_avatar/discuss.roboflow.com/brad/32/23_2.png) [@brad](https://discuss.roboflow.com/u/brad)\ **Post date:** [February 17, 2022, 9:00pm UTC](https://discuss.roboflow.com/t/can-i-deploy-two-different-models-to-my-jetson-at-the-same-time/127/6 "2022-02-17T21:00:56Z")
That makes sense; the more fair compare is against the full time per frame (vs just the model inference) because the server is doing all that other image processing and NMS stuff also vs just calling the model. Have you tried our Jetson Docker to see what fps you get on that?