Hosted API sometimes fails to respond

Community Help
1

Describe your question/issue here! (delete this when you post)

In my project I’m using the hosted API to run inference on my workflow which is a quite standard Yolo SAHI flow. Usually the inference is stable without issues, but the other day all of a sudden I keep getting timeouts in my attempts to run inference. This also happened sometimes when testing the workflow through app.roboflow.com

The error I see is this:

>  {"severity":"WARNING","message":"TypeError: fetch failed\n    at node:internal/deps/undici/undici:12618:11\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n    at async makeRequest (/functions/lib/detector/utils.js:81:30) {\n  cause: ConnectTimeoutError: Connect Timeout Error\n      at onConnectTimeout (node:internal/deps/undici/undici:7760:28)\n      at node:internal/deps/undici/undici:7716:50\n      at Immediate._onImmediate (node:internal/deps/undici/undici:7748:13)\n      at process.processImmediate (node:internal/timers:478:21) {\n    code: 'UND_ERR_CONNECT_TIMEOUT'\n  }\n}"}
>  {"severity":"ERROR","message":"Unhandled error TypeError: fetch failed\n    at node:internal/deps/undici/undici:12618:11\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n    at async makeRequest (/functions/lib/detector/utils.js:81:30) {\n  cause: ConnectTimeoutError: Connect Timeout Error\n      at onConnectTimeout (node:internal/deps/undici/undici:7760:28)\n      at node:internal/deps/undici/undici:7716:50\n      at Immediate._onImmediate (node:internal/deps/undici/undici:7748:13)\n      at process.processImmediate (node:internal/timers:478:21) {\n    code: 'UND_ERR_CONNECT_TIMEOUT'\n  }\n}"}

My questionsa:

  1. Is there something that can be done to mitigate these issues with the hosted inference?
  2. Do you have some kind of “downdetector” that I can use in my project to detect if there are issues with the API?
  3. Do you have some mirrors for the hosted API if these failures are common during a certain period?

Thanks

  • Project Type: Yolo
  • Operating System & Browser: MacOS, Chrome
  • Project Universe Link or Workspace/Project ID: -
2

Thanks for writing in @agoransson. Are you still running into issues? We recently experienced a few unusual delays as a result of an upstream provider.

Monitor Roboflow status here: https://status.roboflow.com/.

And full sdk docs here: Developer Tools | Roboflow Docs.

3

Right now I’m seeing issues again, but it’s not noted on the status.roboflow.com website.

Worth mentioning is that I’m using the serverless.roboflow.com server.

Thanks

/Andreas