Training Error and Credits refund

I have got the training error three times in row and the credits were charged. The model was stuck at 0 seconds remaining and it reported that the training was failed due to an unexpected error. The log data has been provided for failed trainings but credits being charged.

Also do help us with providing information on what is the error about so that we can understand and learn from it.

Timestamp Feature Credits Used
2025-08-21T19:52:00.000Z train 0.02144331
2025-08-21T19:50:00.000Z train 0.33287933
2025-08-21T19:40:00.000Z train 0.33828484
2025-08-21T19:30:00.000Z train 0.33270601
2025-08-21T19:20:00.000Z train 0.3382824
2025-08-21T19:10:00.000Z train 0.33263138
2025-08-21T19:00:00.000Z train 0.41812662
2025-08-21T18:47:00.000Z train 0.33808409
2025-08-21T18:37:00.000Z train 0.33231747
2025-08-21T18:27:00.000Z train 0.33837101
2025-08-21T18:17:00.000Z train 0.33263372
2025-08-21T18:07:00.000Z train 0.33813837
2025-08-21T17:57:00.000Z train 0.33243268
2025-08-21T17:47:00.000Z train 0.33807804
2025-08-21T17:37:00.000Z train 0.332875
2025-08-21T17:27:00.000Z train 0.33821276
2025-08-21T17:17:00.000Z train 0.332351
2025-08-21T17:07:00.000Z train 0.33281457
2025-08-21T16:57:00.000Z train 0.33831691
2025-08-21T16:47:00.000Z train 0.33245936
2025-08-21T16:37:00.000Z train 0.33839163
2025-08-21T16:27:00.000Z train 0.33250785
2025-08-21T16:17:00.000Z train 0.33841128
2025-08-21T16:06:00.000Z train 0.33296027
2025-08-21T15:56:00.000Z train 0.33831661
2025-08-21T15:46:00.000Z train 0.33257125
2025-08-21T15:36:00.000Z train 0.33295783
2025-08-21T15:26:00.000Z train 0.40574787
2025-08-21T15:09:00.000Z image-generation 0.1299
2025-08-20T19:44:00.000Z train 0.02823106
2025-08-20T19:42:00.000Z train 0.33846937
2025-08-20T19:32:00.000Z train 0.33277102
2025-08-20T19:22:00.000Z train 0.33829633
2025-08-20T19:12:00.000Z train 0.33274581
2025-08-20T19:02:00.000Z train 0.33220939
2025-08-20T18:52:00.000Z train 0.59893244
2025-08-20T18:34:00.000Z train 0.3326472
2025-08-20T18:24:00.000Z train 0.33830062
2025-08-20T18:14:00.000Z train 0.33263885
2025-08-20T18:04:00.000Z train 0.3379469
2025-08-20T17:54:00.000Z train 0.33227143
2025-08-20T17:44:00.000Z train 0.33834649
2025-08-20T17:34:00.000Z train 0.33259423
2025-08-20T17:24:00.000Z train 0.33285348
2025-08-20T17:14:00.000Z train 0.33866276
2025-08-20T17:03:00.000Z train 0.33275929
2025-08-20T16:53:00.000Z train 0.33822463
2025-08-20T16:43:00.000Z train 0.33282766
2025-08-20T16:33:00.000Z train 0.33848935
2025-08-20T16:23:00.000Z train 0.3947034
2025-08-20T16:08:00.000Z image-generation 0.1099
2025-08-20T16:07:00.000Z image-generation 0.02
2025-08-20T15:49:00.000Z image-generation 0.1188
2025-08-20T15:49:00.000Z image-generation 0.0111
2025-08-20T15:41:00.000Z image-indexing 0.0023
2025-08-20T15:41:00.000Z image-indexing 0.0296
2025-08-20T15:40:00.000Z image-indexing 0.0201
2025-08-20T14:10:00.000Z train 0.02034614
2025-08-20T14:08:00.000Z train 0.33792056
2025-08-20T13:58:00.000Z train 0.33236177
2025-08-20T13:48:00.000Z train 0.33794397
2025-08-20T13:38:00.000Z train 0.3327884
2025-08-20T13:28:00.000Z train 0.33777189
2025-08-20T13:18:00.000Z train 0.53222402
2025-08-20T13:02:00.000Z train 0.33239404
2025-08-20T12:52:00.000Z train 0.33798182
2025-08-20T12:42:00.000Z train 0.3323669
2025-08-20T12:32:00.000Z train 0.33842683
2025-08-20T12:21:00.000Z train 0.33276656
2025-08-20T12:11:00.000Z train 0.33833136
2025-08-20T12:01:00.000Z train 0.33262832
2025-08-20T11:51:00.000Z train 0.33861412
2025-08-20T11:41:00.000Z train 0.33273181
2025-08-20T11:31:00.000Z train 0.33844689
2025-08-20T11:21:00.000Z train 0.3327603
2025-08-20T11:11:00.000Z train 0.33813726
2025-08-20T11:01:00.000Z train 0.36619943
2025-08-20T10:48:00.000Z image-generation 0.08645
2025-08-20T10:46:00.000Z image-indexing 0.0003
2025-08-20T10:45:00.000Z image-indexing 0.002
2025-08-20T10:45:00.000Z image-indexing 0.0381
2025-08-20T10:44:00.000Z image-indexing 0.0014
2025-08-20T10:44:00.000Z image-indexing 0.0541
2025-08-20T10:43:00.000Z image-indexing 0.0024
2025-08-20T10:43:00.000Z image-indexing 0.0505
2025-08-20T10:42:00.000Z image-indexing 0.0592

Hi @shaheedh!
These failed trainings were related to an issue that we have since fixed. Please kick off a new training job to confirm the fix on your end!

I confirmed that the credits from these failed training have been refunded to your workspace. The system may have a slight delay.

Thank you again for your patience, happy building!!

1 Like

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.