I see this error every time i try to train model:
This training job did not complete successfully. This can happen for a few reasons but often means that the chosen model dimension (which corresponds to image size) was too large to fit into GPU memory.
Please try again with a new version and different export settings. If the error persists, [reach out](https://roboflow.com/contact) and we will be happy to help debug.
Last time i resized images to 412x412 size but it still give me this error. I tried to train on your Google Colab Qwen 2.5 VL but i see this error on A100:
OutOfMemoryError: CUDA out of memory. Tried to allocate 274.00 MiB. GPU 0 has a total capacity of 39.56 GiB of which 122.88 MiB is free. Process 6161 has 39.43 GiB memory in use. Of the allocated memory 38.36 GiB is allocated by PyTorch, and 585.10 MiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True to avoid fragmentation. See documentation for Memory Management
Help me please