# How to upload multimodal (vision language) dataset

**URL:** <https://discuss.roboflow.com/t/how-to-upload-multimodal-vision-language-dataset/8491>\
**Category:** 🤝  Community Help\
**Tags:** formats\
**Created:** [February 3, 2025, 7:57pm UTC](https://discuss.roboflow.com/t/how-to-upload-multimodal-vision-language-dataset/8491 "2025-02-03T19:57:08Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Samuel\_Lima\_Braz](https://yyz1.discourse-cdn.com/flex029/user_avatar/discuss.roboflow.com/samuel_lima_braz/32/5920_2.png) [@Samuel\_Lima\_Braz](https://discuss.roboflow.com/u/Samuel_Lima_Braz)\
**Post date:** [February 3, 2025, 7:57pm UTC](https://discuss.roboflow.com/t/how-to-upload-multimodal-vision-language-dataset/8491/1 "2025-02-03T19:57:08Z")

</div>

I have a dataset of invoices with images and data extraction in JSON format. Like an OCR. I created a folder where there is a subfolder with all the images in JPG and a file annotaitons.jsonl, where each line contains:

```json
{
'image': "path/to/image.jpg",
'prefix': "",
'suffix': "extracted data"
}

```

I’m trying to upload this to Roboflow, but it’s not interpreting the annotations. Either I just keep the images and go to manual annotation, or it gets stuck on this screen

 ![Captura de tela 2025-02-03 165145](https://canada1.discourse-cdn.com/flex029/uploads/roboflow1/original/2X/a/a74b6a079c9fd877d5e0c33f5897a63c394c9406.png)

Should I upload these files somewhere and exchange the ‘image’ key with the urls? Should I use another format?

---

<div class="post-metadata">

**Author:** ![leandro\_roboflow](https://yyz1.discourse-cdn.com/flex029/user_avatar/discuss.roboflow.com/leandro_roboflow/32/5599_2.png) [@leandro\_roboflow](https://discuss.roboflow.com/u/leandro_roboflow)\
**Post date:** [February 3, 2025, 9:09pm UTC](https://discuss.roboflow.com/t/how-to-upload-multimodal-vision-language-dataset/8491/2 "2025-02-03T21:09:40Z")

</div>

Hello @Samuel_Lima_Braz, welcome to the forum, and thank you very much for contacting us.

I would like to ask two things so that we can validate this. Could you please provide the workspace and the project so that we can get more details?

But looking at your JSON format, it seems that the problem is there. You used single quotes instead of double quotes, which is invalid JSON. If that is the case, we can easily solve the problem.

But if it still doesn’t work, please contact me again and I will be happy to help you.

Best regards,  
Leandro Rosemberg

---

<div class="post-metadata">

**Author:** ![Samuel\_Lima\_Braz](https://yyz1.discourse-cdn.com/flex029/user_avatar/discuss.roboflow.com/samuel_lima_braz/32/5920_2.png) [@Samuel\_Lima\_Braz](https://discuss.roboflow.com/u/Samuel_Lima_Braz)\
**Post date:** [February 3, 2025, 9:25pm UTC](https://discuss.roboflow.com/t/how-to-upload-multimodal-vision-language-dataset/8491/3 "2025-02-03T21:25:16Z")

</div>

Now I was able to upload using the CLI. Actually, I was using double quotes, but I mistyped them in the question.

The format I used was:

```json
{
  "image": "20210322_172436.jpg",
  "prefix": "<JSON>",
  "suffix": "{\"company\": \"intermarche\", \"date\": \"2019/06/20\", \"address\": \"armação de pera\", \"total\": \"24.99\", \"invoice_number\": \"0EAA061219/134\", \"buyer_nif\": \"514407395\", \"vat_value\": \"4.67\", \"seller_nif\": \"508162294\"}"
}

```

However, it didn’t work through the interface—or at least there was no indication that any upload was happening. With 814 files, using the CLI command `roboflow import -w tech-ysdkk -p brazilian-documents data/invoices/` worked perfectly.

---

<div class="post-metadata">

**Author:** ![system](https://canada1.discourse-cdn.com/flex029/uploads/roboflow1/original/1X/bb6edbfa56d0cf2ee603f061e9e09103502cc8cc.png) [@system](https://discuss.roboflow.com/u/system)\
**Post date:** [February 10, 2025, 9:25pm UTC](https://discuss.roboflow.com/t/how-to-upload-multimodal-vision-language-dataset/8491/4 "2025-02-10T21:25:43Z")

</div>

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.