I want to fine-tune the ChatGPT model for generating user guides according to UI mockups. The scenario is as follows:

1. GPT should take in an UI mockup with the question “Write a guide on how to use this mockup”
2. Afterwards, it should generate a detailed user guide (f.e., 1. Click the Open button. 2. Enter your name in the Name field etc.)

As far as I understand, first of all, for this I have to to convert the UI mockups into any text format. Tell me, please, how can I do this? What would you recommend?

Thank you in advance for any guidance!

The training dataset example is as follows:

{“messages”: [{“role”: “system”, “content”: “You are the user guide generator that makes user guides according to UI mockups”}, {“role”: “user”, “content”: “Generate a user guide for this UI mockup <here should be a mockup, but I have no idea how to insert it into my dataset>”}, {“role”: “assistant”, “content”: “<content>”}]}