Person will ask a question of AI, and then rate the question they get back. Survey tool.
Asks demographic information, then asks the person to ask a specific question of the AI to solve a problem in their school or life.
First response will be straight AI response with no additional information given.
Second response will be AI response with specialized prompts, include their demographic information, and give more context about how they should respond.
Subjects will rate the two responses, and explain why they rated each response as they did.
This will be done in a web interface to make it easy to tell what is happening and to guide them appropriately through the process.
Their results will be anonymous, but they will enter an email to get a response back so they have a record of what their response is.
Somehow the survey tool needs to capture all the information in the same place, so it can stay organized.