Jan Leike: We had a sizable team of men and women study ChatGPT prompts and responses, and then say if one particular reaction was preferable to a different response. All this details then obtained merged into 1 schooling run. Substantially of it is identical form of factor as what we did with InstructGPT. You wish it to become beneficial, you desi