# Finding GPT-4’s mistakes with GPT-4

Source: https://openai.com/index/finding-gpt4s-mistakes-with-gpt-4
Kiwi News: https://news.kiwistand.com/stories/Finding-GPT-4s-mistakes-with-GPT-4?index=0x66857619db77bf009e0a5b9261e37d530c79680a6a789c19ccbd5dfc4169777e375cb8a3
Submitted by macbudkowski.eth on 2024-07-03 UTC, 1 upvote, 0 comments

## Summary

OpenAI has trained CriticGPT, a model based on GPT-4, to catch errors in ChatGPT's code output, and people who get its help outperform unassisted reviewers 60% of the time. The company says it is beginning to integrate CriticGPT-like models into its RLHF labeling pipeline to give trainers explicit AI assistance. CriticGPT's suggestions are not always correct, but the article states that it helps trainers catch many more problems than they would alone, and that Human+CriticGPT critiques were preferred over unassisted critiques by a second trainer more than 60% of the time.