Prompt Checklist Cuts False Code Reversals in Gemini Tests, but On-Demand Betting Trails

Google-affiliated researcher Nghi D. Q. Bui’s prompt checklist cut false code reversals in Gemini benchmarks, while its On-Demand Betting mode had lower pooled pass and repair rates in mixed-feedback coding tasks. Bui submitted the preprint Oct. 25 at 8:35 p.m. ET (Oct. 26 at 00:35 UTC). It compares five Gemini models on eight public benchmarks spanning coding, report and calculation review, academic reasoning, financial analysis and command-line work. The method, called Thinking-in-Bets, has an agent record checkable claims, supporting evidence and its confidence before reading feedback.

Source: TokenPost