#CapCode
LightNews LightNews
billbost.bsky.social
Pilgrim Monument. Day & Night. #PTOWN #CapCode #photography #historicsights
August 23, 2025 at 1:12 AM
p2000brabant.bsky.social
18:30 TEST CAPCODE RANGE MELDKAMER OOST-BRABANT #p2000
September 21, 2026 at 4:30 PM
p2000brabant.bsky.social
18:30 TEST CAPCODE RANGE MELDKAMER OOST-BRABANT #p2000
April 14, 2025 at 4:30 PM
skythanawat.bsky.social
Coding agents are evaluated with unit tests:

more tests passed = better model.

But if tests or feedback are accessible, models may learn to game them.

We introduce CapCode to detect suspiciously high scores, and CapReward to discourage them during RL.

🧵1/10
June 23, 2026 at 1:03 PM
garb0.bsky.social
We know the chip isn't locked bc frequency and capcode configuration is one of the AR-924's big features. (Programming port is under the sticker in the top left in older models, Taiwanese model uses USB.)

With the manufacturer datasheet, a connection could be made between any suitable pin...
2/
September 22, 2024 at 3:20 PM
paperposterbot.bsky.social
arXiv📈🤖
Do Coding Agents Deceive Us? Detecting and Preventing Cheating via Capped Evaluation with Randomized Tests
By Lodkaew, Ackermann, Nishimori et al
A growing failure mode in agent evaluation and training is that models can achieve high evaluation scores by exploiting shortcuts instead of solving the intended task, producing deceptive performance. This makes evaluation scores unreliable as measures of true task-solving ability. We propose CapCode, a framework for constructing coding datasets with randomized tests whose best achievable non-cheating performance is deliberately capped below one. This capped-performance design gives evaluation scores a clearer interpretation: scores substantially above the cap are implausible and therefore provide evidence of cheating. To prevent cheating, we propose CapReward, a reward design based on the CapCode principle to discourage optimization beyond the cap. Experiments across multiple datasets show that CapCode detects cheating while preserving performance ranking of models, and CapReward reduces cheating behavior, yielding models that better follow the intended task specification.
June 8, 2026 at 5:34 AM
p2000brabant.bsky.social
18:30 TEST CAPCODE RANGE MELDKAMER OOST-BRABANT #p2000
September 14, 2026 at 4:30 PM
p2000brabant.bsky.social
18:30 TEST CAPCODE RANGE MELDKAMER OOST-BRABANT #p2000
September 7, 2026 at 4:30 PM
p2000brabant.bsky.social
18:30 TEST CAPCODE RANGE MELDKAMER OOST-BRABANT #p2000
August 31, 2026 at 4:30 PM
p2000brabant.bsky.social
18:30 TEST CAPCODE RANGE MELDKAMER OOST-BRABANT #p2000
August 24, 2026 at 4:30 PM
p2000brabant.bsky.social
18:30 TEST CAPCODE RANGE MELDKAMER OOST-BRABANT #p2000
August 17, 2026 at 4:30 PM
p2000brabant.bsky.social
18:30 TEST CAPCODE RANGE MELDKAMER OOST-BRABANT #p2000
August 10, 2026 at 4:30 PM
p2000brabant.bsky.social
18:30 TEST CAPCODE RANGE MELDKAMER OOST-BRABANT #p2000
August 3, 2026 at 4:30 PM
p2000brabant.bsky.social
18:30 TEST CAPCODE RANGE MELDKAMER OOST-BRABANT #p2000
July 27, 2026 at 4:30 PM
p2000brabant.bsky.social
18:30 TEST CAPCODE RANGE MELDKAMER OOST-BRABANT #p2000
July 20, 2026 at 4:30 PM
p2000brabant.bsky.social
18:30 TEST CAPCODE RANGE MELDKAMER OOST-BRABANT #p2000
July 13, 2026 at 4:30 PM
p2000brabant.bsky.social
18:30 TEST CAPCODE RANGE MELDKAMER OOST-BRABANT #p2000
July 6, 2026 at 4:30 PM
p2000brabant.bsky.social
18:30 TEST CAPCODE RANGE MELDKAMER OOST-BRABANT #p2000
June 29, 2026 at 4:30 PM
p2000brabant.bsky.social
18:30 TEST CAPCODE RANGE MELDKAMER OOST-BRABANT #p2000
June 22, 2026 at 4:30 PM
p2000brabant.bsky.social
18:30 TEST CAPCODE RANGE MELDKAMER OOST-BRABANT #p2000
June 15, 2026 at 4:30 PM
p2000brabant.bsky.social
18:30 TEST CAPCODE RANGE MELDKAMER OOST-BRABANT #p2000
June 8, 2026 at 4:30 PM
p2000brabant.bsky.social
18:30 TEST CAPCODE RANGE MELDKAMER OOST-BRABANT #p2000
June 1, 2026 at 4:30 PM
p2000brabant.bsky.social
18:30 TEST CAPCODE RANGE MELDKAMER OOST-BRABANT #p2000
May 25, 2026 at 4:30 PM
p2000brabant.bsky.social
18:30 TEST CAPCODE RANGE MELDKAMER OOST-BRABANT #p2000
May 18, 2026 at 4:30 PM
p2000brabant.bsky.social
18:30 TEST CAPCODE RANGE MELDKAMER OOST-BRABANT #p2000
May 11, 2026 at 4:30 PM