OpenAI to Train Models on Daybreak Blue Cybersecurity Session Data

OpenAI plans to begin using Daybreak Blue session data to train its models on November 29, according to an email sent to Trusted Access program members. The data had previously been excluded from training, even for users who had the 'improve the model for everyone' setting turned off. The change drew swift backlash, and OpenAI later promised a separate opt-out.

Policy change for Daybreak Blue sessions

OpenAI's email to Trusted Access members confirmed that Daybreak Blue session data will be used for model training starting November 29. Previously, this data was excluded from training, even when users had the 'improve the model for everyone' setting turned off. Interactions flagged during safety reviews can still be used for safety purposes.

Backlash and promised opt-out

Backlash to the change was swift. OpenAI followed up with a second email promising a separate opt-out for the affected data use.

Concerns over researcher data

The change has researchers worried about a repeat of the Buckmaster-Alpöge case. Mathematicians Tristan Buckmaster and Levent Alpöge uploaded Navier-Stokes equation drafts to OpenAI's Codex. OpenAI soon presented its own proof but denied using their inputs for training. The suspicion alone was enough to show researchers what could go wrong.

Sources: The Decoder