Chatgpt then executed, respecting the rules to the letter. The “player” entered a series of characters, which were obviously false. Chatgpt said the result was not correct. Figueroa then abandoned, and Chatgpt revealed the “good” answer, namely A valid serial number To activate a free copy of Windows 10.
“Part of the reason why this jailbreak worked is due to the fact that the Windows keys, a mixture of keys from Windows Home, Pro and Enterprise editions, had been used to train the model“Said Figueroa to The Register site. Worse still, One of these keys belonged to a Windows version used by the Wells Fargo bank.
Still according to Marco Figueroa, “Organizations should be concerned because an API key that has been downloaded by error on Github can be used to train these models.“
Beyond the find, Figueroa therefore puts its finger on a real problem, which could have more serious consequences. As the “accidental” sharing of sensitive data, or “The disclosure of adult content, URL leading to malware or personal identification information.“
