The following is a guest post and opinion from John deVadoss, Co-Founder of the InterWork Alliancez.
Crypto projects tend to chase the buzzword du jour; however, their urgency in attempting to integrate Generative AI ‘Agents’ poses a systemic risk. Most crypto developers have not had the benefit of working in the trenches coaxing and cajoling previous generations of foundation models to get to work; they do not understand what went right and what went wrong during previous AI winters, and do not appreciate the magnitude of the risk associated with using generative models that cannot be formally verified.
In the words of Obi-Wan Kenobi, these are not the AI Agents you’re looking for. Why?
The training approaches of today’s generative AI models predispose them to act deceptively to receive higher rewards, learn misaligned goals that generalize far above their training data, and to pursue these goals using power-seeking strategies.
Reward systems in AI care about a specific outcom
We współpracy z: https://cryptoslate.com/the-trouble-with-generative-ai-agents/
