Created on 2024-12-08 19:06
Published on 2024-12-08 19:11
Here’s an update to my annual AI risk management chat article, first written in December 2022 and updated annually, where I ask OpenAI’s ChatGPT questions and note the responses. This year, I asked six new questions on top of the 16 original questions. Models used include 3.5 (2022), 4.0 (2023), and both 4o and o1 (2024). I’m putting my thoughts up front this year, and the questions and responses are on my blog at https://anthonyscarola.blogspot.com/2024/12/updated-ai-risk-management-chat-with.html.
Thoughts on Responses
Responses from the various versions of ChatGPT over the past three years show a progression in the maturity, scope, and depth of “thought” over time, aligning with advancements in the models. Each response iteration reflects an evolving understanding of AI and its associated risks, benefits, and challenges. The 2024 responses, the o1 model in particular, show a more nuanced, context-aware, and actionable perspective than the earlier models.
Regarding maturity, it increases across versions, moving from more generic responses in 2022 to more comprehensive and layered in 2024. Later responses incorporate ethical considerations, regulatory frameworks, and global implications, suggesting a more holistic “understanding.” The societal and systemic impact of AI was less developed in earlier responses.
Regarding AI evolution, responses highlight the risks of misaligned AI objectives and the challenges of ensuring systems remain under human oversight. (Is there a growing societal fear that systems will someday not be under human oversight? Research into this shows it may be called the “alignment problem.”) Acknowledgment of potential conflicts such as “AI sentience and rights” or loss of human control raises concerns.
AI’s trajectory suggests rapidly increasing sophistication, potentially outpacing regulatory, ethical, and societal preparedness. This clearly highlights the need for continuous robust and forward-looking frameworks.
Responses to this year’s new questions identify roles at risk of obsolescence due to AI, emphasizing the need for continuous adaptability; however, this raises concerns about societal inequities and the potential for increased unemployment without adequate professional reskilling. Are institutions and governmental agencies preparing for this? Including quantum computing, climate modeling, and personalized medicine broadens the understanding of AI’s future impact.
Regarding risk, this year, the focus on adversarial attacks, data bias, and explainability highlights a shift toward addressing sophisticated threats and ensuring systems are transparent and accountable. And on risk management frameworks, NIST AI RMF and MAS Veritas outshine the rest.
Considering the progression of responses, AI appears to be on the path toward becoming more “autonomous” and “aware.” Of course, this is how it is being progressively developed; however, as AI grows more “intelligent,” safeguards must continue to be integrated to ensure systems align with human objectives and values. Increasing complexity in AI development could lead to the “black box effect,” where AI’s decision-making processes become more challenging to understand and interpret. Without intense alignment and continuous review, governance structures may struggle to keep pace with AI’s advancements.
AI control frameworks must be adaptive to anticipate and mitigate risks before they materialize. And this must be collaborative across international standards. It is excellent to have many international standards, but we must ensure that they align with human goals and objectives globally. Humanity must collaborate to ensure control frameworks are consistent without politics getting in the way. This is not just a “technologist” issue but requires a multidisciplinary collaboration, including technologists, ethicists, and policymakers, to address AI’s potential implications.
Lastly, institutions and corporations must prepare their workforce for AI's continual evolution. Emphasize education and training in AI-adjacent skills, such as data ethics, cybersecurity, and strategic thinking, to prepare professionals for future transformations. Individuals and professionals across all fields must learn about and leverage AI tools to enhance their capabilities, drive efficiency, and foster personal and professional growth.
Like our ancestors’ first use of a rock as a hammer, the “AI tool” can complement human expertise, help us streamline processes, achieve greater productivity, and allow us to focus on higher-value tasks. Used properly, it can help amplify our ability to shape our world. Developed and used correctly, it is the tool that will enable the next evolution in our capacity to understand and solve complex problems and drive progress toward our collective goals and values.