Let’s make this tangible. I’m tracking notable use cases that I wanted to highlight.
AI technology is being developed to enhance wildfire detection, with projects like FireSat aiming to deploy a satellite constellation that can spot small fires globally and provide updates every 20 minutes. Other efforts include Pano AI’s camera stations that detect fires early from high vantage points. While these technologies promise to improve early detection, challenges include the need for long-term studies to assess their effectiveness and the financial burden of implementation, as significant funding is required to launch and maintain these systems.
MyChart, a patient healthcare portal, now uses A.I. to help doctors draft responses to patient messages, raising concerns about transparency and potential errors. While the tool aims to reduce physician burnout by streamlining communication, experts worry it may compromise the quality of medical advice and the doctor-patient relationship. Some health systems disclose A.I. involvement, while others do not, fearing it may undermine trust. The A.I. tool has shown mixed results in improving efficiency and carries risks of inaccuracies, prompting debate on the appropriateness of A.I. in direct patient communication.
The Australian Red Cross has implemented AI solutions, including an AI-powered transcription and translation system, an Auslan translation API for emergency videos, and an internal natural language processing bot named ‘Ted.’ These innovations have significantly reduced waiting times and administrative burdens, saving approximately 1.3 million hours for employees. The organization has also completed a foundational digital transformation, consolidating its infrastructure into six core systems to enhance data management and governance in preparation for AI integration.
Victoria, Australia’s Department of Families, Fairness and Housing has been directed to ban generative AI tools after a case worker used ChatGPT to draft a child protection report, which contained inaccurate personal information and violated privacy rules. An investigation revealed that the report downplayed risks to a child and that the case worker had entered sensitive information into ChatGPT. OVIC found indicators of ChatGPT use in 100 other cases and noted that nearly 900 employees accessed the tool. The department must implement a ban and technical controls by November 5.
It’s not all good. Hackers are increasingly using generative AI to create malware, as evidenced by a recent email campaign targeting French users that delivered AsyncRAT malware. Researchers found that lower-skilled cybercriminals leverage AI to develop malware and customize it for specific targets quickly. Indicators of AI-generated malicious code include structured scripts with detailed comments and the use of native language for function names. The report highlights that generative AI enables faster malware creation, even if not fully functional, enhancing the capabilities of less technical attackers.
Why do we care?
These case studies not only highlight AI’s transformative potential but also its vulnerabilities and the urgent need for comprehensive, responsible management of this technology. The role of IT service providers is expanding beyond implementation to encompass education, governance, and security, positioning them as vital partners in navigating the AI-driven future.
The need for clear policies and training grows as AI tools become ubiquitous. Service providers should offer AI governance consulting to help businesses navigate compliance, ethical considerations, and risk management.