July 2024 Edition No. 2 : AI in Court , Finance and Regulatory Challenges.

Welcome to our weekly newsletter, your trusted source for the latest updates and insights across the diverse sectors we practice. Each edition brings you the most relevant news, trends, and expert opinions to keep you informed about the evolving landscape in areas such as Environmental, Social, and Governance (ESG), AI ,Blockchain, Data, corporate law, technology, finance, healthcare, and more. Our goal is to provide valuable information and inspiration to support your journey toward excellence in your field. Whether you're a seasoned professional or new to these topics, thank you for joining us in our commitment to delivering comprehensive and impactful services.

This edition is packed with intriguing insights and critical updates from the AI landscape. From the use of AI in courtroom unfolding due to AI technologies to top researchers in India raising alarm bells about AI safety, we delve into the most pressing concerns and groundbreaking developments.

Discover the pioneering AI legislation aimed at protecting publishers, explore the heated debate on whether AI in law should be regulated or self-regulated, and learn about Meta’s ambitious yet paused plans to leverage European data for AI training. Additionally, we spotlight India's fast-tracked AI mission. This edition also features insightful pieces on companies bypassing web standards to scrape publisher sites, Indian CEOs emphasizing AI governance for innovation, and UPSC's plans to introduce facial recognition and AI surveillance to safeguard exam integrity.

Stay informed with these critical updates as we explore the intersection of AI with various industries, providing you with the insights needed to navigate and excel in these?dynamic?areas.

AI IN COURTROOM: OPENING A PANDORA'S BOX?

In a groundbreaking move, the Manipur High Court recently made headlines by turning to ChatGPT, an AI language model, for critical legal research. The case involved the reinstatement of a petitioner who had been unfairly dismissed without due process. Facing gaps in traditional legal documentation, the Honorable Judge sought insights from ChatGPT, which ultimately played a decisive role in advocating for the petitioner's rights and led to their reinstatement.

This development has sparked a vigorous debate within legal circles: Should AI tools like ChatGPT be utilized by lawyers for legal assistance? Proponents argue that AI can streamline research processes and enhance efficiency, while skeptics caution against overreliance and the potential pitfalls of AI-generated information. Earlier, in a trademark dispute in August 2023, the Delhi High Court voiced concerns over lawyers leaning on AI models like GPT to substantiate legal arguments, citing risks of inaccuracies and the creation of fictional legal narratives.

The implications are profound. As AI continues to gain prominence in courtrooms, particularly in countries like the UK where guidelines are stringent, India grapples with regulating its use. Without clear boundaries, there is a legitimate fear of misinformation influencing judicial decisions and the undue influence of AI in legal proceedings, raising crucial questions about the role of technology in dispensing justice.

AI Safety Concerns: Open Letter from Top Researchers Sounds Alarm for India!

A recent open letter penned by leading researchers has sent shockwaves through India's AI community, highlighting profound concerns about the risks posed by unregulated artificial intelligence. The letter paints a stark picture of potential disasters stemming from unchecked AI development, warning of exacerbated inequalities and even extreme scenarios of existential threats to humanity.

The core issue revolves around the prioritization of profit over oversight within AI companies. Critics argue that this focus on financial gain could impede effective regulatory frameworks, leaving AI systems operating without adequate transparency or accountability. The lack of clear guidelines means that governments struggle to understand how AI technologies function, further complicating efforts to ensure their safe and ethical use.

Moreover, the letter raises alarms about the silencing of dissent within AI firms through confidentiality agreements, potentially stifling crucial internal discussions on the risks associated with AI advancements.

For India, these revelations carry significant implications. As the country experiences a burgeoning AI sector, robust regulations are urgently needed to address these critical issues. Key concerns include preventing AI from being weaponized for misinformation campaigns, safeguarding against widening socio-economic disparities exacerbated by AI innovations, and implementing stringent data privacy laws to protect citizens' personal information in an era reliant on vast datasets.

Safeguarding News: Pioneering AI Legislation for Publisher Protection

India is on the brink of a transformative legislative breakthrough aimed at safeguarding digital rights in the age of AI. The government's pioneering AI law is set to redefine how publishers and content creators are protected in the digital landscape.

This landmark legislation seeks to establish a delicate equilibrium: preserving the integrity of intellectual property, fostering innovation in AI technologies, and ensuring equitable revenue distribution throughout the ecosystem, including for Large Language Models (LLMs) like ChatGPT.

The timing of this initiative is crucial amid global debates over fair compensation and copyright protection in AI-driven environments, exemplified by high-profile legal battles such as The New York Times' lawsuit against tech giants.

Experts commend these legislative efforts for their potential to guarantee fair compensation to creators and enforce transparent contracts with AI systems. Such measures are seen as laying the groundwork for a collaborative future where innovation and protection coexist harmoniously.

Internationally, India joins a broader dialogue shaped by initiatives like Europe's AI Act, renowned for its stringent regulations on high-risk AI systems and robust copyright compliance mandates. This global context underscores the complexity and significance of aligning AI development with ethical and legal frameworks.

Crucially, industry stakeholders have underscored their commitment to responsible AI practices through initiatives like the Tech Accord, emphasizing collaborative approaches to combat deceptive AI applications and ensure technology serves society responsibly.

AI in Law: To Regulate or Self-Regulate? The Debate Heats Up!

The 2024 Report on the UK Legal Market has sparked intense debate among legal professionals, with nearly half advocating for self-regulation of AI within the legal realm. This trend raises critical questions about the future of law and justice amidst rapid advancements in AI technology.

The report reveals that 48% of lawyers in firms and 50% of in-house lawyers support self-regulation of AI, citing concerns about accuracy, data security, compliance, privacy, and the potential impact on critical thinking and creativity. These concerns underscore the need for balanced approaches to harnessing AI's potential while ensuring ethical and regulatory safeguards.

The adoption of AI in tasks such as document review and legal research also brings challenges related to ethical use and regulatory compliance, prompting global reflections on responsible AI deployment. As India considers its approach to AI regulation in the legal sector, similar concerns resonate, requiring careful consideration of ethical AI use and robust regulatory frameworks to shape AI's role in the future of law.

India's AI Mission on the Fast Track!

Under the leadership of the Hon'ble Minister of Information and Broadcasting, India is gearing up for a significant leap in AI development, bolstered by new regulations and plans for domestic AI chip manufacturing. These initiatives are poised to elevate India's standing as a pivotal player in the global AI landscape.

Key initiatives include the expedited implementation of the Digital Personal Data Protection (DPDP) Law, crucial for safeguarding personal data in the digital era. Additionally, there's a strong focus on advancing India's Artificial Intelligence mission, potentially including the domestic production of AI chipsets (GPUs), a move aimed at reducing dependence on imports and aligning with global AI technology leaders.

The regulatory agenda extends to amendments to the IT Act, the Digital India Bill, and the formulation of guidelines for non-personal data and the online gaming industry. These efforts are anticipated to enhance India's global competitiveness in AI, drive economic growth through increased tech investment and job creation, and foster a thriving environment for cutting-edge AI research and development.

Meta's EU AI Plans Paused: Regulatory Challenges and Global Impact

Meta's ambitious plans to leverage vast amounts of user data for new AI features in Europe have hit a roadblock due to regulatory concerns. The company intended to train its large language model (LLM), Llama, using public posts, images, captions, and chatbot conversations from European users. However, the Irish Data Protection Commission (DPC) intervened, citing Meta's non-compliance with GDPR (General Data Protection Regulation) regarding transparency and consent in data processing.

This pause is viewed as a setback for European AI innovation and competition, with Meta now focused on addressing regulatory feedback from the EU and UK while reaffirming its commitment to eventually introduce AI features that align with European data protection standards.

The European Center for Digital Rights (Noyb) has actively challenged Meta's data practices across EU countries, highlighting discrepancies in consent and transparency compared to other tech giants like OpenAI and Google. Meta's stance on "legitimate interests" for data processing did not align with GDPR's stringent requirements, underscoring the need for greater transparency and user control in AI development.

In India, where data privacy regulations are evolving, the Meta incident underscores the importance of robust data protection laws. As India shapes its AI strategy, lessons from the EU's regulatory framework can guide efforts to balance technological innovation with safeguarding user privacy and upholding ethical standards.

Pune Real Estate Firm Duped Out of ?4 Crore in Sophisticated Cyber Scam

A Pune-based real estate firm recently fell victim to a sophisticated cyber scam, losing ?4 crore to cybercriminals who impersonated its chairman. This incident underscores the rising threat of whaling attacks, where scammers adeptly target high-level executives using advanced social engineering tactics. Such scams involve meticulous planning and the exploitation of trust, often leading unsuspecting victims to transfer large sums of money under false pretenses.

In India, phishing attacks are evolving with the integration of AI, enabling fraudsters to craft highly convincing emails and messages that appear legitimate. These AI-driven scams are a wake-up call for the urgent implementation of stricter regulations and enhanced cybersecurity measures nationwide. Without robust safeguards, businesses remain vulnerable to financial fraud and the compromise of sensitive data, jeopardizing not only their operational stability but also their reputation and customer trust.

The repercussions of cyber scams are profound: beyond financial losses that can destabilize businesses, there's an increased risk of data breaches that expose sensitive information to malicious actors. This not only impacts the affected organizations but also undermines consumer confidence and can lead to broader economic consequences. To mitigate these risks, India must strengthen its cybersecurity framework with proactive security protocols, comprehensive employee training in cybersecurity awareness, and stringent regulations that mandate swift incident reporting and response protocols to law enforcement agencies.

In essence, the Pune real estate firm's ordeal serves as a stark reminder of the critical need for robust cybersecurity measures and regulatory frameworks in India.

EU Worries About AI in Finance!

On June 18, the European Commission released a consultation highlighting concerns about the impact of artificial intelligence (AI) on banking, insurance, and securities markets. This follows the recent passage of the groundbreaking AI Act, which made the EU the first jurisdiction globally to legislate AI for safety and non-discrimination.

The consultation warns that overreliance on AI in finance could lead to significant issues, including bias, market panic, and poor financial advice. AI systems might unintentionally perpetuate discrimination, affecting credit scores and insurance rates, or provide incorrect advice that could destabilize markets. Additionally, AI "hallucinations" or nonsensical responses could lead to poor financial decisions.

The new EU AI Act aims to provide a robust framework for technological innovation, ensuring AI tools are both safe and fair. However, officials are now questioning if more specific guidance is needed for the financial sector, where the cost of errors can be exceptionally high. Sensitive applications, such as credit checks, may require additional laws to prevent bias and inaccuracies. The EU is calling for public feedback on this rapidly evolving area, emphasizing the need for transparency, accountability, and the prevention of AI misuse in finance. The AI Act, set to take effect in May 2025, seeks to foster innovation while safeguarding against the potential harms of AI, ensuring that financial AI tools remain both innovative and safe.

Companies Bypassing Web Standards to Scrape Publisher Sites

AI companies are increasingly circumventing web standards to scrape content from publisher sites, raising significant ethical and legal concerns. Key highlights reveal that these companies are ignoring the "robots.txt" standard, a critical web protocol that signals "do not crawl" to prevent unauthorized data extraction. Content licensing startup, TollBit, reports that numerous AI agents are disregarding these signals, posing a threat to the publishing industry. In one notable case, Forbes has accused AI startup Perplexity of plagiarizing its investigative stories by generating AI summaries without permission, spotlighting the growing tension between AI innovators and content creators.

The News Media Alliance has voiced concerns about the implications of ignoring "do not crawl" signals, emphasizing that such practices undermine the monetization of valuable content and jeopardize the livelihoods of journalists. TollBit is actively working to mediate this conflict by helping publishers and AI companies negotiate licensing deals, ensuring that content creators are compensated fairly. By tracking AI traffic and using analytics, TollBit can determine appropriate fees for different types of content, promoting a more equitable distribution of digital resources.

Strong regulations are essential in this context to protect content creators, enforce compliance, and promote ethical AI use. Effective AI regulation can ensure that publishers receive fair compensation, uphold intellectual property rights, and maintain the integrity and sustainability of the journalism industry. As AI continues to evolve, establishing robust frameworks to govern its use in content generation and distribution becomes increasingly critical.

Indian CEOs Emphasize AI Governance for Adoption and Innovation : Insights from IBM Study

A recent study by the IBM Institute for Business Value and Oxford Economics highlights the crucial role of AI governance for Indian business leaders. According to the study, 70% of Indian CEOs believe that trusted AI is only possible with effective AI governance. Additionally, 49% of these leaders are hiring for generative AI roles that did not exist last year, underscoring the rapid evolution of the AI job market. However, they face significant challenges, including workforce adaptation, cultural transformation, and the establishment of robust governance structures.

Regulatory constraints also pose a major barrier to AI innovation, with 48% of Indian CEOs identifying them as the top obstacle. The need for workforce transformation is evident, as 34% of the workforce will require retraining and reskilling over the next three years. The study emphasizes the urgent necessity for strong AI governance to ensure responsible and effective AI adoption in India. As AI technologies advance, regulations will play a pivotal role in shaping the industry landscape, helping businesses navigate the complexities of AI integration while balancing innovation with compliance.

For Indian businesses, regulatory frameworks provide the structure necessary for ethical AI development and deployment, safeguarding against biases and ensuring transparency. Robust regulations are essential for AI to flourish in a way that is both safe and beneficial, giving Indian companies a competitive edge in the global market. As they continue to integrate AI, Indian companies must prioritize governance to ensure they can capitalize on AI innovations responsibly and effectively.

UPSC To Introduce Facial Recognition & AI Surveillance to Safeguard Exam Integrity

Exciting developments are underway in exam security as the Union Public Service Commission (UPSC) plans to implement advanced facial recognition and AI-based CCTV surveillance systems to ensure the fair conduct of exams. This initiative addresses growing concerns over malpractices in national tests. Key highlights include the use of Aadhaar-based authentication, incorporating both fingerprint and facial recognition to verify candidate identities, and AI-driven monitoring systems that provide real-time surveillance, eliminating blind spots in exam halls.

The large-scale implementation will cover around 80 exam centers, impacting approximately 2.6 million candidates annually. These AI systems will generate real-time alerts for any suspicious activities or anomalies, ensuring prompt action and maintaining the integrity of the examination process. By providing transparent and unbiased monitoring free from human error, AI is revolutionizing exam security. Advanced verification techniques will prevent impersonation and fraud, ensuring that only legitimate candidates are allowed to participate.

To harness the benefits of AI while avoiding potential pitfalls, robust regulations must be implemented. Ensuring secure and ethical use of biometric data, regularly updating AI algorithms to prevent biases, and providing clear guidelines on AI system usage are crucial steps. Balancing AI surveillance with human invigilators will also help handle complex situations effectively. By adopting these measures, the UPSC aims to enhance exam security and uphold the integrity of national examinations, setting a new standard in the education sector.

Closing Insights : Key AI Developments

In this edition, we've explored significant AI trends and updates across various sectors. Our aim is to keep you informed about the evolving landscape of AI and technology around the globe. Stay tuned for our next edition, where we continue to spotlight the critical developments shaping the future of law. Thank you for staying engaged and committed to making a positive?impact.

Disclaimer

The information provided in this newsletter is for general informational purposes only and is not intended to be a substitute for professional advice, whether legal, financial, or otherwise. While we strive to ensure the accuracy and reliability of the information presented, we make no representations or warranties of any kind, express or implied, about the completeness, accuracy, reliability, suitability, or availability with respect to the newsletter or the information contained therein. Any reliance you place on such information is therefore strictly at your own risk.

In no event will With Law be liable for any loss or damage including without limitation, indirect or consequential loss or damage, or any loss or damage whatsoever arising from the use of this newsletter. The inclusion of any links or references does not necessarily imply a recommendation or endorsement of the views expressed within them.

We encourage you to consult with appropriate professionals before making any decisions based on the information provided in this newsletter. Your use of the information contained herein is at your own risk, and we assume no responsibility or liability for any errors or omissions in the content of this newsletter.