On July 30, the leading artificial intelligence company, Anthropic, announced its support for the UK AI Security Institute’s Alignment Project to “contribute computing resources to advance critical research.”
“As AI systems grow more capable, ensuring they behave predictably and in line with human values gets ever more vital,” the Anthropic team writes in a post on X.
Anthropic to Help the US Govt to Advance Human-Controlled AI
The US’s AI Security Institute has launched a major project to ensure powerful artificial intelligence systems act safely, efficiently, and predictably. To achieve this goal, the project called ‘The Alignment Project’ was launched by the government in July.
Amid the exponential growth in AI development, the risk of systems functioning unpredictably increases, potentially causing harm to users if not properly aligned with human values or their real purpose.
The project will focus on preventing AI from behaving in harmful or unpredictable ways as the technology grows more advanced. The effort brings together top researchers and global partners, including the Canadian AI Safety Institute, Schmidt Sciences, Amazon Web Services, Halcyon Futures, SafeAI, and the UK Advanced Research and Innovation Agency, and now leading AI firms like Anthropic, to tackle one of the biggest challenges in AI development: keeping it under human control.
The project is guided by a high-profile advisory board featuring AI luminaries such as Yoshua Bengio and Shafi Goldwasser. It will fund critical research across three key areas:
- Grants of up to £1 million per project for scientists studying AI alignment
- £5 million in cloud computing credits for large-scale experiments
- Venture capital backing to fast-track real-world solutions
The Alignment Project will fill the gaps in AI safety research by improving transparency and developing better monitoring methods. It will ensure that humans remain in charge of AI decision-making.
“By fostering interdisciplinary collaboration, providing financial support and dedicated compute resources, we are tackling one of AI’s most urgent problems: developing AI systems that are beneficial, reliable and remain under human control at every step,” the official website states.
Not just at the domestic level, but at the global level, the Alignment Project emphasizes international cooperation as AI risks are a global concern.
Anthropic is in advanced discussions to raise between $3 billion and $5 billion in fresh funding, a deal that could value the company at a staggering $170 billion. The round, reportedly led by Silicon Valley investment capital firm Iconiq Capital, shows the relentless investor frenzy around elite AI firms as demand for cutting-edge AI continues to soar.
Also Read: Anthropic Targets $170B Valuation in New Funding Round
