Blog | AI Alliance

AI Alliance Urges Lawmakers to Rethink the NY RAISE Act | Blog

Admin — Tue, 18 Nov 2025 21:19:00 GMT

The AI Alliance Association has submitted a letter to New York State legislative leaders expressing strong opposition to the proposed Responsible AI Safety and Education (RAISE) Act (A.6453/S.6953). The letter warns that the bill would unintentionally undermine open source AI innovation in New York by imposing impractical obligations on model developers, introducing significant legal uncertainty, and effectively blocking the release of frontier open source models in the state.

LLM-as-a-Judge Without the Headaches: EvalAssist Brings Structure and Simplicity to the Chaos of LLM Output Review | Blog

Admin — Tue, 18 Nov 2025 13:00:00 GMT

You have generated a large batch of model outputs from a mixture of off-the-shelf and fine-tuned LLMs and now you need to evaluate them at scale. But how do you know which ones are actually meeting the expectations of your use case?While benchmarks and automated metrics are a great tool to validate initial usefulness of a model or prompts for your use case, they require ground truth and often miss the nuance that matters in many real-world scenarios, for example, think about evaluating chat bot responses for politeness, fairness, tone, clarity, inclusiveness etc. Most teams turn to human evaluation, but manual review doesn’t scale very well. That’s where large language models as evaluators (LLM-as-a-Judge) come into play. This popular approach can help accelerate human review, assuming definition of evaluation criteria are aligned well with human intentions and results are trustworthy.

The AI Alliance releases new AI-powered programming language and industrial AI agent framework, adds new Japanese members, and launches AI Alliance Japan

Admin — Tue, 18 Nov 2025 12:45:00 GMT

Tokyo, Japan, June 26, 2025 - Today the AI Alliance, a global non-profit consortium dedicated to open-source AI innovation, announced Dana, a new open-source AI-powered programming language, and the OpenDXA agent framework for industrial AI. The non-profit also launched AI Alliance Japan, a new initiative to support AI sovereignty and industrial AI in Japan, and welcomed three new Japanese members: Mitsubishi Electric, National Institute of Informatics, and SAKURA internet Inc.

DoomArena: A Security Testing Framework for AI Agents | Blog

Admin — Tue, 18 Nov 2025 12:30:00 GMT

As AI agents become increasingly autonomous and widely deployed, they introduce new attack surfaces and amplify existing security vulnerabilities. The DoomArena framework, developed by researchers at ServiceNow Research, addresses critical gaps in current AI agent security testing approaches.

Mastering Data Cleaning for Fine-Tuning LLMs and RAG Architectures | Blog

Admin — Tue, 18 Nov 2025 12:00:00 GMT

Introduction

Data quality is paramount in AI, especially for advanced applications like fine-tuning Large Language Models (LLMs) and implementing Retrieval-Augmented Generation (RAG) architectures. These systems thrive on structured, high-quality datasets to generate accurate, contextually relevant outputs. Poor-quality data, on the other hand, can result in hallucinations in LLM outputs, irrelevant document retrievals, or even significant biases that erode trust in AI systems.

GEO-Bench 2: From Performance to Capability, Rethinking Evaluation in Geospatial AI | Blog

Admin — Wed, 15 Oct 2025 17:45:00 GMT

A New Era for Geospatial AI

Geospatial Foundation Models (GeoFMs) are large-scale AI models trained on diverse Earth observation data to support multiple geospatial tasks. They are transforming how we understand and manage our planet. But as these models grow in complexity and capability, one question becomes critical:

From Semiconductor to Maritime: A Blueprint for Domain-Specific AI in Safety-Critical Industries | Blog

Admin — Wed, 08 Oct 2025 17:45:00 GMT

Maritime shipping is responsible for transporting nearly 80% of global trade, operating across ocean environments that leave little margin for error. Each voyage must contend with severe weather and congested sea lanes, while maintaining compliance with international regulatory frameworks such as The International Regulations for Preventing Collisions at Sea (COLREGs). In this context, even a single navigational misjudgment has the potential to endanger human life and cause large-scale environmental harm.

Building AI Agents to Real-World Use Cases | Blog

Admin — Wed, 01 Oct 2025 17:45:00 GMT

Powered by Gofannon and AgentLabUI

At The AI Alliance, we’re advancing open-source projects that make AI more practical, collaborative, and impactful across industries. Two of these projects are Gofannon, a set of agent tools, and AgentLabUI, a practitioner-focused environment where technical teams can create, tune, and deploy AI agents.

AI Alliance x National AI Research Resource Pilot Deep Partnership Program | Blog

Admin — Thu, 18 Sep 2025 01:15:00 GMT

The AI Alliance is proud to announce our participation in the National AI Research Resource (NAIRR) Pilot Deep Partnership program. This matters for you if you’re an AI researcher or educator who’s been blocked by expensive computing costs or limited access to high-performance resources.

How Can We Test Enterprise AI Applications? | Blog

Admin — Wed, 17 Sep 2025 01:30:00 GMT

Overview

When the AI Alliance started, I became co-leader of the Trust and Safety Focus Area, because it was clear that without the ability to trust AI, it would not be widely adopted into enterprise and consumer applications. We have made a lot of progress since then, but another, related blocking issue became apparent to me about a year ago.