100% Secure Payments
Tender Details
- Country: Belgium
- Summary: Agentic Evaluation Interface
- KWT Ref No: 118312330
- Deadline: 12 Jun 2025
- Competition: ICB
- Financier: European Commission
- Purchaser Ownership: Public
- Tender Value: 1080000
- Notice Type: Tender
- Document Ref. No.: 272332-2025
- Purchaser's Detail :
- Description :
- The objective of this lot is to supply the AI Office with a programmatic interface for the evaluation of General-Purpose Artificial Intelligence (GPAI) models through agentic interaction patterns, i.e. the evaluation of GPAI models for use in tasks requiring multiple decisions and interaction with digital environments such as a browser, command line, or a full operating system. The interface is taken to mean software, methodology, configuration, cloud orchestration and other digital technical components that would allow the AI Office to execute evaluations of GPAI model and their agentic capabilities, without further dependency on the contractor, supplementing and working in tandem with AI Office digital infrastructure. The AI Office is seeking such an interface in the form of a GPAI model evaluation workflow or ‘harness-, and the necessary components thereof, that allow the AI Office and its technical experts to rapidly integrate into the evaluation pipeline new GPAI models and benchmarks across all digital modalities (text, image, video, audio) and from the full spectrum of digital tasks. This harness should provide support for relevant and state of the art elicitation methods and agent scaffolding, including fallback mechanisms that connect text only models to multi-modal benchmarks. It is expected that a significant part of the service will be dedicated to supporting the AI Office in the deployment on Commission infrastructure of existing or developed components of the e...
- Documents :
Purchaser : EUROPEAN COMMISSION, DG CNECT - COMMUNICATIONS NETWORKS, CONTENT AND TECHNOLOGY
Address: CNECT.A.3 - Artificial Intelligence Safety
Town: Brussels
NUTS-Code: BE100
Postal Code: B-1049
Phone: +32 2 299 11 11
Email :cnect-procurement@ec.europa.eu
URL :https://ec.europa.eu/info/departments/communications-networks-content-and-technology_en
If you are registered member, kindly login to view full details of this tender notice:
CLICK HERE TO LOGIN
