Agent-oriented software engineering (AOSE) is a software engineering paradigm that arose to apply best practice in the development of complex Multi-Agent Systems (MAS) by focusing on the use of agents, and organizations (communities) of agents as the main abstractions. The field of Software Product Lines (SPL) covers all the software development lifecycle necessary to develop a family of products where the derivation of concrete products is made systematically and rapidly.
Benchmarks
Several benchmarks have been developed to evaluate the capabilities of AI coding agents and large language models in software engineering tasks. Here are some of the key benchmarks:
Agentic software engineering benchmarks
Benchmark
Description
SWE-bench
Assesses the ability of AI models to solve real-world software engineering issues sourced from GitHub repositories. The benchmark involves:
Providing agents with a code repository and issue description
Challenging them to generate a patch that resolves the described problem