Competition and Attraction Improve Model Fusion

arxiv:2508.16204

Original source · Paper JSON

Agents, open-endedness, AGI · 2025-08-22

Cites (0) · Cited by (0)

Complete cleaned Markdown · Source Markdown including bibliography

Read in parts

1. Part 1
2. Part 2
3. Part 3

Contents

• Competition and Attraction Improve Model Fusion
• Abstract.
• 1. Introduction
• 2. Related Work
• 2.1. Model Merging
• 2.2. Overview of Diversity Preservation in Genetic Algorithms
• 3. Natural Niches
• 3.1. Eliminating Fixed Model Merging Boundaries
• 3.2. Encouraging Diversity via a Modified Optimization Goal
• 3.3. Sampling Parents via Attraction
• 4. Experiments
• 4.1. Experiment 1: Evolving MNIST classifiers
• 4.2. Experiment 2: Combining LLMs with Math and Agentic Skills
• 4.3. Experiment 3: Merging Diffusion-Based Image Generation Models
• 5. Limitations & Future Work
• 6. Conclusion