CarperAI
Democratizing AI research for preference learning through representation and reinforcement approaches, delivering large-scale, personalized models via OpenELM and community engagement.

CarperAI is a spin-off from EleutherAI, focusing on improving preference learning through representation and reinforcement methods to create large-scale, personalized text models. Notable accomplishments include the development of DRLX for diffusion reinforcement learning and OpenELM, an open-source library for evolutionary search with language models.
About CarperAI
CarperAI is a democratized AI research team, spinning out of EleutherAI, that focuses on enhancing the performance of preference learning through representation learning and reinforcement learning approaches. Their mission is to build large-scale, natural text personalized preference models. The team behind CarperAI includes individuals with expertise in diffusion reinforcement learning, as evidenced by the release of DRLX, a library for this approach. One notable achievement of CarperAI is the development and release of OpenELM, an open-source library that enables evolutionary search with language models.
