Forum Discussion

Intii's avatar
Intii
Copper Contributor
Aug 25, 2025

Do you have experience fine tuning GPS OSS models?

Hi I found this space called Affine. It is a daily reinforcement learning competition and I'm participating in it. One thing that I am looking for collaboration on is with fine tuning GPT OSS models to score well on the evaluations. 

I am wondering if anyone here is interested in mining? I feel that people here would have some good reinforcement learning tricks. 

These models are evaluated on a set of RL-environments with validators looking for the model which dominates the Pareto frontier. I'm specifically looking to see any improvements in the coding deduction environment and the new ELR environment they made. I would like to use a GPT OSS model here but its hard to fine-tune these models in GRPO.

Here is the information I found on Affine:

https://www.reddit.com/r/reinforcementlearning/comments/1mnq6i0/comment/n86sjrk/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button

No RepliesBe the first to reply

Resources