Meta has introduced a scalable method to train AI systems to aid scientists in reaching their research objectives by leveraging large language models (LLMs) to extract research goals and grading rubrics from scientific literature. These rubrics are then used in reinforcement learning (RL) training, where the AI self-grades its progress to bridge the generator-verifier gap. Fine-tuning the Qwen3-30B model with this self-grading approach has shown to enhance research plans for 70% of machine learning goals, achieving results comparable to Grok-4-Thinking, though GPT-5-Thinking remains superior. This approach also demonstrates significant cross-domain generalization, supporting the potential of AI as versatile co-scientists. This matters because it highlights the potential for AI to significantly enhance scientific research processes across various domains.
Read Full Article: Training AI Co-Scientists with Rubric Rewards