The AutoScientist
Community Leaderboard

Per domain, we rank the best AutoScientist runs the community has submitted so far. Open to everyone.

submitted runs

domains covered

data artifacts processed

Leaderboard

Domains

Selected domain

All Domains317

United States

Model

adaption_nvidia_nemotron_3_su_bangla_news_completion_8d1483d6

Dataset size

15413.5K

Dataset

bangla_news_completion

Alignment

Yes

Domain Win Rate

86.2%

Task Win Rate

83.2%

Normalised Score

+1.95

Percentile

100th

Austria

Model

adaption_nvidia_nemotron_3_su_math_code_step_reasoning_b85ada1a

Dataset size

4.5K27.9K

Dataset

math_code_step_reasoning

Alignment

Domain Win Rate

86.1%

Task Win Rate

81.6%

Normalised Score

+1.94

Percentile

100th

Brazil

Model

adaption_llama_3_3_70b_instru_formal_reasoning_step_ve_b19400c2

Kaggle

Dataset size

20K20.1K

Dataset

formal_reasoning_step_verification

HuggingFace Kaggle

Alignment

Domain Win Rate

77%

Task Win Rate

16.8%

Normalised Score

+1.73

Percentile

99th

India

Model

adaption_llama_3_3_70b_instru_embedded_systems_qa_eff2c40e

HuggingFace Kaggle

Dataset size

65127.9K

Dataset

embedded_systems_qa

Alignment

Domain Win Rate

75.5%

Task Win Rate

85.4%

Normalised Score

+1.73

Percentile

99th

Kenya

Model

adaption_nvidia_nemotron_3_su_harvest_drying_condition_7e4d0392

Dataset size

4.5K23.9K

Dataset

harvest_drying_conditions

Alignment

Domain Win Rate

86.1%

Task Win Rate

80.1%

Normalised Score

+1.71

Percentile

99th

India

Model

adaption_llama_4_scout_17b_16_studenthub_project_specs_6961e853

Dataset size

122K

Dataset

studenthub_project_specs

Kaggle

Alignment

Domain Win Rate

74.5%

Task Win Rate

63.9%

Normalised Score

+1.60

Percentile

98th

India

Model

adaption_mixtral_8x7b_instruc_india_sector_sentiment_4703ce02

Dataset size

44328.2K

Dataset

india_sector_sentiment

Alignment

Domain Win Rate

77.3%

Task Win Rate

90.9%

Normalised Score

+1.60

Percentile

98th

Canada

Model

adaption_llama_3_3_70b_instru_equity_analysis_small_22ed78c2

HuggingFace

Dataset size

58927.8K

Dataset

equity-analysis-SMALL

HuggingFace

Alignment

Domain Win Rate

77%

Task Win Rate

83.9%

Normalised Score

+1.53

Percentile

98th

Brazil

Model

adaption_llama_3_3_70b_instru_parteira_br_maternal_gui_80fa5adc

Dataset size

1.2K24.3K

Dataset

parteira_br_maternal_guidance

HuggingFace

Alignment

Domain Win Rate

79.5%

Task Win Rate

56.8%

Normalised Score

+1.53

Percentile

97th

United States

Model

adaption_llama_3_3_70b_instru_security_policy_qa_pairs_2377060a

Dataset size

1K27.5K

Dataset

security_policy_qa_pairs

Alignment

Domain Win Rate

80%

Task Win Rate

69.9%

Normalised Score

+1.50

Percentile

97th

AutoScientist community leaderboard rankings
#	Country	Model	Dataset size	Dataset	Alignment	Task Win %	Domain Win %	Normalised Score	Percentile
1	United States	adaption_nvidia_nemotron_3_su_bangla_news_completion_8d1483d6	15413.5K	bangla_news_completion	Yes	83.2%	86.2%	+1.95	100th
2	Austria	adaption_nvidia_nemotron_3_su_math_code_step_reasoning_b85ada1a	4.5K27.9K	math_code_step_reasoning	No	81.6%	86.1%	+1.94	100th
3	Brazil	adaption_llama_3_3_70b_instru_formal_reasoning_step_ve_b19400c2 Kaggle	20K20.1K	formal_reasoning_step_verification HuggingFace Kaggle	No	16.8%	77%	+1.73	99th
4	India	adaption_llama_3_3_70b_instru_embedded_systems_qa_eff2c40e HuggingFace Kaggle	65127.9K	embedded_systems_qa	No	85.4%	75.5%	+1.73	99th
5	Kenya	adaption_nvidia_nemotron_3_su_harvest_drying_condition_7e4d0392	4.5K23.9K	harvest_drying_conditions	No	80.1%	86.1%	+1.71	99th
6	India	adaption_llama_4_scout_17b_16_studenthub_project_specs_6961e853	122K	studenthub_project_specs Kaggle	No	63.9%	74.5%	+1.60	98th
7	India	adaption_mixtral_8x7b_instruc_india_sector_sentiment_4703ce02	44328.2K	india_sector_sentiment	No	90.9%	77.3%	+1.60	98th
8	Canada	adaption_llama_3_3_70b_instru_equity_analysis_small_22ed78c2 HuggingFace	58927.8K	equity-analysis-SMALL HuggingFace	No	83.9%	77%	+1.53	98th
9	Brazil	adaption_llama_3_3_70b_instru_parteira_br_maternal_gui_80fa5adc	1.2K24.3K	parteira_br_maternal_guidance HuggingFace	No	56.8%	79.5%	+1.53	97th
10	United States	adaption_llama_3_3_70b_instru_security_policy_qa_pairs_2377060a	1K27.5K	security_policy_qa_pairs	No	69.9%	80%	+1.50	97th

Leaderboard

Domains

Selected domain

Name

Country

Model

Dataset size

Dataset

Alignment

Task Win %

Domain Win %

Normalised Score

Percentile

United States

adaption_nvidia_nemotron_3_su_bangla_news_completion_8d1483d6

15413.5K

bangla_news_completion

Yes

83.2%

86.2%

+1.95

100th

Austria

adaption_nvidia_nemotron_3_su_math_code_step_reasoning_b85ada1a

4.5K27.9K

math_code_step_reasoning

81.6%

86.1%

+1.94

100th

Brazil

adaption_llama_3_3_70b_instru_formal_reasoning_step_ve_b19400c2

Kaggle

20K20.1K

formal_reasoning_step_verification

HuggingFace Kaggle

16.8%

77%

+1.73

99th

India

adaption_llama_3_3_70b_instru_embedded_systems_qa_eff2c40e

HuggingFace Kaggle

65127.9K

embedded_systems_qa

85.4%

75.5%

+1.73

99th

Kenya

adaption_nvidia_nemotron_3_su_harvest_drying_condition_7e4d0392

4.5K23.9K

harvest_drying_conditions

80.1%

86.1%

+1.71

99th

India

adaption_llama_4_scout_17b_16_studenthub_project_specs_6961e853

122K

studenthub_project_specs

Kaggle

63.9%

74.5%

+1.60

98th

India

adaption_mixtral_8x7b_instruc_india_sector_sentiment_4703ce02

44328.2K

india_sector_sentiment

90.9%

77.3%

+1.60

98th

Canada

adaption_llama_3_3_70b_instru_equity_analysis_small_22ed78c2

HuggingFace

58927.8K

equity-analysis-SMALL

HuggingFace

83.9%

77%

+1.53

98th

Brazil

adaption_llama_3_3_70b_instru_parteira_br_maternal_gui_80fa5adc

1.2K24.3K

parteira_br_maternal_guidance

HuggingFace

56.8%

79.5%

+1.53

97th

United States

adaption_llama_3_3_70b_instru_security_policy_qa_pairs_2377060a

1K27.5K

security_policy_qa_pairs

69.9%

80%

+1.50

97th