What is closed about kaggle that this does differently? I've always viewed that community as extremely open, even allowing hosts the option to open source solutions or not, thus attracting more challenges and competitors.
The about page [1] for this project says,
> With EvalAI, we want to standardize the process of evaluating different methods on a dataset
Standardization often does come from openness, I'm just not sure juxtaposing against kaggle is the right move.
The service itself? Okay, so in theory anyone could host competitions with this backend.
The lion's share of Kaggle's effort lies in their expertise in (1) making deals, and (2) making sure the challenge is legit (no bias in training data, not too easy, etc.). That's not easily replicable, so while an "Open-Source alternative" sounds good up front, the bulk of the work remains.
The about page [1] for this project says,
> With EvalAI, we want to standardize the process of evaluating different methods on a dataset
Standardization often does come from openness, I'm just not sure juxtaposing against kaggle is the right move.
[1] https://eval.ai/about