Feat/competition/eval (#114)

* integrating results for comps

* Update polaris/hub/client.py

Co-authored-by: Cas Wognum <[email protected]>

* addressing comments & adding CompetitionResults class

* test competition evalution works for multi-column dataframes

* add single column test to competition evaluation

* fix multitask-single-test-set cases

* fix bug with multi-test-set benchmarks

* adding functions to serialize & deserialize pred objs for external eval

* updating return for evaluate_competition method in client

* updating evaluate_competition method to pass additional result info to hub

* refuse early to upload a competition with a zarr-based dataset

* removing merge conflicts

---------

Co-authored-by: Andrew Quirke <[email protected]>
Co-authored-by: Andrew Quirke <[email protected]>
Co-authored-by: Cas Wognum <[email protected]>

Author: 3 people

polaris/hub/client.py

@@ -799,6 +799,10 @@ def upload_competition(
         """
         ACCESS = "private"
 
+        if competition.dataset.zarr_root is not None:
+            logger.info("Zarr-based competitions are not supported at this time")
+            return
+
         # Upload competition dataset
         dataset_response = self._upload_dataset(
             competition.dataset, ArtifactType.COMPETITION.value, ACCESS, timeout, owner, if_exists