add notes regarding unit test
This commit is contained in:
parent
d1af06a541
commit
f2e5f209b3
1 changed files with 1 additions and 1 deletions
|
@ -89,7 +89,7 @@ y+ │ ├────────────────►▼ ┌─
|
|||
Evaluation is a two-step process. Submissions must pass Step 1 to be considered for Step 2.
|
||||
|
||||
### Step 1: Correctness (Pass/Fail)
|
||||
The output image from your API will be visually inspected. If the stitched, cropped, and scaled image is not what is expected from the input parameters, the submission is considered incorrect and will not be benchmarked for performance. **An incorrect submission receives no score.**
|
||||
The output image from your API will be visually inspected using perceptual hashing or manually. If the stitched, cropped, and scaled image is not what is expected from the input parameters, the submission is considered incorrect and will not be benchmarked for performance. Unit tests will be provided by organizer (author: I haven't written them yet). **An incorrect submission receives no score.**
|
||||
|
||||
### Step 2: Performance Benchmarking
|
||||
If the output is correct, your API will be benchmarked on two key metrics:
|
||||
|
|
Loading…
Add table
Add a link
Reference in a new issue