Skip to content

Benchmark is inoperable #618

@aryalabs-approver

Description

@aryalabs-approver

All the OPC Download links are dead-you have to manually search for the papers and find the new links for them
You cannot run the assessment at all because the repo download is not available nor are many of the files availible including, but not limited to
What's missing from the repo (not papers):

  • gold.py (reference implementations) for tasks 03-33
  • rubric.json (evaluation rubrics) for tasks 03-33
  • CSV data files for tasks 03-33
  • requirements.txt, env.example, source utils

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions