跳到主要内容

Submit

POST 

/submit

Submit a single problem in a dataset

Request

Body

required

    dataset Dataset (string)required

    id

    object

    required

    anyOf

    integer

    completion Completion (string)required

    config

    object

    required

    custom_extract_logic: a piece of python code that calls submit_code_blocks(cbs) to extract custom code cbs: List[CodeBlock], CodeBlock(priority=40, code='xxx', language='xxx') priority: fenced = 30, incomplete fenced = 20, heuristic = 10

    dataset_type

    object

    the dataset class used to process, only works when the dataset id is not registered.

    anyOf

    string

    language

    object

    anyOf

    string

    Possible values: [python, cpp, nodejs, go, go_test, java, php, csharp, bash, typescript, sql, rust, cuda, lua, R, perl, D_ut, ruby, scala, julia, pytest, junit, kotlin_script, jest, verilog, python_gpu, lean, swift, racket]

    locale

    object

    anyOf

    string

    is_fewshot

    object

    anyOf

    boolean

    compile_timeout

    object

    anyOf

    number

    run_timeout

    object

    anyOf

    number

    custom_extract_logic

    object

    anyOf

    string

    provided_data

    object

    anyOf

  • Array [

  • property name*

    object

    anyOf

    string

  • ]

  • extra object
    Default value: {}

Responses

Successful Response

Schema

    id

    object

    required

    anyOf

    integer

    accepted Accepted (boolean)required
    extracted_code Extracted Code (string)required

    full_code

    object

    anyOf

    string

    test_code

    object

    anyOf

    string

    tests

    object[]

    required

  • Array [

  • passed Passed (boolean)required

    exec_info

    object

    required

    status RunStatus (string)required

    Possible values: [Success, Failed, SandboxError]

    message Message (string)required

    compile_result

    object

    anyOf

    status CommandRunStatus (string)required

    Possible values: [Finished, Error, TimeLimitExceeded]

    execution_time

    object

    anyOf

    number

    return_code

    object

    anyOf

    integer

    stdout

    object

    anyOf

    string

    stderr

    object

    anyOf

    string

    run_result

    object

    anyOf

    status CommandRunStatus (string)required

    Possible values: [Finished, Error, TimeLimitExceeded]

    execution_time

    object

    anyOf

    number

    return_code

    object

    anyOf

    integer

    stdout

    object

    anyOf

    string

    stderr

    object

    anyOf

    string

    executor_pod_name

    object

    anyOf

    string

    files

    object

    property name* string

    test_info

    object

    anyOf

    object

  • ]

  • extracted_type

    object

    anyOf

    string

    Possible values: [fenced, incomplete_fenced, heuristic, empty]

    extra

    object

    anyOf

    object

Loading...