Skip to content

cannot reproduce paper results with default setting #2

Description

@zihuixue

Hi,

Thanks for sharing the code! When I ran the code on PPI dataset, I'm unable to have a student (LSP) of F1 score 96.1 as reported in Table 2 of the paper. I used default settings and teacher path file provided in this repo. If I train a student from scratch, i.e., mode = full, F1 score = 95.75. And if I use same settings and change to LSP, i.e., mode = mi, F1 score = 95.76. I wonder if there's some problem here.

I would appreciate it if you could answer me.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions