Hi there! In the function corresponding to NDCG calculation I noticed that ignore_rank_of_non_annotated_urls flag is present.
|
ignore_rank_of_non_annotated_urls: bool=True) -> float: |
The question is: are your results in the paper calculated with ignore_rank_of_non_annotated_urls=True?
Hi there! In the function corresponding to NDCG calculation I noticed that
ignore_rank_of_non_annotated_urlsflag is present.CodeSearchNet/src/relevanceeval.py
Line 76 in 76a006f
The question is: are your results in the paper calculated with
ignore_rank_of_non_annotated_urls=True?