@@ -34,12 +34,12 @@ We provide pretrained embeddings and model weights. We evaluate our models by e
3434
3535| Training data | Aligned modalities | Embeddings | Model | Config |
3636| ---------------| ---------------------| -------------| ---------| --------|
37- | BIOSCAN-1M | None | [ Embedding] ( https://aspis.cmpt.sfu.ca/projects/bioscan/checkpoint/for_readme/ver_1_0/no_alignment/extracted_feature_from_test_split.hdf5 ) | N/A | [ Link] ( https://github.com/bioscan-ml/clibd/blob/main /bioscanclip/config/model_config/for_bioscan_1m/final_experiments/image_dna_text_no_loading.yaml ) |
38- | BIOSCAN-1M | ** I** mage + ** D** NA | [ Embedding] ( https://aspis.cmpt.sfu.ca/projects/bioscan/checkpoint/for_readme/ver_1_0/image_dna/extracted_feature_from_test_split.hdf5 ) | [ Link] ( https://aspis.cmpt.sfu.ca/projects/bioscan/checkpoint/for_readme/ver_1_0/image_dna/best.pth ) | [ Link] ( https://github.com/bioscan-ml/clibd/blob/main /bioscanclip/config/model_config/for_bioscan_1m/final_experiments/image_dna_seed_42.yaml ) |
39- | BIOSCAN-1M | ** I** mage + ** D** NA + ** T** ax | [ Embedding] ( https://aspis.cmpt.sfu.ca/projects/bioscan/checkpoint/for_readme/ver_1_0/image_dna_text/extracted_feature_from_test_split.hdf5 ) | [ Link] ( https://aspis.cmpt.sfu.ca/projects/bioscan/checkpoint/for_readme/ver_1_0/image_dna_text/best.pth ) | [ Link] ( https://github.com/bioscan-ml/clibd/blob/main /bioscanclip/config/model_config/for_bioscan_1m/final_experiments/image_dna_text_seed_42.yaml ) |
40- | BIOSCAN-5M | None | [ Embedding] ( https://aspis.cmpt.sfu.ca/projects/bioscan/checkpoint/for_readme/ver_1_0/bioscan_5m/no_alignment/extracted_feature_from_test_split.hdf5 ) | N/A | [ Link] ( https://github.com/bioscan-ml/clibd/blob/main /bioscanclip/config/model_config/for_bioscan_5m/no_alignment_baseline/no_align.yaml ) |
41- | BIOSCAN-5M | ** I** mage + ** D** NA | [ Embedding] ( https://aspis.cmpt.sfu.ca/projects/bioscan/checkpoint/for_readme/ver_1_0/bioscan_5m/image_dna/extracted_feature_from_test_split.hdf5 ) | [ Link] ( https://aspis.cmpt.sfu.ca/projects/bioscan/checkpoint/for_readme/ver_1_0/bioscan_5m/image_dna/best.pth ) | [ Link] ( https://github.com/bioscan-ml/clibd/blob/main /bioscanclip/config/model_config/for_bioscan_5m/final_experiments/image_dna_seed_42.yaml ) |
42- | BIOSCAN-5M | ** I** mage + ** D** NA + ** T** ax | [ Embedding] ( https://aspis.cmpt.sfu.ca/projects/bioscan/checkpoint/for_readme/ver_1_0/bioscan_5m/image_dna_text/extracted_feature_from_test_split.hdf5 ) | [ Link] ( https://aspis.cmpt.sfu.ca/projects/bioscan/checkpoint/for_readme/ver_1_0/bioscan_5m/image_dna_text/best.pth ) | [ Link] ( https://github.com/bioscan-ml/clibd/blob/main /bioscanclip/config/model_config/for_bioscan_5m/final_experiments/image_dna_text_seed_42.yaml ) |
37+ | BIOSCAN-1M | None | [ Embedding] ( https://aspis.cmpt.sfu.ca/projects/bioscan/checkpoint/for_readme/ver_1_0/no_alignment/extracted_feature_from_test_split.hdf5 ) | N/A | [ Link] ( https://github.com/bioscan-ml/clibd/blob/45f38fc /bioscanclip/config/model_config/for_bioscan_1m/final_experiments/image_dna_text_no_loading.yaml ) |
38+ | BIOSCAN-1M | ** I** mage + ** D** NA | [ Embedding] ( https://aspis.cmpt.sfu.ca/projects/bioscan/checkpoint/for_readme/ver_1_0/image_dna/extracted_feature_from_test_split.hdf5 ) | [ Link] ( https://aspis.cmpt.sfu.ca/projects/bioscan/checkpoint/for_readme/ver_1_0/image_dna/best.pth ) | [ Link] ( https://github.com/bioscan-ml/clibd/blob/45f38fc /bioscanclip/config/model_config/for_bioscan_1m/final_experiments/image_dna_seed_42.yaml ) |
39+ | BIOSCAN-1M | ** I** mage + ** D** NA + ** T** ax | [ Embedding] ( https://aspis.cmpt.sfu.ca/projects/bioscan/checkpoint/for_readme/ver_1_0/image_dna_text/extracted_feature_from_test_split.hdf5 ) | [ Link] ( https://aspis.cmpt.sfu.ca/projects/bioscan/checkpoint/for_readme/ver_1_0/image_dna_text/best.pth ) | [ Link] ( https://github.com/bioscan-ml/clibd/blob/45f38fc /bioscanclip/config/model_config/for_bioscan_1m/final_experiments/image_dna_text_seed_42.yaml ) |
40+ | BIOSCAN-5M | None | [ Embedding] ( https://aspis.cmpt.sfu.ca/projects/bioscan/checkpoint/for_readme/ver_1_0/bioscan_5m/no_alignment/extracted_feature_from_test_split.hdf5 ) | N/A | [ Link] ( https://github.com/bioscan-ml/clibd/blob/45f38fc /bioscanclip/config/model_config/for_bioscan_5m/no_alignment_baseline/no_align.yaml ) |
41+ | BIOSCAN-5M | ** I** mage + ** D** NA | [ Embedding] ( https://aspis.cmpt.sfu.ca/projects/bioscan/checkpoint/for_readme/ver_1_0/bioscan_5m/image_dna/extracted_feature_from_test_split.hdf5 ) | [ Link] ( https://aspis.cmpt.sfu.ca/projects/bioscan/checkpoint/for_readme/ver_1_0/bioscan_5m/image_dna/best.pth ) | [ Link] ( https://github.com/bioscan-ml/clibd/blob/45f38fc /bioscanclip/config/model_config/for_bioscan_5m/final_experiments/image_dna_seed_42.yaml ) |
42+ | BIOSCAN-5M | ** I** mage + ** D** NA + ** T** ax | [ Embedding] ( https://aspis.cmpt.sfu.ca/projects/bioscan/checkpoint/for_readme/ver_1_0/bioscan_5m/image_dna_text/extracted_feature_from_test_split.hdf5 ) | [ Link] ( https://aspis.cmpt.sfu.ca/projects/bioscan/checkpoint/for_readme/ver_1_0/bioscan_5m/image_dna_text/best.pth ) | [ Link] ( https://github.com/bioscan-ml/clibd/blob/45f38fc /bioscanclip/config/model_config/for_bioscan_5m/final_experiments/image_dna_text_seed_42.yaml ) |
4343
4444We also provide checkpoints trained with LoRA layers. You can download them from this [ Link] ( https://aspis.cmpt.sfu.ca/projects/bioscan/clip_project/ckpt/bioscan_clip/lora_version_ckpt.zip )
4545
0 commit comments