https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#head https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM http://www.nanopub.org/nschema#hasAssertion https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#assertion https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM http://www.nanopub.org/nschema#hasProvenance https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#provenance https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM http://www.nanopub.org/nschema#hasPublicationInfo https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#pubinfo https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://www.nanopub.org/nschema#Nanopublication https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#assertion https://arxiv.org/abs/2308.11696 https://sense-nets.xyz/hasZoteroItemType preprint https://arxiv.org/abs/2407.13696 https://sense-nets.xyz/hasZoteroItemType preprint https://arxiv.org/pdf/2407.13696 https://sense-nets.xyz/hasZoteroItemType unknown https://github.com/IBM/BenchBench https://sense-nets.xyz/hasZoteroItemType computerProgram https://huggingface.co/spaces/ibm/benchbench https://sense-nets.xyz/hasZoteroItemType webpage https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#assertion http://purl.org/dc/terms/creator https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#assertion http://purl.org/spar/cito/discusses https://arxiv.org/abs/2308.11696 https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#assertion http://purl.org/spar/cito/discusses https://arxiv.org/pdf/2407.13696 https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#assertion http://purl.org/spar/cito/discusses https://x.com/LChoshen/status/1696153656653926581 https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#assertion http://www.w3.org/2000/01/rdf-schema#comment The BenchBench Leaderboard lets you explore 100s of benchmarks and find trustworthy alternatives that fit your resources. 👉 https://huggingface.co/spaces/ibm/benchbench Currently, benchmark comparisons are often ad-hoc and inconsistent making results untrustworthy and benchmark choice 🤮 BenchBench & our findings: https://arxiv.org/pdf/2407.13696 offer standard and transparent comparisons to reduce variance and increase confidence in your evaluations!🎉 https://twitter.com/LChoshen/status/1835738770353623053/photo/1 No need to manually gather and compare benchmark data! BenchBench provides a centralized platform with a curated database and standardized methodology for effortless benchmark agreement testing. You can also use them with our package here: https://github.com/IBM/BenchBench Want to incorporate your benchmark into BenchBench? Make a PR skeptical about the idea of BenchBench? comment! Details? Read: https://arxiv.org/abs/2407.13696 And if you are in the mood for other benchmarking aspects: https://x.com/LChoshen/status/1696153656653926581 https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#assertion https://schema.org/keywords Benchmarking https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#assertion https://schema.org/keywords CentralizedPlatform https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#assertion https://schema.org/keywords CuratedDatabase https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#assertion https://schema.org/keywords HuggingFace https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#assertion https://schema.org/keywords LanguageModels https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#assertion https://schema.org/keywords StandardizedMethodology https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#assertion https://sense-nets.xyz/announcesResource https://huggingface.co/spaces/ibm/benchbench https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#assertion https://sense-nets.xyz/endorses https://arxiv.org/pdf/2407.13696 https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#assertion https://sense-nets.xyz/endorses https://huggingface.co/spaces/ibm/benchbench https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#assertion https://sense-nets.xyz/recommends https://arxiv.org/abs/2407.13696 https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#assertion https://sense-nets.xyz/recommends https://github.com/IBM/BenchBench https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#assertion https://sense-nets.xyz/summarizes https://arxiv.org/abs/2407.13696 https://x.com/LChoshen/status/1696153656653926581 https://sense-nets.xyz/hasZoteroItemType forumPost https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#provenance https://sense-nets.xyz/ http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://www.w3.org/ns/prov#SoftwareAgent https://sense-nets.xyz/ http://www.w3.org/ns/prov#actedOnBehalfOf https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#activity http://www.w3.org/1999/02/22-rdf-syntax-ns#type https://sense-nets.xyz/unsupervisedActivity https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#activity http://www.w3.org/ns/prov#wasAssociatedWith https://sense-nets.xyz/ https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#assertion http://www.w3.org/ns/prov#linksTo https://x.com/LChoshen/status/1835738766851645622 https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#assertion http://www.w3.org/ns/prov#wasAssociatedWith https://x.com/LChoshen https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#assertion http://www.w3.org/ns/prov#wasAttributedTo https://orcid.org/0000-0002-0085-6496 https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#assertion http://www.w3.org/ns/prov#wasAttributedTo https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#assertion http://www.w3.org/ns/prov#wasGeneratedBy https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#activity https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts http://xmlns.com/foaf/0.1/account https://orcid.org/0000-0002-0085-6496 https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts http://xmlns.com/foaf/0.1/account https://x.com/LChoshen https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#pubinfo https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#sig http://purl.org/nanopub/x/hasAlgorithm RSA https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#sig http://purl.org/nanopub/x/hasPublicKey MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEArHtI92jm8pAYVsvJabxLGfOT+7G0JyJGh2gwjB5x2pFPga6wWTd+rNBWWUZViIFnaJrBEsJpgdnoupLU9ppwn+khMiGRfxqGsDDzwHcj3Jc75CRys7d3etwXdBdoXfBgjsJiZBazwm13idr6tljRrC1TaEJBnRQAqzBw9cLDeGY77cSznzXT39feUGT168dpCSE9O6u/48DvvWVqciHGsH9cQ+LroJJVsMrorwtsdZnAK+q48wtIP6pIpw5shSJ5LnA0qeN/f4TvTFDV6ItYIXjiWWpTECc/Bxmfnyat3B5xWCu9nvz8fEs7Ns0TuzQwT3/K55iSKDEIi/E0nO97xwIDAQAB https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#sig http://purl.org/nanopub/x/hasSignature I5lz+4/xIbaHsmaqNtkbAL0ZQmAmLTB8MjqHiqx5ifUTvyjDx0uWFZwslB9tXL6QZ2pITWfYWDY21vr3QCzSzNMzYWx+EeQbJbuF1D/RUBtHQzQLIl1LqH3WyLLPfzpIpskjshyow+5LUifAQ2GU3tRtdXzAoEz4MKMKHRAZbolbXsjrON65/lIjSqWvDYHAFNCtyBjvTIH3qwycis6GG7vyUKQ+K0FUcOf+CfttB8A+gV/HFXOGId10hn0O/saxCcxhffApPwaIv6yOm0NZOHlE4OpoZg5w3FzEQhKN/NjaFBWCnhxWdJSwpNr8m/gGCDUAmeQkhDprtiq6Obtsng== https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#sig http://purl.org/nanopub/x/hasSignatureTarget https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#sig http://purl.org/nanopub/x/singedBy https://sense-nets.xyz/ https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM#sig http://www.w3.org/ns/prov#wasAssociatedWith https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16VtssigningDelegation https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM http://purl.org/dc/terms/created 2024-09-16T18:17:08.034Z https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM http://purl.org/dc/terms/creator https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM http://purl.org/dc/terms/license https://creativecommons.org/licenses/by/4.0/ https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM http://purl.org/nanopub/x/hasNanopubType https://sense-nets.xyz/SemanticPost https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM http://purl.org/nanopub/x/wasCreatedAt https://sense-nets.xyz/ https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM http://www.w3.org/2000/01/rdf-schema#label CoSMO Semantic Post https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM http://www.w3.org/ns/prov#wasAttributedTo https://orcid.org/0000-0002-0085-6496 https://w3id.org/np/RA0at64nVVpsyTU-R4bAsmdCkO8pK2ZFLGsLnJIoS07wM https://sense-nets.xyz/hasRootSigner 0xf6ECcfD463afB464dcC85b051DF2E93E2646E6D2 https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts http://xmlns.com/foaf/0.1/account https://orcid.org/0000-0002-0085-6496 https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts http://xmlns.com/foaf/0.1/name Leshem Choshen 🤖🤗 @ICML wanna talk?