https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#head https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I http://www.nanopub.org/nschema#hasAssertion https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I http://www.nanopub.org/nschema#hasProvenance https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#provenance https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I http://www.nanopub.org/nschema#hasPublicationInfo https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#pubinfo https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://www.nanopub.org/nschema#Nanopublication https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion http://purl.org/dc/terms/creator https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion http://www.w3.org/2000/01/rdf-schema#comment Human feedback is critical for aligning LLMs, so why don’t we collect it in the open ecosystem?🧐 We (15 orgs) gathered the key issues and next steps. Envisioning a community-driven feedback platform, like Wikipedia https://www.alphaxiv.org/abs/2408.16961 🧵 https://twitter.com/LChoshen/status/1831708316982231235/photo/1 We define 5 axes of openness: Methodology (how its collected) Access (who can use it) Models (one\many) Contributors (as diverse as its uses?) Time (keeps updating? closed models improve over several feedback iterations, and of course, models change) Is current feedback open?🥶 https://twitter.com/LChoshen/status/1831708319855362549/photo/1 In our paper, we first learn from peer production efforts like wiki and stack overflow. These case studies tell us how important it is to align incentives of different bodies, allow the community to dictate the policies, etc. Then, we hone on 6 crucial areas to develop open human feedback ecosystems: Incentives to contribute, reducing contribution efforts, getting expert and diverse feedback, ongoing dynamic feedback, privacy and legal issues. https://twitter.com/LChoshen/status/1831708324284522965/photo/1 We believe a successful ecosystem must center around feedback loops where anyone can spin up a community model, for storytelling, Bengali or anything else Others can use it, give feedback, and benefit from a model that keeps improving with the contributions https://twitter.com/LChoshen/status/1831708326717161683/photo/1 The feedback from all models will be open and collected in one pool, helping beyond the specialized models created to future research and general improvement This was a huge effort and the paper is packed with ideas thanks to: #deepRead @Shachar_Don @ben_burtenshaw @RamonAstudill12 @cailean_osborne @MimansaJ @tzushengkuo @wzhao_nlp @IdanShenfeld @TheAndiPenguin @Yurochkin_M @Dr_Atoosa @YangsiboHuang @tatsu_hashimoto @YJernite @dvilasuero @AbendOmri @jen_gineered @sarahookr @hannahrosekirk Note, we don't only preach open, this was open with contributions from so many organizations @CohereForAI @MITIBMLab @IBMResearch @huggingface @nlphuji @UniofOxford @MIT_CSAIL @StanfordHAI @turinginst @princeton_nlp @cmuhcii @EdinburghUni @cornell_tech Please ask us anything, share, discuss and talk to us, we are going to make it real! Together! Much much more in the paper: https://www.alphaxiv.org/abs/2408.16961 https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion https://schema.org/keywords LLMs https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion https://schema.org/keywords communitydriven https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion https://schema.org/keywords deepRead https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion https://schema.org/keywords feedbackplatform https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion https://schema.org/keywords humanfeedback https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion https://schema.org/keywords interdisciplinary https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion https://schema.org/keywords openecosystem https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion https://sense-nets.xyz/announcesResource https://www.alphaxiv.org/abs/2408.16961 https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion https://sense-nets.xyz/recommends https://www.alphaxiv.org/abs/2408.16961 https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion https://sense-nets.xyz/summarizes https://www.alphaxiv.org/abs/2408.16961 https://www.alphaxiv.org/abs/2408.16961 https://sense-nets.xyz/hasZoteroItemType webpage https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#provenance https://sense-nets.xyz/ http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://www.w3.org/ns/prov#SoftwareAgent https://sense-nets.xyz/ http://www.w3.org/ns/prov#actedOnBehalfOf https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#activity http://www.w3.org/1999/02/22-rdf-syntax-ns#type https://sense-nets.xyz/supervisedActivity https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#activity http://www.w3.org/ns/prov#wasAssociatedWith https://sense-nets.xyz/ https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion http://www.w3.org/ns/prov#linksTo https://x.com/LChoshen/status/1831708316982231235 https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion http://www.w3.org/ns/prov#wasAssociatedWith https://x.com/LChoshen https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion http://www.w3.org/ns/prov#wasAttributedTo https://orcid.org/0000-0002-0085-6496 https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion http://www.w3.org/ns/prov#wasAttributedTo https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion http://www.w3.org/ns/prov#wasGeneratedBy https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#activity https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts http://xmlns.com/foaf/0.1/account https://orcid.org/0000-0002-0085-6496 https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts http://xmlns.com/foaf/0.1/account https://x.com/LChoshen https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#pubinfo https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#sig http://purl.org/nanopub/x/hasAlgorithm RSA https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#sig http://purl.org/nanopub/x/hasPublicKey MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEArHtI92jm8pAYVsvJabxLGfOT+7G0JyJGh2gwjB5x2pFPga6wWTd+rNBWWUZViIFnaJrBEsJpgdnoupLU9ppwn+khMiGRfxqGsDDzwHcj3Jc75CRys7d3etwXdBdoXfBgjsJiZBazwm13idr6tljRrC1TaEJBnRQAqzBw9cLDeGY77cSznzXT39feUGT168dpCSE9O6u/48DvvWVqciHGsH9cQ+LroJJVsMrorwtsdZnAK+q48wtIP6pIpw5shSJ5LnA0qeN/f4TvTFDV6ItYIXjiWWpTECc/Bxmfnyat3B5xWCu9nvz8fEs7Ns0TuzQwT3/K55iSKDEIi/E0nO97xwIDAQAB https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#sig http://purl.org/nanopub/x/hasSignature c+TcSl1OTytUG6viQ407ucCmFFbg/ub4luPcAQIYcR7vRb+PusWvJefmZBqh7PcPGCRU9ype5ZM6zVyHMJsV9f++VX+rtRcSJgkc8PwHdv5rdNZLGhRdHrhEbLrTgKev5BotRosf3V7WaXYGJ2n4P0DO51OVyrLBl3u1pYaGXjTVmO0tY9AeR7Gd36BJnyBqPp2l7FfysrYl5uXeuPq69b38sXSiJ4Brg4FU9t9ZIfPixo/wpZLT5LupxpTHz/cjPkY8L75d7zAovHENF1xevHGbe2u3od5+njlQNSAIMWHSPX2njIcxKR9FIL8AkoLWHt/aGEMJ0l+znFemGJlupg== https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#sig http://purl.org/nanopub/x/hasSignatureTarget https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#sig http://purl.org/nanopub/x/singedBy https://sense-nets.xyz/ https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#sig http://www.w3.org/ns/prov#wasAssociatedWith https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16VtssigningDelegation https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I http://purl.org/dc/terms/created 2024-09-05T18:07:39.354Z https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I http://purl.org/dc/terms/creator https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I http://purl.org/dc/terms/license https://creativecommons.org/licenses/by/4.0/ https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I http://purl.org/nanopub/x/hasNanopubType https://sense-nets.xyz/SemanticPost https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I http://purl.org/nanopub/x/wasCreatedAt https://sense-nets.xyz/ https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I http://www.w3.org/2000/01/rdf-schema#label CoSMO Semantic Post https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I http://www.w3.org/ns/prov#wasAttributedTo https://orcid.org/0000-0002-0085-6496 https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I https://sense-nets.xyz/hasRootSigner 0xf6ECcfD463afB464dcC85b051DF2E93E2646E6D2 https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts http://xmlns.com/foaf/0.1/account https://orcid.org/0000-0002-0085-6496 https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts http://xmlns.com/foaf/0.1/name Leshem Choshen 🤖🤗 @ICML wanna talk?