https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#head
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I
http://www.nanopub.org/nschema#hasAssertion
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I
http://www.nanopub.org/nschema#hasProvenance
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#provenance
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I
http://www.nanopub.org/nschema#hasPublicationInfo
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#pubinfo
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I
http://www.w3.org/1999/02/22-rdf-syntax-ns#type
http://www.nanopub.org/nschema#Nanopublication
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion
http://purl.org/dc/terms/creator
https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion
http://www.w3.org/2000/01/rdf-schema#comment
Human feedback is critical for aligning LLMs, so why don’t we collect it in the open ecosystem?🧐
We (15 orgs) gathered the key issues and next steps.
Envisioning
a community-driven feedback platform, like Wikipedia
https://www.alphaxiv.org/abs/2408.16961
🧵 https://twitter.com/LChoshen/status/1831708316982231235/photo/1
We define 5 axes of openness:
Methodology (how its collected)
Access (who can use it)
Models (one\many)
Contributors (as diverse as its uses?)
Time (keeps updating? closed models improve over several feedback iterations, and of course, models change)
Is current feedback open?🥶 https://twitter.com/LChoshen/status/1831708319855362549/photo/1
In our paper, we first learn from peer production efforts like wiki and stack overflow. These case studies tell us how important it is to align incentives of different bodies, allow the community to dictate the policies, etc.
Then, we hone on 6 crucial areas to develop open human feedback ecosystems:
Incentives to contribute, reducing contribution efforts, getting expert and diverse feedback, ongoing dynamic feedback, privacy and legal issues. https://twitter.com/LChoshen/status/1831708324284522965/photo/1
We believe a successful ecosystem must center around feedback loops
where anyone can spin up a community model, for storytelling, Bengali or anything else
Others can use it, give feedback, and benefit from a model that keeps improving with the contributions https://twitter.com/LChoshen/status/1831708326717161683/photo/1
The feedback from all models will be open and collected in one pool,
helping beyond the specialized models created to future research and general improvement
This was a huge effort and the paper is packed with ideas thanks to:
#deepRead
@Shachar_Don @ben_burtenshaw @RamonAstudill12 @cailean_osborne @MimansaJ @tzushengkuo @wzhao_nlp @IdanShenfeld @TheAndiPenguin @Yurochkin_M @Dr_Atoosa @YangsiboHuang @tatsu_hashimoto @YJernite @dvilasuero @AbendOmri @jen_gineered @sarahookr @hannahrosekirk
Note, we don't only preach open, this was open with contributions from so many organizations
@CohereForAI @MITIBMLab @IBMResearch @huggingface @nlphuji @UniofOxford @MIT_CSAIL @StanfordHAI @turinginst @princeton_nlp
@cmuhcii @EdinburghUni @cornell_tech
Please ask us anything, share, discuss and talk to us, we are going to make it real! Together!
Much much more in the paper:
https://www.alphaxiv.org/abs/2408.16961
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion
https://schema.org/keywords
LLMs
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion
https://schema.org/keywords
communitydriven
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion
https://schema.org/keywords
deepRead
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion
https://schema.org/keywords
feedbackplatform
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion
https://schema.org/keywords
humanfeedback
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion
https://schema.org/keywords
interdisciplinary
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion
https://schema.org/keywords
openecosystem
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion
https://sense-nets.xyz/announcesResource
https://www.alphaxiv.org/abs/2408.16961
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion
https://sense-nets.xyz/recommends
https://www.alphaxiv.org/abs/2408.16961
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion
https://sense-nets.xyz/summarizes
https://www.alphaxiv.org/abs/2408.16961
https://www.alphaxiv.org/abs/2408.16961
https://sense-nets.xyz/hasZoteroItemType
webpage
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#provenance
https://sense-nets.xyz/
http://www.w3.org/1999/02/22-rdf-syntax-ns#type
http://www.w3.org/ns/prov#SoftwareAgent
https://sense-nets.xyz/
http://www.w3.org/ns/prov#actedOnBehalfOf
https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#activity
http://www.w3.org/1999/02/22-rdf-syntax-ns#type
https://sense-nets.xyz/supervisedActivity
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#activity
http://www.w3.org/ns/prov#wasAssociatedWith
https://sense-nets.xyz/
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion
http://www.w3.org/ns/prov#linksTo
https://x.com/LChoshen/status/1831708316982231235
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion
http://www.w3.org/ns/prov#wasAssociatedWith
https://x.com/LChoshen
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion
http://www.w3.org/ns/prov#wasAttributedTo
https://orcid.org/0000-0002-0085-6496
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion
http://www.w3.org/ns/prov#wasAttributedTo
https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#assertion
http://www.w3.org/ns/prov#wasGeneratedBy
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#activity
https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts
http://xmlns.com/foaf/0.1/account
https://orcid.org/0000-0002-0085-6496
https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts
http://xmlns.com/foaf/0.1/account
https://x.com/LChoshen
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#pubinfo
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#sig
http://purl.org/nanopub/x/hasAlgorithm
RSA
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#sig
http://purl.org/nanopub/x/hasPublicKey
MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEArHtI92jm8pAYVsvJabxLGfOT+7G0JyJGh2gwjB5x2pFPga6wWTd+rNBWWUZViIFnaJrBEsJpgdnoupLU9ppwn+khMiGRfxqGsDDzwHcj3Jc75CRys7d3etwXdBdoXfBgjsJiZBazwm13idr6tljRrC1TaEJBnRQAqzBw9cLDeGY77cSznzXT39feUGT168dpCSE9O6u/48DvvWVqciHGsH9cQ+LroJJVsMrorwtsdZnAK+q48wtIP6pIpw5shSJ5LnA0qeN/f4TvTFDV6ItYIXjiWWpTECc/Bxmfnyat3B5xWCu9nvz8fEs7Ns0TuzQwT3/K55iSKDEIi/E0nO97xwIDAQAB
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#sig
http://purl.org/nanopub/x/hasSignature
c+TcSl1OTytUG6viQ407ucCmFFbg/ub4luPcAQIYcR7vRb+PusWvJefmZBqh7PcPGCRU9ype5ZM6zVyHMJsV9f++VX+rtRcSJgkc8PwHdv5rdNZLGhRdHrhEbLrTgKev5BotRosf3V7WaXYGJ2n4P0DO51OVyrLBl3u1pYaGXjTVmO0tY9AeR7Gd36BJnyBqPp2l7FfysrYl5uXeuPq69b38sXSiJ4Brg4FU9t9ZIfPixo/wpZLT5LupxpTHz/cjPkY8L75d7zAovHENF1xevHGbe2u3od5+njlQNSAIMWHSPX2njIcxKR9FIL8AkoLWHt/aGEMJ0l+znFemGJlupg==
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#sig
http://purl.org/nanopub/x/hasSignatureTarget
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#sig
http://purl.org/nanopub/x/singedBy
https://sense-nets.xyz/
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I#sig
http://www.w3.org/ns/prov#wasAssociatedWith
https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16VtssigningDelegation
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I
http://purl.org/dc/terms/created
2024-09-05T18:07:39.354Z
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I
http://purl.org/dc/terms/creator
https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I
http://purl.org/dc/terms/license
https://creativecommons.org/licenses/by/4.0/
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I
http://purl.org/nanopub/x/hasNanopubType
https://sense-nets.xyz/SemanticPost
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I
http://purl.org/nanopub/x/wasCreatedAt
https://sense-nets.xyz/
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I
http://www.w3.org/2000/01/rdf-schema#label
CoSMO Semantic Post
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I
http://www.w3.org/ns/prov#wasAttributedTo
https://orcid.org/0000-0002-0085-6496
https://w3id.org/np/RAmS1KQ103xMFff7_icnwLhkxSj-dAhF6-MjA42488t0I
https://sense-nets.xyz/hasRootSigner
0xf6ECcfD463afB464dcC85b051DF2E93E2646E6D2
https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts
http://xmlns.com/foaf/0.1/account
https://orcid.org/0000-0002-0085-6496
https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts
http://xmlns.com/foaf/0.1/name
Leshem Choshen 🤖🤗 @ICML wanna talk?