https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#head https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk http://www.nanopub.org/nschema#hasAssertion https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#assertion https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk http://www.nanopub.org/nschema#hasProvenance https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#provenance https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk http://www.nanopub.org/nschema#hasPublicationInfo https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#pubinfo https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://www.nanopub.org/nschema#Nanopublication https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#assertion https://openreview.net/forum?id=u3sssLLu4y&referrer= https://sense-nets.xyz/hasZoteroItemType conferencePaper https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#assertion http://purl.org/dc/terms/creator https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#assertion http://purl.org/spar/cito/discusses https://openreview.net/forum?id=u3sssLLu4y&referrer= https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#assertion http://www.w3.org/2000/01/rdf-schema#comment #ICML2024 Weight decay regularizes weights to be low-rank + increases alignment between laters Good labels end with low rank middle layer weights This doesn't happen with random labels https://openreview.net/forum?id=u3sssLLu4y&referrer=%5Bthe%20profile%20of%20Samuel%20Wheeler%5D(%2Fprofile%3Fid%3D~Samuel_Wheeler1) @kkpatelnmh @PedroSavarese @iammattwalters https://twitter.com/LChoshen/status/1816819564002304091/photo/1 https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#assertion https://schema.org/keywords ICML2024 https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#assertion https://schema.org/keywords alignment https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#assertion https://schema.org/keywords lowrank https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#assertion https://schema.org/keywords machinelearning https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#assertion https://schema.org/keywords weightdecay https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#assertion https://sense-nets.xyz/summarizes https://openreview.net/forum?id=u3sssLLu4y&referrer= https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#provenance https://sense-nets.xyz/ http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://www.w3.org/ns/prov#SoftwareAgent https://sense-nets.xyz/ http://www.w3.org/ns/prov#actedOnBehalfOf https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#activity http://www.w3.org/1999/02/22-rdf-syntax-ns#type https://sense-nets.xyz/supervisedActivity https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#activity http://www.w3.org/ns/prov#wasAssociatedWith https://sense-nets.xyz/ https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#assertion http://www.w3.org/ns/prov#linksTo https://x.com/LChoshen/status/1816819564002304091 https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#assertion http://www.w3.org/ns/prov#wasAssociatedWith https://x.com/LChoshen https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#assertion http://www.w3.org/ns/prov#wasAttributedTo https://orcid.org/0000-0002-0085-6496 https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#assertion http://www.w3.org/ns/prov#wasAttributedTo https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#assertion http://www.w3.org/ns/prov#wasGeneratedBy https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#activity https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts http://xmlns.com/foaf/0.1/account https://orcid.org/0000-0002-0085-6496 https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts http://xmlns.com/foaf/0.1/account https://x.com/LChoshen https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#pubinfo https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#sig http://purl.org/nanopub/x/hasAlgorithm RSA https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#sig http://purl.org/nanopub/x/hasPublicKey MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEArHtI92jm8pAYVsvJabxLGfOT+7G0JyJGh2gwjB5x2pFPga6wWTd+rNBWWUZViIFnaJrBEsJpgdnoupLU9ppwn+khMiGRfxqGsDDzwHcj3Jc75CRys7d3etwXdBdoXfBgjsJiZBazwm13idr6tljRrC1TaEJBnRQAqzBw9cLDeGY77cSznzXT39feUGT168dpCSE9O6u/48DvvWVqciHGsH9cQ+LroJJVsMrorwtsdZnAK+q48wtIP6pIpw5shSJ5LnA0qeN/f4TvTFDV6ItYIXjiWWpTECc/Bxmfnyat3B5xWCu9nvz8fEs7Ns0TuzQwT3/K55iSKDEIi/E0nO97xwIDAQAB https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#sig http://purl.org/nanopub/x/hasSignature Q/hcs0IsrhgfmeBO64uz4EH5qhcyTixKRpmd91KMpQjCkrBa/i+gr70jn80Sy1Zvx7KOQaLn4CMyVquhsL9CwwOfCA9kzxCzB7A4RD5DMrGIxNEpsy+j4RmuTKeiMMLnxjjwGj0q3muT8pCL4MHNlILwk6H8kBD8D5srQ42/AZG/NzRDr23hmPR9eFsQEim2BZKo7f1v/FbaYsFVUEwQqQpoy90jwVVhRJOsx4MLglKaveKHIhQBSpWfqOGVJg2PxCOhv/M6/sx8C7Do/j1uQYUNs6bxegbXz9KSHmPAbIh0OFAlFJAIRR/XxQ/7ALZ4C/KeGfO9XMuGF8ui/IY9wQ== https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#sig http://purl.org/nanopub/x/hasSignatureTarget https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#sig http://purl.org/nanopub/x/singedBy https://sense-nets.xyz/ https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk#sig http://www.w3.org/ns/prov#wasAssociatedWith https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16VtssigningDelegation https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk http://purl.org/dc/terms/created 2024-09-12T18:44:50.152Z https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk http://purl.org/dc/terms/creator https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk http://purl.org/dc/terms/license https://creativecommons.org/licenses/by/4.0/ https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk http://purl.org/nanopub/x/hasNanopubType https://sense-nets.xyz/SemanticPost https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk http://purl.org/nanopub/x/wasCreatedAt https://sense-nets.xyz/ https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk http://www.w3.org/2000/01/rdf-schema#label CoSMO Semantic Post https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk http://www.w3.org/ns/prov#wasAttributedTo https://orcid.org/0000-0002-0085-6496 https://w3id.org/np/RA7XjzRLoMcPrDu3gZTqotvYYe-qL-wd---Pzyvh-6UWk https://sense-nets.xyz/hasRootSigner 0xf6ECcfD463afB464dcC85b051DF2E93E2646E6D2 https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts http://xmlns.com/foaf/0.1/account https://orcid.org/0000-0002-0085-6496 https://w3id.org/np/RAoSadUw99CeqDlR2400018nqTzR_38fT86OrTzk16Vts http://xmlns.com/foaf/0.1/name Leshem Choshen 🤖🤗 @ICML wanna talk?