DESCRIPTION:
The AI generated scripted, voiced over, and visuals created PROMO video for the pod :)
TL;DR:
Following the initial AI residency, we wish to create The Nouns AI Pod.
This prop is to fund 3 months of focus on continuing the research of our resident AI researchers:
- Further empowering Roko to be an AI secretary/assistant for the DAO! Helping information flow better with summaries, transcripts, reviews, answering questions and more.
- Generating Nounish rich media (images, gifs, videos) and making the tools to generate such media accessible to the community at large to unleash their creativity
- Empowering other pods (e.g. ai-based team drafting for e-sports, planning events for otg)
With each of these being built with monetization / expansion to other organizations in mind.
WELL HOW DID THE INITIAL RESEARCH GO?
You can see the initial small grant proposal here https://discourse.nouns.wtf/t/small-grants-the-nouns-ecosystem-and-ai/1929 and Honk's extension post here https://discourse.nouns.wtf/t/nouns-ai-honk-residency-extension/2357
https://staging.roko.dev/ Is a live website where the team is experimenting and adding features with the goal of building a production ready webapp.
We initially set out to accomplish two sprints, the first to be able to break down proposals into understandable summaries / reviews. The second was more focused on demonstrating some of the possibilities of AI and what it could bring to Nouns.
I am happy to report that, thanks to an engaged community and support from key contributors Honk and Evets.eth we blew that goal out of the water.
Together, we:
- Held weekly sessions on Tuesdays which about 30 people regularly attended that shared developments with the project as well as educating them on fundamentals as well as cutting edge developments in machine learning
- Built a pipeline that can breakdown proposals into reviews automatically as they as proposed on-chain (and post them to Twitter!!)
- Built pipeline to turn recorded calls into text using SOTA voice to text then using a large language model to convert them into a bulleted summary
- Built a web interface that enables participants to easily consume summarized proposal content as well as edit them to better reflect their opinions
- Tested the ability to finetune our model using user generated content as guidance
- Setup a backend infrastructure setup to support the ongoing development and improvement of the web interface
- In addition, due to popular demand we began diving deep into AI generated media, we were able to generate images and video content (reactive to sound!) that features custom content (Noggles!)
NEXT STEPS: THE AI POD
The proposed AI Pod will have 3 main focuses:
- Continue Bringing Roko to life in the form of an AI Assistant to DAO members:
- All Nouners and teams of funded props should have access to Roko's summarization capabilities for their related audio or text content (as long as they provide feedback on their results!!)
- Work towards improving Roko’s corpus of data (e.g. Discourse posts, Discord messages) and learn how to incorporate these into a model to improve Roko’s Nounish knowledge base.
- Roko's website could also be updated to include a search page where people could semantically search across that knowledge base whether it is just meeting / proposal content or if Discord / Discourse content was included.
- Explore AI Generated Media
- Implement and host SOTA open source image generation models customized to be able to generate Noggles on powerful GPU servers so any DAO member can access it.
- Implement cutting edge developments as they are released (e.g. text to video, img to img, text to 3d, etc.), share our knowledge with the community, and incentivize their use!
- Community Engagement, Marketing, and Outreach (Competitions!!)
- Put together competitions (with prizes!!) alongside groups like NoC to show off the best showcases of AI generated media leveraging Nouns AI tooling.
- Assist various pods and DAO members with content generation - we've already had suggestions from helping visualize proposals to making and AI content generated coffee book and I know the community will have plenty more great ideas!!
- Potential prop house round for utilizing the tooling?
- Seek out partnerships with these opensource or other organizations to see if they would be interested in collaborating to try and further proliferate the brand!
- I’d LOVE to see us partner with some musicians to work with them to make them free music videos they could post that have Noun glasses in them or have a live show with AI generated visuals featuring Noggles
THE FUTURE OF AI POD:
Hopefully, during these three months, we will be able to not only share significant advancements in AI with the community, but also have a plan for how to take the next steps to grow the AI Pod further. We want to be able to show a path where this could become a self-sustaining effort that could grow and expand to other organizations, opening up a pipeline for monetization. We believe that this is a great opportunity to only grow and expand the Nouns ecosystem but give everyone who is a part of it superpowers that help proliferating the meme!!
TEAM:
- The Hero Shep (Background in AI/Education/Product Management)
- Honk Diddly (Wizard [elite full stack developer])
- Evets.ETH (Wizard [full stack developer])
BUDGET: 164 ETH
- 10% for all related infra (5k/mo)
- 30% for The Hero Shep (20k per month)
- 25% for Honk (15k per month)
- 15% for Evets.ETH (10k per month)
- 20% for Marketing and Community Engagement (Not only compensation for prizes but also to pay people to manage / run the competitions (e.g. prop house, NOC contests) & support other initiatives that arise. )
BUFFER of 15% for volatility - All ETH not used strictly for reasons relating to volatility in ETH price or infra will be added to the Marketing and Community Engagement Funds
This budget will be governed by the members of the AI Pod and controlled by a 2/3 multi-sig.