TL;DR
FDD as a workstream is dissolving after Season 17, but the need for fraud detection and prevention services is far from done.
- S17 Budget is almost $10k lower than Season 16
- FDD is not requesting any reserves as this is the last season for us as a workstream
- The Contributor Transition process has already started partially with an intention for clear transfer roles after EthDenver
- Embedding fraud & data analyst/science knowledge and expertise across the workstreams will help the DAO realize the value of trust & risk management as well as increase awareness for fast-paced, data-driven “build-measure-learn” culture
- Open Data Community continues data infrastructure innovation with hackathons and provides data transparency, provenance, and reproducibility for algorithmic policy decisions
3 key themes this season:
- Continued Trust in Gitcoin’s Ability to Prevent Fraud
- Empowering the DAO with Open Data Infrastructure & Processes
- FDD Workstream Dissolution Success
Amount
FDD is requesting $123,694 from the treasury to complete a budget of $340,314 for S17. A breakdown of the budget can be found at the end of this document.
Gitcoin Season | Season 15 | Season 16 | Season 17 |
---|---|---|---|
Season Budget | $349,500 | $349,500 | $340,314 |
Season Reserves | $233,000 | $172,615 | $216,620 1* |
Unspent Reserves % | 100% | 100% | 100% |
Treasury Request USD | $362,500 | $409,885 | $123,694 2** |
1*) FDD received $233,000 in reserves which were requested at a GTC price of $1.65 in S15. These were received in January at a GTC price of $1.37 making the received total of $193,461. 60% was converted to stables ($116,077) leaving a 40% exposure of GTC to upward price movement from $1.37 to $1.78 ($77,384 to $100,543) leaving a total of $216,620 in unspent reserves
2**) Since FDD intends to dissolve as a workstream, we will request the full season budget less 100% rolled over reserves from S16. The amount of GTC requested and the value of the reserves will be adjusted based on the current market value at the time this proposal is moved to Tally using the lower of the current price or the 20 day moving average, whichever is lower.
Milestone Report S16
Season 16 has been a very dynamic and the most unusual season for us. We set out with likely projects (S16 budget request) and needed to respond to the changing circumstances of the DAO during the season. The changes include the decision not to host GR16 in December, to deprecate the cGrants product, the decision by GPC/PGF that sybil defense services wouldn’t be needed during UNICEF/Fantom/Alpha rounds, and subsequent findings that these did indeed need services.
Our assessment on what we completed and why can be found here: Miro | Online Whiteboard for Visual Collaboration
Objectives Past Season | Initiative / Outcome | Key Result |
---|---|---|
Continuous analysis & validation of passport scores made available for round owners & technical users in partnership with the Passport team. | Everything the Passport team asked for was delivered on time and extra work was done | * Created 4 scores including the one in use for Alpha rounds and Passport Scoring as a Service * Built a passport scoring application mvp * Delivered stamp topology research and stamp prioritization requests |
Build reliable composable, open source software tools for round owners to prevent fraud. | Documentation and understanding were massively improved, but actual building was slower than expected. Results of hackathon could make this green. | * Designed a user interface for legos to be used by an fdd fraud consultant & eventually a round owner * 5 Packages wallet legos in FDD github * Created documentation for the person of a fraud consultant or round operator * Created & updated readme files for all legos and applications and general getting started * Created FAQ for Open Data Community to build and interact with legos * Posted 3 articles discussing Sybil Scoring Legos * Building custom aura implementation for gitcoin grants and an gitcoin/fdd team to participate |
To empower a regen data community with infrastructure, tools, and shared learnings which provides 50% of impactful insights into optimal capital allocation using Gitcoin grants. | Community growth and participation were a huge success with non-gitcoin community members driving many efforts. | * Enabled the community led curation of data sources for quality and usefulness. * Collaboratively authored the landscape of useful tools and guides for Open Data Community. * Catalyzed & lead creation of a platform to host the open data community including collaboration about tools, data sources and methodologies especially non-gitcoin participation documentation & bounties to create new analysis and turn validated analysis into legos * Over 100 in Discord with 6 active (non-fdd) contributors on Github * Built a public facing data & research hub with all past grant round datasets with FDD |
Find a sustainable strategy to engage ODC members and contributors to service decentralized grants rounds & maintain quality processes. | While we lowered the % of ODC costs which Gitcoin pays, we did not establish governance to run a grants round yet. This is partly because the protocol wasn’t ready this season. | * Doubled prize total from $19k to $40k while Gitcoin/FDD is only paying 39% of it! (paid 100% last round) * Added 6 sponsor orgs * Contests hosted for unicef, fantom, and gitcoin alpha * One previous hackathon participant was funded and returned as a Sponsor to the 2nd hackathon - They also provided services to the Fantom round outside of the hackathon. |
Continuously iterate, test & innovate on algorithmic solution quality and availability. | We deprioritized much of the grant eligibility work due to the decision to have closed alpha rounds, but had multiple useful outputs from FDD research. | * Bankless & Snapshot Analysis leading to 6 new legos * Created a topology of stamps with recommendations * Designed Cost of Forgery stamp weighting model * Trial use of rhaphorty open source graphdb for graph analysis * Building custom aura implementation for gitcoin grants and an gitcoin/fdd team to participate * cadCAD round simulator - can be used to find optimality gap analysis and optimal red team strategies * Design workflow pipelines for legos from ideation or behavioral observation through building |
The right work gets done and the tools and access needed to do it is in order. We build plans for the future | The lego process was more difficult to scope and start but now since it is going it is moving well, we worked through many models for the future, but ended up needing the last week of the season to realize dissolution was the best answer. | * Created a custom moloch DAO (on testnet) for a multisig allowing for true decentralization and potential spin out capability while separating Gitcoin funds to NOT be accessible by a ragequit * Analyzed at all past FDD contributors pay, membership status, and contribution weeks to design a share splitting model * Received a grant for sybil study of Aave onchain activity which overlaps with needs for Gitcoin * Posted 5 FDD review articles * Taught and/or transferred responsibility to Tigress treasury management and how to pay contributors |
Legend
Success
Incomplete, will hit goal or priority change
Incomplete, will not hit goal
Canceled - out of workstream’s control
Moving to a Protocol Future
The launch of the Allo Protocol will shift the needs of the Gitcoin community away from the historic goals of the Fraud Detection and Defense workstream.
In pivoting into a new structure, FDD is preparing to support the break out into smaller and more end-to-end accountable workstreams, without sacrificing the unified intention of the FDD: fraud defense, risk mitigation, and trust building.
These smaller functional units eliminate any “I have 2 bosses” conflicts of interest. Individuals safe-guarding risk and trust priorities are embedded in end-to-end accountable working groups.
The core promise of the Fraud Detection & Defense workstream has been providing legitimacy & trust to the outcomes of Gitcoin’s quadratic funding rounds. This has been done by keeping quadratic funding rounds free from stolen and misallocated funds caused by sybil attacks and illegitimate grants. The continued improvement of our ability for clients using Passport & Allo protocols the ability to access and share this trust with their communities belongs as a function that is accountable with the program, product or engineering teams providing the trust.
These functions of the current “centralized” organizational FDD structure will have moved over to other end-to-end accountable workstreams by the course of Season 17 to better reflect the future structure desired by stewards & Gitcoin leadership. We anticipate beginning to make these operational changes gradually with clear accountability shifts only happening after EthDenver, concurrently with the GPC workstream splitting into Passport & Allo streams. These changes are being made with the prior consent and partnership of the other workstreams involved.
This last season FDD has 3 key themes:
Continued Trust in Gitcoin’s Ability to Prevent Fraud: Data informed recommendations to mitigate fraud are made continuously available.
- Fantom & Gitcoin Alpha Round Recommendations
- A Scalable Mitigation Sybil Solution Exists
- Sybil Defense Innovation & Insights Continue after FDD
- Passport has Analysis & Data Science Support
- Recommendations to Correct Web2 Vulnerabilities are Followed Through
Empowering the DAO with Open Data, Infrastructure, & Processes: Data processes & pipelines are reliably available & maintained.
- An On-chain Data Extraction Solutions that Meets the Needs of Real-Time Anomaly Detection
- Open and Decentralized Data Repository for the Community
- Gitcoin Analytic DB & Query Interface
FDD Workstream Dissolution Success: FDD contributors and work is smoothly transitioned and/or shut down.
- Successful Transition of Contributors
- Clearly Documented Closing of Accounts & Obligations
- A Proposal for a Ratified Process to Spin-Out “Investible Workstreams”
List of S17 Outcomes
Continued Trust in Gitcoin’s Ability to Prevent Fraud
Outcome Description | Essential Intent Connection | Likely Projects/Tasks |
---|---|---|
“What outcome or impact will we see?” | “How does this align with our most important work?” | “What will the work likely look like?” |
Final recommendations are provided to the Fantom & Gitcoin Alpha rounds | Programs Growth |
Data extraction & cleaning Computation of all sybil scoring legos available Analysis of potential fraudulent behavior is drafted Final recommendations for retroactive Sybil discounting |
The tools & processes for a scalable sybil mitigation solution is available for program managers during the beta rounds. | Programs Growth |
Conduct historical analysis Design dashboard essentials & highest impact visualizations Finish building a round dashboard MVP Earn consensus on policy shifts as needed Collect user feedback on round dashboards “Trusted Vendor” process solidified Monitor April rounds and define opportunities for improvement |
A flywheel of insight and innovation in sybil defense brings continued innovation & insights from the Open Data Community which reduces sybil behavior and improves Program Manager feedback. | Financial Sustainability | Insights are documented and included in fraud runbooks Analyze ODC 2nd Hackathon submissions (e.g. www.grantlooker.xyz) and use potentially good submissions as inspiration for the further development Builds are documented in Github for future use Lowercost of iterative innovation for data infrastructure & innovation from the FDD workstream budget to bounties & membership costs. ODC synthesizes learnings from the first three hackathons and provides documentation towards data standards and good practices in ongoing resource updates, useful to Gitcoin and the entire web3 community. Freshly built legos get tested and applied to beta rounds Testing reports including metrics on fraud tax are written in co-creation (ODC, Gitcoin Fraud Analyst) and shared with Gitcoin’s product & engineering teams. |
Passport is supported with analysis & data science needs as they work to hire a new data analyst/scientist. | Protocols Passport |
Assistance in hiring and training of a data scientist to join the GPC workstream in S18 Updated score is provided Retraining schedule is created for PSaaS Update & adjust weighting before next season Testing reports including metrics on fraud tax are written in co-creation (ODC, Gitcoin Fraud Analyst) and shared with Gitcoin’s product & engineering teams. In case of success, stakeholders discuss how and when to implement legos. |
Recommendations to correct web 2 vulnerabilities are made to respective product units. | Protocols | Define Opportunities & additional data pull needs Monitor Google Analytics events during alpha round & analysis Get feedback on recommendations Correct web 2 vulnerabilities Monitor core metrics for change with implementation |
Empowering the DAO with Open Fraud Data, Infrastructure & Processes
Outcome Description | Essential Intent Connection | Likely Projects/Tasks |
---|---|---|
“What outcome or impact will we see?” | “How does this align with our most important work?” | “What will the work likely look like?” |
An on-chain data extraction solution is developed providing speed, transparency, reliability, cost efficiency, and auditability gains. | Programs | Settle on tech stack Erigon archival node for ethereum chain data Trueblocks node with custom Chifra Server Define core heuristics Share with partners for testing Define contract/protocol anomalies Set up a Service Leasing Agreement (SLA) with Open Data Community to run the Gitcoin Open Data Stack Begin serving up chain data via Rounds Dashboard & GitcoinDB |
An open & decentralized data repository with all round data is consistently updated for the entire Gitcoin community. | Programs Growth |
Discovering scope of repository project in co-creation with Gitcoin Builds an MVP similar to the fddhub.io but hosted by the open data community and updated with new round data To ensure continued support and availability a service agreement for continued data infrastructure support is defined and agreed upon between Open Data Community and Gitcoin. |
A Gitcoin Analytic DB & query environment empowers analysts across all of GitcoinDAO to become more data driven | DB design discovery - Tech stack / tooling research Continue build in progress Metric discovery in partnership with all workstreams Financial Dashboards w/ DAOops Partnership health w/ PGF Partnerships Product Goals w/ Allo & Passport DevRel Goals w/ DevRel User Activity w/ MMM Modeling for GTC utility to design a more costly to attack than defend system Solve hosting questions - gain home for SaaS charges Begin surfacing key on-chain signals in query environment |
FDD Workstream Dissolution Success
Outcome Description | Essential Intent Connection | Likely Projects/Tasks |
---|---|---|
“What outcome or impact will we see?” | “How does this align with our most important work?” | “What will the work likely look like?” |
Successful transition of contributors with offered and accepted roles to other workstreams allows the completion of FDD work and the smooth assimilation to new roles. | DAO Organization | Transfers are communicated with other workstream leads, introductions are made, and formal transition dates & compensation agreements are set. Data Analyst > Allo Fraud Analyst > Program Readiness (PGF) Data Analyst hiring support > Passport Other TBD = Data Engineering, Technical Writer, Financial Analyst Successful handover: FDD work is either completed or transitioned to new workstreams |
Clearly documented accounting winddown of all FDD wallets and financial obligations. | DAO Organization | All FDD multisig wallets are closed Severance is paid where necessary Exit interviews are conducted in partnership with DAOops Transparent budget is available for review w/ audit |
Proposal to create a CSDO-ratified process for spinning out “investable workstreams” exists to help Gitcoin avoid the “services trap”. | Financial Sustainability | In cooperation with DAOops create a positive sum model / process for de-risked, legally viable, and minimally disruptive investible spinout of workstreams. Discovery around unanswered or uncertain aspects of workstream dissolution is conducted leading to ratified solutions which are safe to try. Recommend a “spinout architecture” including literature research on legal wrappers and tech solutions Craft a “spinout process” to transfer ownership and funds |
Budget Breakdown
The FDD Season 17 budget is almost $10k lower than Season 16. Additionally we will not be requesting reserves for S17.
Budget Category | Description | Amount USD |
---|---|---|
7 Core Contributors | WS Leads Product / Strategy (Joe) Operations (Tigress) Full Time Contributors Data Scientist (Omni) Sr. Fraud Detection Analyst (Alex) Data/DevOps Engineer (Zen) Data Analyst (Bella) OpenData Community Project Lead (EPowell) |
$241,639 |
3 Trusted Contributors | FDD Review & Science SME (J-Cook) Data Analyst (Adebola) Analyst (Sorana) |
$27,300 |
2 Regular Contributors | Software Engineers (Eric & Yogeesh) | $24,375 |
Open Data Hackathon | Bounties / Prizes | $30,000 |
SaaS, Fees, etc. | $3,000 | |
Travel & other expenses*) | $14,000 | |
Other Bounties | $0 | |
Total | $340,314 |
*) Includes Gitcoin Retreat, EthDenver or similar events & travel reimbursements.
Footnotes in Conclusion and Looking Forward
With the DAO Data-related outcomes described above, we intend to provide data insights for protocol-based and transparent DAO operations. We have the skills and the opportunity to codify certain best practices. We also believe past learnings from best-in-class sybil defense have led to several key opportunities for automation, tooling, and experimentation.
As we prepare to better utilize data for FDD aims, we see a necessity of building out the data capacities of the whole DAO alongside us, and it no longer seems efficient for FDD’s data resources to operate in silo.
Can Gitcoin be the new, more secure, and more trusted GoFundMe? Can we correct the issues inherent in early web2 projects like Kickstarter & co? We believe so. But to be ready for the new challenges which come from a wider audience, we have to invest in tooling and the necessary infrastructure now in order to carry out the promise inherent in an on-chain, trustless grants system.
It is, of course, the case that Gitcoin is not alone in these essential needs to secure our protocol and protect our governance practices. We have heard repeatedly from our partners – new and long-standing – that it is necessary for other DAOs in the ecosystem to have the tools and the knowledge available to protect their own environments. Because of the growing demand for such services, it is thought to be well-validated that the DAOs Growth unit can spinout and begin seeking payment for more generalized “trust-as-a-service” as an a la carte consulting product, as well as providing this service which can be added to the most vulnerable grants rounds ad hoc.
Authors of this Document
Section | Author(s) |
---|---|
Milestone Report | Joe |
TL;DR | Joe |
FDD Outcomes | Joe in collaboration with Stewards and FDD contributors |
Amount, Budget Breakdown | Tigress with support from Joe |
Footnotes in Conclusion and Looking Forward | Alex |