[Proposal] Ratify the Results of GG18 and Formally Request the Community Multisig Holders to Payout Matching Allocations

[connor]

I want to give a huge shoutout to @umarkhaneth for driving this and everyone else who helped detect Sybils and implement cluster mapping QF.

I am personally very excited about (and bullish on) cluster mapping and other varieties of QF that can effectively dampen collusion and Sybil attacks across the board in an objective fashion. The old cGrants platform had been using pairwise QF for years (a similar modification to cluster mapping, with similar impact/results). This was first tried in GR5, through GR15 (so almost 3 years from 2020 - 2023). We only went back to “traditional QF” for the Alpha and Beta rounds.

Most users probably weren’t even aware of this and there wasn’t a push to publish the match differences between pure QF and pairwise, it was just the method found to work best. Similarly, while I’m glad Umar shared matching calcs for both methods in this case, given it’s the first time it’s being tried, I don’t think it’s productive to publicize all alternatives every round. If we calculated results with pure QF, pairwise, cluster mapping, Sybil or no Sybil squelching, and shared them all to compare, almost everyone would be able to find a scenario where they would get more funding and thus would not be happy.

I do trust the team doing deep data analysis on Sybils, passports, voting patterns, etc, to find and use the best method to prevent collusion across the board (objectively without manual subjective judgments). We should absolutely be as transparent as possible though about the methods used and decisions made, and I believe we’re only getting better in that regard compared to prior rounds.

So all that said, I really appreciate the hard work and hours that went into this from many people, and although not everyone is happy with the outcome, I am in favor of moving forward to a snapshot vote to ratify these results.

[rohit]

@connor

If we calculated results with pure QF, pairwise, cluster mapping, Sybil or no Sybil squelching, and shared them all to compare, almost everyone would be able to find a scenario where they would get more funding and thus would not be happy.

Strongly agree. We should debate and discuss the methods and their trade-offs, along with which ones are suitable for the current scale of Gitcoin Grants and which we should run low-stake experiments for the future. I am certain Cluster-Matching QF too shall outrun its utility at some point, and we will need to keep evolving. Tethering to outcomes of a single round to cherry-pick design choices will add to fragility.

Ideally, I would love to see more feature rounds operating variations of QF (and other allocation mechanisms) and sharing their learnings across the community. However, there is no one allocation mechanism “to rule them all”.

[jayashree]

Hi @umarkhaneth

We at Pollen Buzz Initiative had ‘opted in’ via email for the additional matching funds from Shell on the 21st of August, but we do not see our projects name in the Shell’s matching round results.

[rohit]

@thedevanshmehta

Reduce Quadratic Funding Inequality with a Progressive Tax System · Eric Zhang, Felix Cai, @DoraFactory · Dora Research Blog

I, too, would like to see a less steeper curve. I am not in favor of any form of taxation, yet. This likely deserves a separate thread since it is independent of GG18 results.

My concern with a direct intervention like taxation is that it leaves endemic issues driving inequity unaddressed and dampens the effectiveness of taxation. Moreover, there is a risk that taxation diminishes input signals that are performance-based, such as grantees who show up round after round sharing their impact and raising support from the community will have a disproportionate share of the funding for the right reasons.

Viewing the allocation of the funding pool in the context of respective eligible crowdfunding contributions adds more to the picture. The top 15 projects in the web3 OSS round received a share of 67.5% of eligible contributions and were allocated 70.3% of the funding pool.

However, I would still support the case for a less steeper curve. Here are not-so-exhaustive measures, which if they don’t make a dent, make the case for taxation stronger.

• Improve discoverability of grantees on the platform who may not have as strong a marketing muscle as larger projects (a lot is happening in this direction already, also shameless self plug for AI-driven discoverability is here)

• Find ecosystem partners who can pool funds to run dedicated feature rounds exclusively for smaller projects (based on consensus on definition) similar to opportunities that accelerators and seed-stage funding offer to young start-ups.

• Run QF with weighted votes for subject matter expertise so smaller projects making large strides can see the gains in allocation based on curation from people in-the-know (Token Engineering Commons already did this in a feature round here).

• Integrate with a protocol like Hypercerts where firstly, the proof of impact, and then, evaluations, help divert dollars where the action is (food for thought here)

Unfortunately, none of these are silver bullets that will change things overnight, but I am hopeful that ease of discoverability can make an impact in the near term.

[littertoken]

The funding dashboard & our Grants page showed 990 votes but the final results are showing only 177 base voters. Obvi a pretty big gap. Would appreciate if you can take a look @umarkhaneth - would that be possible?

We can assure you that only 3 people from our community voted, so the vast majority of those votes were from people who genuinely supported our project.

[littertoken]

Our vote is to not ratify this decision yet. We only received credit for 18% of the votes we received and we worked extremely hard on this last Grant round so it’s disheartening for us.

[umarkhaneth]

@rohit

The new algorithm increases the total cost for Sybil attackers and tilts the scale for the system to be “cheaper to defend than attack.” It might be a worthwhile exercise (possibly a prospectively funded project in Citizens Round if anyone is interested) to evaluate if we can lower the requirement for Passport Score in the frontend with cluster-matching QF as an additional rear-guard mechanism to nullify Sybil contributions.

Tipping the scales to make it more expensive to defend than attack is definitely one of the properties we like about it a lot. Down to run this test you mention as well!

@solarpunkmaxi

Just trying to wrap my head around whats happening - Cluster QF filters donors having voted for multiple projects and counts them for QF , so does it also exclude a few donors that projects might have had that have just donated to that single project or that figure needs to cross a certain threshold?

Hey solarpunkmaxi! This can be a little confusing but Cluster QF doesn’t filter any donors out. Instead, it groups together donors who vote identically (who support the same projects and don’t support the same projects) and treats them as a community. Then, each community gets matched instead of each individual.

@solarpunkmaxi

The difference between base and eligible voters represents the no of votes that projects rcvd from donors just voting for that particular project?

Not quite – the difference is due to our sybil squelching. Does this quick diagram help?

[ASTRO-HSU]

This diagram is quite helpful, thanks !

[duckdegen]

We’re at day 5 so in the interest of moving forward I for one vote in favor of ratification of the results.

[duckdegen]

Dear sir, I have made a dune dashboard back in the days, where even my most basic of analysis shows that there are far less donations above 1 USD than the total count.

Please look here:
dune [com] /queries/2946938

Specifically, for your project my dune query tallies 135 donors that gave more than 1USD, but keep in mind that i dont work for gitcoin and my data may be off.
What is evident from this is that there was a huge amount of airdrop farming going on from donors who dusted a bunch of grantees, and sadly the UI reflected this total tally even if it didnt qualify.

I hope that seeing this data will convince you that the problem is not with the matching, rather with the fact that legit donors were far less than what the UI showed.

It is good to keep in mind that the UI’s purpose per se isnt to show filtered, cleaned and refined data, but rather to just show a total of transactions that came in.
Its good to note that this is a process, and tooling will be improved, but ultimately the data was there to look at even from within your recipient wallet, and considering that the criteria of minimum 1 USD was defined from the start this specific outcome could have been seen from the raw data itself.

hope this helps you gain clarity on this topic

[connor]

Hey all, the GG18 ratification snapshot vote is now live!

https://snapshot.org/#/gitcoindao.eth/proposal/0xf4f44efa6c9a2968c8fba8fd664b7ba03a03b876eb033c09dd088d62877eb2fa

Thank you everyone for the thoughtful comments, feedback, and debate in here

[littertoken]

@duckdegen

dune [com] /queries/2946938

Thanks for looking into it. It’s just such a massive drop off that the other top 3 projects (Silvi & Earthist) did not seem to experience (at least not to as severe a degree). It doesn’t make sense that “airdrop farmers” would have chosen to disproportionately focus on our project.

I would also call into question the minimum 1 USD donation criteria. Can someone remind me of the logic behind this criteria? Why should people & projects be penalized for giving less than 1 USD? This is especially relevant for projects like ours that focus on the Global South.

[FractalVisions]

Time to vote … Some amazing discussions have been made above and after observing the results along with the sentiment of participants it appears that a significant improvement can be made to this system.

It’s obvious that the projects with a stronger following on social media from past grant rounds that were successful and who have more capital allocated up front were able to drive donations to their projects with ease in order to achieve the highest ranks possible for matching funds. They have large teams allowing for low effort campaigns which are not intertwined with the rest of the community & seem to be out of touch with the smaller teams and projects who are participating completely.

My commentary suggestion about hosting spaces to highlight other projects to one team I don’t want to mention here was completely ignored on social media when they made a post about how they could help other projects during this last round.

I do NOT see the camaraderie that one another offers when participating in each round in order to help shill it forward for other impact makers in the round.

The competition between the larger projects to overtake the entire round without some sort of system put into place for checks and balances will continue to hinder the overall growth and evolution of the regenerative movement that has sparked the flame of many passionate individuals who have joined Gitcoin.

Meanwhile the projects with low visibility yet have a ton of impactful potential are not able to campaign without putting in a massive amount of effort, energy, and time which could be used for development work during the round.

It is important to keep in mind that the pie will not continue to grow larger if a majority of it is consumed by one entity. The math is simple and plain. No one else will be able to sustain themselves, their projects developments will dwindle, and builders ideas will continue to struggle to survive along with their livelihood. Every last drop of energy put into a project then becomes a waste.
Questions will be made as to why they didn’t do more in between rounds with what little funding they were given from the previous round. Scrutinizing smaller teams during the intake filter is also a concern because they are questioned more heavily than a large establishment is about their proof of impact.

I am curious … Where is the proof of impact threads with onchain data for the biggest projects that have received the most funds in the BETA round?

Do we have any updates from any of the projects that received QF showing their impact onchain ?

[Kronosapiens]

I’ll share a different experience… I’ve self-funded my project for the last three years, and submitted it for a grant hoping to get a little funding to help offset the costs. The project doesn’t have a huge community or a lot of marketing capacity, but based on the organic traffic to the GG18 round alone I was able to raise a very meaningful amount of money.

While I can’t speak to what extent large active communities and coordinated marketing efforts may have allowed some projects to secure significant grants in the round, I can say that at least in my case the process worked as intended, where organic traffic chose to support a project that seemed promising.

[jon-spark-eco]

First, I want to give a big thanks to @umarkhaneth and the rest of the team who worked tirelessly to evaluate GG18. I believe the new tools you deployed along with utilizing cluster matching provided solid results and I have voted to ratify them.

@littertoken

Thanks for looking into it. It’s just such a massive drop off that the other top 3 projects (Silvi & Earthist) did not seem to experience (at least not to as severe a degree). It doesn’t make sense that “airdrop farmers” would have chosen to disproportionately focus on our project.

I would also call into question the minimum 1 USD donation criteria. Can someone remind me of the logic behind this criteria? Why should people & projects be penalized for giving less than 1 USD? This is especially relevant for projects like ours that focus on the Global South.

In watching the round progress Silvi & Earthist received support earlier in the round, and then your project gained significant donations a bit later. This would lead me to believe that your donors were different donors than the other two projects. This is likely why they were squelched less than you, as their donors had different behaviors. Most of the donations your project received were less than $1, which is often an indication of a sybil attack or airdrop farming (though I am not suggesting it was you or your community that attacked). Since the Red team is not transparent about what they do and why they do it, I cannot tell you why your project was chosen by these donors.

Regarding the $1 minimum, this is another sybil protection. Our goal is always to make it more expensive for the Red team to attack and cheaper for us the Blue team to defend. This minimum allows us to remove some of the sybil attackers or airdrop farmers from the start because it forces them to pay more for their vote to count towards matching. I do hear you with regard to communities in the global south that this can be a gating factor. As our passport system continues to improve there may be a point where we can rely more on it and remove this barrier. For now this has been a part of our criteria for many rounds.

@FractalVisions

The competition between the larger projects to overtake the entire round without some sort of system put into place for checks and balances will continue to hinder the overall growth and evolution of the regenerative movement that has sparked the flame of many passionate individuals who have joined Gitcoin.

Since you participated in the Community & Education round, I will speak specifically about that round though some of what I write may apply to other rounds. In this round that focuses on community, I would say the objective of the projects in this round is to grow community, educate community or be a resource to community, and if the project is successful, that community will fund what matters to them during a round. I would also say that several of the top projects are run by small teams. The fact that they are at the top tells me they are fulfilling the objective of projects in the round (grow community, educate community or be a resource to community).

On the flip side, it is difficult for QF mechanisms not to become popularity contests, and I think that may be what you are pointing at. I think cluster matching helps with this but does not completely solve it. In that respect, you are right the system will continue to evolve to be fairer over time. Even the authors of the cluster matching research paper do not believe this is the final evolution of this funding mechanism.

@FractalVisions

It is important to keep in mind that the pie will not continue to grow larger if a majority of it is consumed by one entity. The math is simple and plain. No one else will be able to sustain themselves, their projects developments will dwindle, and builders ideas will continue to struggle to survive along with their livelihood.

To this point, the round has a 6% matching cap, so a project can’t earn more than 6% of the pie or $15k. If you assume these projects participate quarterly, that is $60k to support a project that, for most projects, is not sustainable and likely doesn’t support their livelihood. We could reduce the %, but given the size of the matching pool, I am not sure that would be the right direction to go if we want to fund what matters to the community. We could make the eligibility requirements stricter, but I suspect this would not make the community happy. In general, it isn’t easy running a grants program, and in the end, you can never make everyone happy.

@FractalVisions

I am curious … Where is the proof of impact threads with onchain data for the biggest projects that have received the most funds in the BETA round?

Impact is clearly an area where all of web3 is struggling. It is something we are always discussing internally, and something I am passionate about and working on outside of gitcoin. We hope to see more review and impact tools emerge to track impact on-chain. For now, I would suggest that of the top 5 projects in the community round, I think there is likely significant on-chain activity to back up the work they are doing, but I leave it to you to do that research.

[cyrusclarke]

I appreciate the thinking and work around cluster matching. But seeing the length of replies to this idea brings me to 2 very succinct points:

1. Isn’t this adding even more to the issue of “over-engineering the solution to the problem” which Gitcoin seems to be obsessed with i.e. preventing Sybil vs. just encouraging more donations/votes?

2. Why wasn’t this communicated before the round so that voters knew the rules of the game? Retroactively doing just punishes projects who encouraged people to get out and vote/donate for them.

I would not vote to ratify this result mostly based on point 2 and request further deliberation.
I would also encourage more discussion about where attention is placed based on 1.

[FractalVisions]

@jon-spark-eco

On the flip side, it is difficult for QF mechanisms not to become popularity contests, and I think that may be what you are pointing at.

Jon thanks for taking your time to respond to us today. Yes. I think it’s a positive sign to see the space that was held today with security experts who were joining together.
That was a great example of how the energy can be laser focused on initiatives and security is definitely number one.

@jon-spark-eco

We could make the eligibility requirements stricter, but I suspect this would not make the community happy. In general, it isn’t easy running a grants program, and in the end, you can never make everyone happy.

On this note I definitely understand what you mean & respect everyone for their hard work during or in between rounds. It’s truly amazing. I assume the passport is constantly being improved upon for matching fund eligibility slowly over the course of the future.

Has there been any proposals from projects that have offered to pay back a portion of their donations into the matching pools at the end of the round if they received “x” amount of funding in round ? This is an idea that I think would be interesting to experiment with if builders who are heavily committed to the grants stack are also willing to turn around and help spread the distribution more evenly.

Dashboards for analytics research are great a way for anyone to learn more about blockchain in general. We will do our best to add value to the GTC ecosystem by doing our own research.

[PouPou]

Thank you, @umarkhaneth, and the entire team for your efforts and for providing clarity. Would it be possible for you to add a column indicating the initial number of votes?
From my rapid calculations based on the OSS round data, it appears that 58% of the base votes were not considered. How much does this compare to previous rounds?

@ale.k

Overall though- I support ratifying these results. In line with expectations and past rounds’ sybil-rates.

In my opinion, these numbers are staggering. Additionally, considering that 73% didn’t surpass the passport score, how many total voters and votes does this account for? It seems that fewer than a third of the votes are getting counted. Is that an accurate estimation? Does this also represent a third of the unique voters?

I also have some questions regarding the cluster QF. Do you consolidate votes from a single donor before the clustering process? For instance, if a donor votes multiple times within a round, are all their donations counted as one? If this isn’t the case, I imagine the results might vary, especially as voters familiarize themselves with new projects and subsequently vote for them during the round.

[robioreefeco]

Thank you for all the people and contributors that made this possible!!

[Yoshi420]

I love the concept but have multiple concerns. Does the product have any potential risk for labeling people on the spectrum as bots? We tend to be more robotic in our movements.
Does the product have issues with IPhone? I’ve struggled to get it to work, it won’t recognize my social media, or Google I’m not getting credit for much of any activity on the chain. It’s disappointing.