Leveraging Bayesian Truth Serum to Reward Correct Contrarians
Last updated
The Opinion Markets within Olas serve as a platform where contributors offer diverse opinions and predictions on various subjects. The great weakness of traditional prediction markets in this sector is that bettors are more incentivised to bet on what they believe the majority believes to be true rather than what they know to be true themselves. This biases outcomes to popularly held but incorrect beliefs.
The Bayesian Truth Serum (BTS) algorithm was specifically designed to remedy this bias. Olas employs this algorithm via the article tipping/commenting system and implements a specially designed market on top of it to reward contrarians that believe they hold correct but unpopular beliefs. If it turns out that there are others that share this position in greater numbers than alternative possibilities - the market will provide a signal to everyone else that this 'surprisingly popular' answer is likely to be the most insightful.
The BTS algorithm works using on a dual-questioning approach, pairing factual queries with predictions of popular opinions.
Here is an overview of how the opinion markets work:
Each opinion piece poses a factual question (Q) paired with a popular opinion question (P) related to the topic ( Question Formulation ). Tippers respond to question Q and P with tips and voice their opinions. BTS evaluates discrepancies between responses to Q and P, identifying the Surprisingly Popular Answer (SPA).
Discrepancy in the BTS Method:
In the context of the BTS methodology within Olas, the discrepancy represents the difference or variance between two sets of responses. The discrepancy calculation involves comparing the percentage of participants who responded to the factual question (either "Yes" or "No") with the percentage of participants who predicted what they believe most people will respond to the same question.
Example:
If 60% of participants responded "Yes" to the factual question, but 70% predicted that most people would respond "Yes," the discrepancy for "Yes" would be -10% (60% - 70% = -10%).
Similarly, if 40% responded "No" to the factual question, but 30% predicted that most people would respond "No," the discrepancy for "No" would be +10% (40% - 30% = +10%).
The discrepancies highlight the difference between participants' actual responses and their predictions regarding the collective opinion. This variance is crucial in identifying the SPA, which is the response with the larger discrepancy, as it signifies an unexpected or contrary view compared to popular expectation.
Market Outcome:
Once the market is settled, there can be 2 outcomes - Popular Answer (PA) or Surprisingly Popular Answer (SPA). PA occurs when there are not enough contrarian opinions on the other hand SPA happens when there are enough contrarian opinions.
In the both the cases, the Content Contributor is paid a payout depending on where the market stands (i.e. market share on writer's side).
Payout Mechanisms
Deciding Market Outcome
Once market expires and is ready to settle, we calculate the SPA strength (s) and dynamic threshold (t) to determine if an SPA exists or not.
Discrepancy Calculation:
Dy=Qy−Py
Dy= Discrepancy for YES response
Qyis the percentage of participants who voted "YES" for Q
Py is the percentage of participants who voted "YES" for P
Dn=Qn−PnDn= Discrepancy for NO response
Qn is the percentage of participants who voted "NO" for Q
Pn is the percentage of participants who voted "NO" for P
Spread(X%)=∣Dy∣+∣Dn∣
Spread (X%) is the sum of the absolute value of discrepancy for Yes and the absolute value of discrepancy for No.
Dynamic Threshold (t)
Dynamic Threshold is a percentage value which helps us decide if an SPA exists or not. It is calculated using a logarithmic graph which takes into account the total number of participants in the market.
t(n)=⎩⎨⎧186+12⋅(1−(ln(500)ln(n/10))0.4)6 if n≤10 if 10<n<5000 if n≥5000Where:∙n is the sample size∙t(n) is the threshold percentage of total votes required∙ln is the natural logarithm
When does the market resolve to an outcome of SPA ?
If the SPA spread ratio (X%) exists with a strength of greater than or equal to dynamic threshold (t), we say that SPA exists.
if(X≥t)SPA existswhere:∙ X is the SPA spread ratios∙t is dynamic threshold
Surprisingly Popular Answer (SPA) Payout Mechanism
SPA Strength (s)
SPA Strength (s) is SPA spread (X%) capped to a limit of t to 2.5t.
s(X,t)=min(2.5⋅t,max(t,X))where:∙t is the threshold∙X is the SPA spread
SPA Influence (i)
This is what decides how much of an influence SPA has on the market, it ranges from 0 to 1. 0 being 0% influence of SPA and 1 being 100% influence of SPA on the market.
i(s,t)=(s−t)/1.5twhere:∙ 0 ≤ i ≤ 1 ∙s is the SPA strength∙t is the SPA threshold percentage
Curvature Factor (c)
Decides the curvature of the curve
c=0.7⋅iwhere:0 ≤ c ≤ 0.7
SPA Payout Percentage
This function takes into account the influence (i) (which is calculated using the SPA strength and threshold), the market share from writer's perspective and the curvature (decided via the influence) to come up with a percentage value that dictates how we payout the Content Contributor.
f(x,t,s)=⎩⎨⎧0.5+0.5⋅i0.5+0.5⋅i⋅(1−(0.45x)1−c1)0.50.5−0.5⋅i⋅(1−(1−0.45x−0.55)1−c1)0.5⋅(1−i)if x=0if 0<x<0.45if 0.45≤x≤0.55if 0.55<x<1if x=1where:∙x is the market share from writer’s perspective∙ i is the SPA influence on market payout∙c is the curvature
SPA Payout
Pspa=f(x,t,s)⋅(T+S)where:∙f is the SPA Payout percentage∙x is the market share from writer’s perspective∙T is the total tips received∙S is the writer’s original stake
When does the market resolve to an outcome of PA?
if(X<t) PA existswhere:∙ X is the SPA spread ratio∙t is dynamic threshold
Popular Answer (PA) Payout Mechanism
Parameters:Constants:∙x∙T∙Smin∙Smax∙S∙r∙clow∙chigh∙p∙α∙m∙kMarket ShareTotal TipsMinimum StakeMaximum StakeStake AmountReputation Score=0.85=0.65=0.3=0.7=0.03=1(0≤x≤1)(0-100)(Curvature for 0≤x<0.45)(Curvature for 0.55<x≤1)(Stake power)(Low stake penalty factor)(Middle curvature)(High performance multiplier factor)
PA Payout
We calculate the payout for popular answer by using a base curve which is influenced by various multipliers and penalties explained below.
Base Payout B(x)
This determines the base curve for the popular answer payout mechanism.
Participant Alignment: When a participant's response aligns with the Surprisingly Popular Answer (SPA) for the factual question (Q).
Content Contributor Alignment: Indicates alignment when a content contributor's stance in the opinion piece aligns with either the Popular Answer or Surprisingly Popular Answer.
Olas Global Pool Fee
Any amount from Total Tips or Content Contributor's Stake not going to the Writer goes to the Olas Global Pool to fund better opinions in the future.