Close

    • Dark Prophecies Balance 101



      Howdy Shadow Era peoples! Mojumbo here today to tell you all about the balancing of our new expansion set Dark Prophecies. In particular, I’m going to focus on how we go about making balance decisions based off tracking win rates, tracking card usage stats, and playing/watching games. Expect to learn a few interesting factoids from this article!

      Live Server Stats

      First off, to get an idea of how balanced a given metagame is we need to keep track of all of the heroes’ win rates. Of course, we track how often the heroes are being used as well so we can determine which heroes are very popular and which ones aren’t as popular. For example, Eladwen is currently the most popular hero as she represents 10% of games played. She currently holds a win rate of 51%.

      Now it’s great to know that the most popular hero is only winning 51% of the time but there is more useful data we can extract out of this data to make it even more meaningful. For instance, we can determine Eladwen’s win rate both going first and going second: Eladwen wins 52% of the time going first and 49% of the time going second. The fact Eladwen wins 3% more going first than going second does imply a minor advantage to going first (but 3% isn’t too bad still) but we can then design cards like Layarian Seductress that offer an advantage when you’re going second over going first.

      After we have determined the heroes’ overall win rates we then break it down hero by hero. For example, our live server stats suggest that Eladwen’s best matchup is against Elementalis and her worst matchup is against Amber. Using this data, we could determine that Eladwen needs tools in the near future to help out against Amber’s big weapons and likewise Elementalis may need tools to better fight off Eladwen’s mage prowess.

      Here are some interesting factoids about Dark Prophecies balance:
      • We strive to have every hero producing a 50% win rate +/- 5% (between 45-55%).
      • No hero is currently holding a win rate of 55% or higher.
      • First turn advantage generally amounts to a difference of 2-3% higher win rate going first.
      • In terms of games played, the hero pool is quite diverse in this metagame.
      • The stats don’t include games where people leave too early (where you gain no gold or xp).
      • The average time for a game across all heroes is between 11-14 minutes.

      Card Usage Stats

      Naturally, balance goes further than just looking at individual hero win rates. We also have to look at the popularity of individual cards. To do this we look at how often a specific card was used when it was legal for it to be in a deck. After that we determine how many copies of the card were being used. For example, we could determine that Ley Line Nexus is really popular as a 2-of in your deck whereas a card like Ironhide Karash is really popular as a 4-of in your deck.

      This data is important because it helps determine why some heroes are producing high win rates and also validates the feedback we receive from the community. If a card is rarely being used but is being considered overpowered by a few then it likely needs more active coverage. If a card is being used heavily and is being considered overpowered consistently, then it probably is.

      Here are some interesting factoids about Dark Prophecies card usage:
      Aldon the Brave is currently the most used card
      • Cloak of obscurity is current the least used card

      Balance Testing

      Stats can only take you so far. After we have run the numbers it’s time for us to get testing. Testing can both mean playing the game or watching replays of other players playing. The Player Focus Group (PFG) is invaluable when it comes to generating lots of highly skilled replays to watch so we can determine how powerful a card is (or isn’t) when it is used correctly. From there, we can make the necessary nerfs/buffs as required.

      It is only after we have live server stats, card usage stats, and have done the requisite balance testing that we can make informed decisions to change cards on the live server. We are happy with how Dark Prophecies has turned out from a balance perspective and hope you are too! There are lots of new powerful cards and combinations that will allow you to make new decks that weren’t quite viable during Call of the Crystals.

      Well that does it for my look at Dark Prophecies balance. Hope you enjoyed the article, good luck in your games, and make sure you have fun! This is Mojumbo signing out.


      This article was originally published in forum thread: Dark Prophecies Balance 101 started by Mojumbo
      View original post
      Comments 80 Comments
      1. Ballyworld -
        Quote Originally Posted by Rayzie View Post
        So you said that no hero has a win rate of >55%, but do any heroes (not naming names) have a <45% win rate?
        Quote Originally Posted by Drakkon View Post
        This was my question
        And mine as well, we don't need to know the hero, but if there is one <45 it would mean that Balance adjustments are on-going....
      1. Melph's Avatar
        Melph -
        Quote Originally Posted by pyrogene View Post
        Hmm... so no differentiation when looking at stats for different ranking sub-groups? I do believe there would be a significant difference in these stats if you look at say, 300+ only games. And it might be more meaningful to look at game balance for more "competitive" players rather than the entire player group.
        I was wondering the same thing. Powerlevel need to be evaluated at a competitive level. If a hero isn't played in the 300 rating that's saying someting about the power level of cards available to that hero.
      1. SamuelJ's Avatar
        SamuelJ -
        It's statistics, there will always be errors...
      1. roustabout's Avatar
        roustabout -
        Think about it this way: If Elad has a 3% fta across all matchups by all players in the game, that just means that that 3% should be viewed as a remarkably high number (in context).

        There are two items in question here: the statistic and the interpretation of that statistic. No one care's about the statistic per se; it is only once one makes the interpretive leap to "power level". What we care about is how much more powerful is elad when going first as compared to her power going second.

        3% sounds like a small number, and a small number makes it seem like elad's the power difference is also small. However, power level is a potentiality, whereas the statistics are actual outcomes. But the gap between power potential and actual results can be quite large. It is consistent to say that elad is massively more powerful when going first vs. when going second while also saying that she only wins, overall, slightly more often when going first. Why? There are at least 3 factors. A less skilled player with a great deck can waste potential power by misplaying. A skilled player with a poorly constructed or experimental deck can lack opportunities to take advantage of potential power on account of card choices (i.e. elad with all neutral support abilities will have a 0% win rate, but this does not meant that her power level is any less). And finally, a skilled player with a well designed deck can fall prey to bad luck in draws.

        So there are many factors that mask a hero's power level. One could interpret the fact of 3% fta by admitting that this number is low but interpreting it's lowness as a testament to how much of elad's potential power (with fta) is wasted. Looking at it the other way, we might say that although 3% sounds like a low number it is actually incredibly high given that her fta is still 3% after so much of her potential power is wasted suggests.

        A true judgment on power level is only available statistically if you assume you have players of perfect skill with perfectly constructed decks playing against one another for enough games to make an adequate sample size. Then, if you measure win rates, the interpretive element of statistics is reduced to a minimum.
      1. roustabout's Avatar
        roustabout -
        On a tangential note: does anyone else get the feeling that baduruu might be the only hero who actually has a SECOND turn advantage? My stats and my in game experiences seem to suggest that this is true. And I speculate that this is because putting a bow in play on t4 is much more game-altering than on t5 combined with the fact that baduruu's ability costs a card which is relatively more expensive when one goes first and starts with one less card to begin with.
      1. pyrogene's Avatar
        pyrogene -
        No reply by Mojumbo on this.
      1. Gondorian's Avatar
        Gondorian -
        Quote Originally Posted by pyrogene View Post
        No reply by Mojumbo on this.
        If by "this" you mean the question on average rating, that's a Kyle question.
      1. pyrogene's Avatar
        pyrogene -
        Quote Originally Posted by Gondorian View Post
        If by "this" you mean the question on average rating, that's a Kyle question.
        No, was referring to basically this entire thread and the discussion it spawned.
      1. Gondorian's Avatar
        Gondorian -
        Quote Originally Posted by pyrogene View Post
        No, was referring to basically this entire thread and the discussion it spawned.
        OK. The general approach we try to follow is to let you guys discuss things yourselves rather than have us weigh in too often, other than to clarify things, which I did a few pages back.

        That's most likely why Mojumbo hasn't replied here. But if you have a specific question for him, now that the discussion has died down, post it here and hopefully you'll get a reply.

        By the way, we have stats just for high rating, and they are very similar to the overall ones.
      1. pyrogene's Avatar
        pyrogene -
        Hmm, ok. I guess the main questions from this thread would be:

        1. Is it better in his opinion (and also what is currently being done) to look at stats for the entire player base or only for higher ranking players for balance decisions?

        2. Are there differences in stats between subsections of players with different rating? Specifics would be nice but I understand if some data cannot be revealed.

        3. It's mentioned that no heroes have a win rate of above 55% but are there heroes with win rate under 45%?
      1. sh1va's Avatar
        sh1va -
        Quote Originally Posted by MacLeod View Post
        Another more lively example for the same point.

        Let two monkeys play SE. No matter which heroes you assigned to the monkeys, the win rate will be about 50%. And it also doesn't matter which monkey goes 1st!

        But does that mean SE is perfectly balanced?
        you just totally made my day mate
      1. Ballyworld -
        Quote Originally Posted by pyrogene View Post
        Hmm, ok. I guess the main questions from this thread would be:

        1. Is it better in his opinion (and also what is currently being done) to look at stats for the entire player base or only for higher ranking players for balance decisions?

        2. Are there differences in stats between subsections of players with different rating? Specifics would be nice but I understand if some data cannot be revealed.

        3. It's mentioned that no heroes have a win rate of above 55% but are there heroes with win rate under 45%?
        4. Elad is the most used hero at 10%, which is 5%over straigh mathmatical avg based on having 20 heros. Is there any hero receiving a 1-2% playrate?
      1. maskee's Avatar
        maskee -
        OMG, win rate from QM? The ratinq system is made for win rate around 50% !!! Everyone climbs up till moment when he starts lose, and than most of us have constant 50% win rate. Even very best players reach rating 330 very fast and than they have around 50% rating against other best players... I think this "Trueskill" rating is about to set u somewhere in the field where u have 50% win rate. So more u play,... closer to 50% !!! Only players who play very little or players on edges can have win rate far from 50%.
      1. oijjio's Avatar
        oijjio -
        I'm quite happy for overall deck balance and variety, what I'm unhappy with is the number of expensive cards in store that look like bombs but are still unbalanced and unplayable that I feel are just there to trick TCG noobs. In a small tcg with limited amount of cards, you really can't afford to have many competitively unplayable cards.
      1. Mojumbo's Avatar
        Mojumbo -
        Quote Originally Posted by pyrogene View Post
        Hmm, ok. I guess the main questions from this thread would be:

        1. Is it better in his opinion (and also what is currently being done) to look at stats for the entire player base or only for higher ranking players for balance decisions?

        2. Are there differences in stats between subsections of players with different rating? Specifics would be nice but I understand if some data cannot be revealed.

        3. It's mentioned that no heroes have a win rate of above 55% but are there heroes with win rate under 45%?
        1. It's important to pull stats from all levels of play really. You want to get an idea of what newer players are attracted towards playing and how they do with the heroes they choose to use. Naturally pulling stats from the top tier players makes sense because it gives you an idea of how balanced the game is in the higher levels of play which helps determine the health of the tournament scene. Lastly, it's a good to pull the overall stats so you can look for "glaringly" overpowered heroes. Let's say a hero, overall, was holding a 60% win percentage overall. That would be pretty telling that there might be an issue with that particular hero. Overall stats are also good for determining the raw popularity of heroes.

        2.For the most part, hero stats are rather consistent across the ratings so far. You do get minor differences in first turn advantage win rates, overall winrates, and hero usage but Eladwen, for example, holds a similar win rate and usage % both when broken into subsets and taken overall (her first turn advantage fluctuates between 2-4% depending on the data being looked at).

        3. Yes, very few heroes have a win rate below 45% but some do exist. Generally, the heroes that aren't as popular (the few that get played around 1-2% of the time) also harbor a win rate around 40%. Jericho, for example, holds a 42% win rate and is played 1% of the time among high ranking players. It's important to keep in mind that this isn't necessarily a reflection that Jericho's power level is lacking but rather that he is unpopular. In fact, Kyltz recently used Jericho in the Wulven Challenge Tournament and won with him only dropping 1 game the entire time! It should be noted, however, that we are always looking for ways to increase the popularity of our lower rated heroes to get them some time in the spotlight. The increased exposure can then be turned into a higher win rate
      1. Drakkon's Avatar
        Drakkon -
        If two players are both using Eladwen, one will lose and one will win.. does this water down the stats you're looking at? Can you look at it without the mirror?
      1. Mojumbo's Avatar
        Mojumbo -
        Quote Originally Posted by Drakkon View Post
        If two players are both using Eladwen, one will lose and one will win.. does this water down the stats you're looking at? Can you look at it without the mirror?
        Yes we can
      1. pyrogene's Avatar
        pyrogene -
        Thanks for the reply! Good to know that there is more analysis done behind the scenes.
      1. Pandevmonium's Avatar
        Pandevmonium -
        If they only nerfed Eladwen a little bit more... we have a nice balanced and playable meta, way more than Yugioh and MtG; but it's a shame to still see kris-puwen-aldon-oracle-nova-nova-fireball-fireball at every level. And that's why Millstalker still reigns supreme
      1. pyrogene's Avatar
        pyrogene -
        Quote Originally Posted by Pandevmonium View Post
        If they only nerfed Eladwen a little bit more... we have a nice balanced and playable meta, way more than Yugioh and MtG; but it's a shame to still see kris-puwen-aldon-oracle-nova-nova-fireball-fireball at every level. And that's why Millstalker still reigns supreme
        I don't think Eladwen is popular just because she is OP. It's probably also due to relative ease of play and the fact that the deck is cheaper to build compared to item heavy decks. And even without Eladwen, I doubt the less popular heroes like Jericho would see much more play.
      Untitled Document