test content
What is the Arc Client?
Install Arc

Is the Forgehammer of Gond (tool) broken?

Hello guys, I'm a masterworker and I'm about to have all the masterwork professions at rank 4, ready to start the final step to reach rank 5.
After having spent many hours crafting resources, I've collected my own statistics about success/failure rate.
As the title of this topic says, I've found an incoherence using the Forgehammer of Gond. The description states that the mythic tool should provide +55% quality, but this is not what I've observed. I perfectly know that success chance and success rate are two completely different things, but when the statistics becomes large enough, their mismatch should not be so large.
Let me explain with some examples.



Case 1
4x Epic tools (+40% quality each)
Tier 3 chance = 60%
My statistics = 56%
In line with expectation? YES



Case 2
3x Epic tools (+40% quality each)
1x Legendary tools (+50% quality)
Tier 3 chance = 70%
My statistics = 68%
In line with expectation? YES



Case 3
2x Epic tools (+40% quality each)
2x Legendary tools (+50% quality each)
Tier 3 chance = 80%
My statistics = 84%
In line with expectation? YES



Case 4
3x Epic tools (+40% quality each)
1x Mythic tool (+55% quality)
Tier 3 chance = 75%
My statistics = 58%
In line with expectation? NO



Case 5
4x Epic tools (+40% quality each)
1x Legendary tools (+50% quality)
1x Mythic tool (+55% quality)
Tier 3 chance = 85%
My statistics = 72%
In line with expectation? NO



Case 6
1x Epic tool (+40% quality)
2x Legendary tools (+50% quality each)
1x Mythic tool (+55% quality)
Tier 3 chance = 95%
My statistics = 80%
In line with expectation? NO




In conclusion, in my opinion the quality increase granted by the Mythic Forgehammer of Gond (tool) is lower than the one reported inside the description. However, I've reported my findings in this section because, being a matter of statistics, I would like to hear the experience of someone else. If few of you have found an opposite behavior, maybe it's just a matter of (my) bad luck. But, if not, I would like to know if someone else noticed this fact before posting in the Bug report section.

PS: please, avoid inconsistent replies. If you have not collected your statistics, it's just feelings. If you just performed 10 attempts, it's not enough to build a statistics.

Thank you for your time.

Comments

  • xxxsfalxxxxxxsfalxxx Member Posts: 133 Arc User
    No hard numbers, but some thoughts.

    Given what I've read here in the forums, in discussions such as on read it, from other players directly, and my own experiences over the last three and a half years, I don't think it's possible for users to know how close to "random chance" overall results are for everyone over time. I didn't keep stats on the 60% tries on purple gemmed stuff back at level 20 before mastercrafting but it seemed that there would be bad runs and good runs which over time was near that, 6 gemmed and 4 not, in10 tries, but did everyone else get the same sorts of results?

    If we had ten thousand trials each by ten thousand people every day for a year, overall would that be near the chance it's supposed to. Short of data game-wide as time went on, there's probably only anecdotal reports from the individuals who took the time to gather data for what they experienced, and is that sample large enough even still? Your numbers don't seem surprising though, some are closer than others.

    Although it's seemed to me that professions were closer than kits, refining, drops, and they weren't all the same. Does it seem that getting 5 arcana kits in a row break happening every few weeks is abnormal, or is that just making up for the many times there were more successes than that in a row? On the other hand, the thievery kit at the wagon in the rothe valley tunnels seems to break a few times more often than not.
  • spidey#3367 spidey Member Posts: 400 Arc User



    PS: please, avoid inconsistent replies. If you have not collected your statistics, it's just feelings. If you just performed 10 attempts, it's not enough to build a statistics.

    Thank you for your time.

    How many attempts did you make?

  • finalalex#7864 finalalex Member Posts: 27 Arc User
    edited November 2018

    No hard numbers, but some thoughts.

    Given what I've read here in the forums, in discussions such as on read it, from other players directly, and my own experiences over the last three and a half years, I don't think it's possible for users to know how close to "random chance" overall results are for everyone over time. I didn't keep stats on the 60% tries on purple gemmed stuff back at level 20 before mastercrafting but it seemed that there would be bad runs and good runs which over time was near that, 6 gemmed and 4 not, in10 tries, but did everyone else get the same sorts of results?

    If we had ten thousand trials each by ten thousand people every day for a year, overall would that be near the chance it's supposed to. Short of data game-wide as time went on, there's probably only anecdotal reports from the individuals who took the time to gather data for what they experienced, and is that sample large enough even still? Your numbers don't seem surprising though, some are closer than others.

    Although it's seemed to me that professions were closer than kits, refining, drops, and they weren't all the same. Does it seem that getting 5 arcana kits in a row break happening every few weeks is abnormal, or is that just making up for the many times there were more successes than that in a row? On the other hand, the thievery kit at the wagon in the rothe valley tunnels seems to break a few times more often than not.

    Well, I agree with you on the what is the meaning of "large enough" numbers/statistics. Maybe 1000 are not enough to match the exact number of a given percentage, but don't forget the magnitude of the numbers we are talking about.
    If you are trying to guess a percentage of legendary mount (more or less in the range of 0.1-0.01%, if not lower) I agree with you that thousands or even milions of attempts are necessary to have something that can be called estimation.
    However, here we have a completely different scale. The smallest success chance is 60%. If a thousand of tries are not yet matching more or less the expected results, there is a high probability that something is not working.
    In particular, if you look at the data I reported, there is a clear polarization, around a -10% when using the Mythic Forgehammer of Gond, like if the game is not accounting for its quality, comparing it to an epic tool. That's why I asked for other player's feedback.
    For what concern the kit's success rate (75% on skill nodes), I bet that everyone of us faced sometimes sequential failures. Like the refinement of enchantments, sometimes it happens to obtain a series a failure that is completely out of statistics (I've even got 10 consecutive failures on the same enchantment having 50% success chance). But I suggest to make a distinction in this case. Such improbable events could be related to an issue in the random function used to determine the success or failure result. If the seed is badly generated (i.e. time/date-releated like in many mmorpg), it does not change consistently at each try. Follows that spamming the button will only waste your kits/preservation wards. And this fact can be easily tested: after a failure on a high chance (like a skill node for example), wait few seconds before trying again. Rarely you will obtain a second failure and in any case you won't obtain again an abnormal series of failure.
  • finalalex#7864 finalalex Member Posts: 27 Arc User
    edited November 2018



    PS: please, avoid inconsistent replies. If you have not collected your statistics, it's just feelings. If you just performed 10 attempts, it's not enough to build a statistics.

    Thank you for your time.

    How many attempts did you make?

    Roughly, since I've started collecting data:

    ~ 500 case 1
    ~ 100 case 2
    ~ 100 case 3
    ~ 200 case 4
    ~ 100 case 5
    ~ 100 case 6
    Post edited by finalalex#7864 on
  • jamiefors#0606 jamiefors Member Posts: 48 Arc User
    Interesting, yesterday I was crafting with mythic forge hammer and 2 legendary tools giving me a 95% chance at tier 3 and obviously a 5% fail
    Attempt 1 = fail !!
    Attempt 2 = fail !!
    Attempt 3 = success
    Attempt 4 = success
    Attempt 5 = success
    Attempt 6 = fail
    That point I turned it off as I’ve never ever failed at 95%
  • finalalex#7864 finalalex Member Posts: 27 Arc User

    Interesting, yesterday I was crafting with mythic forge hammer and 2 legendary tools giving me a 95% chance at tier 3 and obviously a 5% fail
    Attempt 1 = fail !!
    Attempt 2 = fail !!
    Attempt 3 = success
    Attempt 4 = success
    Attempt 5 = success
    Attempt 6 = fail
    That point I turned it off as I’ve never ever failed at 95%

    This is the reason why I'm actually using 3x legendary tools instead of 2xleg + gond
  • thefabricantthefabricant Member, NW M9 Playtest Posts: 5,248 Arc User
    You can find my null hypothesis test for these tools here.
  • finalalex#7864 finalalex Member Posts: 27 Arc User
    edited November 2018

    You can find my null hypothesis test for these tools here.

    Thank you for the comment. I read the whole discussion.
    Apart from some peculiar comment of people having a knowledge of probability theory equal to zero, I found the discussion really interesting. I appreciated your test on large scale with the oil of vitriol.
    Therefore, your opinion is that it's just of matter or RNG and, on the long run, the results match the expectation.
    I will update this post when I'll have at least doubled my attempts, so we can compare our results (yes, I record everything and I don't miss any success).

    PS: How did the investigation end up? Any response from developers? I mean, being the post you linked been submitted to their attention...
  • geno82geno82 Member Posts: 80 Arc User
    I'm mod 15 the problem is solved, forgehammer have 600 Prof and that's without a problem ..
  • finalalex#7864 finalalex Member Posts: 27 Arc User
    geno82 said:

    I'm mod 15 the problem is solved, forgehammer have 600 Prof and that's without a problem ..

    How do the tools work in mod 15?
  • thefabricantthefabricant Member, NW M9 Playtest Posts: 5,248 Arc User

    You can find my null hypothesis test for these tools here.

    Thank you for the comment. I read the whole discussion.
    Apart from some peculiar comment of people having a knowledge of probability theory equal to zero, I found the discussion really interesting. I appreciated your test on large scale with the oil of vitriol.
    Therefore, your opinion is that it's just of matter or RNG and, on the long run, the results match the expectation.
    I will update this post when I'll have at least doubled my attempts, so we can compare our results (yes, I record everything and I don't miss any success).

    PS: How did the investigation end up? Any response from developers? I mean, being the post you linked been submitted to their attention...
    There was never a response given.
  • finalalex#7864 finalalex Member Posts: 27 Arc User
    Thank you for the information
Sign In or Register to comment.