test content
What is the Arc Client?
Install Arc

Petition for better testing standards please.

nwswansnwswans Member Posts: 39
edited October 2014 in General Discussion (PC)
I'd just like to petition for the developers to actually TEST their own coding, before deploying changes to the live server, and improve their testing process before making future changes.

Why? Just think about the Bottle Lightning quest bug that was introduced. Bug report at: http://nw-forum.perfectworld.com/showthread.php?776691-Bottled-Lightning

I think it has become abundantly clear to us players that the developers do not have any proper standards when it comes to testing and deployment of code changes to the live server. Given their history of breaking something whenever they try to fix something, it gives me the impression that the developers lack a good process in testing and assuring the changes are proper before they release the changes.

Bug fixes, patching, etc involves a process, and usually goes as such:
(1) Identify the problem, by replicating it in the office/test/live environment.
(2) Find the root cause of the problem, through code analysis.
(3) Make the necessary code changes to fix the problem.
(4) Deploy the code changes in the office/test environment, with source code management.
(5) Test if the problem has been fixed with a proper test case.
(6) Test if the problem affects other related parts of the application (integration testing).
(7) Deploy the code changes to the live environment during a schedule downtime/maintenance.

Now the developers give the impression that they are skipping (5) and (6) altogether. You do not make code changes and not test them; this is simply BAD programming. In the Bottled Lightning case, it could have simply been tested by having a couple of developers go to the Rothe Valley zone, and interact with a Bottle while having another tester stand nearby. Despite the simplicity of this test case, it was clearly not done!

Sure, you can tell me it's more complicated than that, that you have multiple files to deploy, that the coding was correct and tested, just not deployed correctly, that something else that was patched caused the quest to not update, etc. But it all boils down to the testing process, and developers, your testing process is clearly bugged. Please fix it first. Thank you.

/signed
Post edited by nwswans on

Comments

  • gerbilhurdlergerbilhurdler Member, Neverwinter Beta Users Posts: 418 Bounty Hunter
    edited October 2014
    nwswans wrote: »
    I'd just like to petition for the developers to actually TEST their own coding, before deploying changes to the live server, and improve their testing process before making future changes.

    Why? Just think about the Bottle Lightning quest bug that was introduced. Bug report at: http://nw-forum.perfectworld.com/showthread.php?776691-Bottled-Lightning

    I think it has become abundantly clear to us players that the developers do not have any proper standards when it comes to testing and deployment of code changes to the live server. Given their history of breaking something whenever they try to fix something, it gives me the impression that the developers lack a good process in testing and assuring the changes are proper before they release the changes.

    Bug fixes, patching, etc involves a process, and usually goes as such:
    (1) Identify the problem, by replicating it in the office/test/live environment.
    (2) Find the root cause of the problem, through code analysis.
    (3) Make the necessary code changes to fix the problem.
    (4) Deploy the code changes in the office/test environment, with source code management.
    (5) Test if the problem has been fixed with a proper test case.
    (6) Test if the problem affects other related parts of the application (integration testing).
    (7) Deploy the code changes to the live environment during a schedule downtime/maintenance.

    Now the developers give the impression that they are skipping (5) and (6) altogether. You do not make code changes and not test them; this is simply BAD programming. In the Bottled Lightning case, it could have simply been tested by having a couple of developers go to the Rothe Valley zone, and interact with a Bottle while having another tester stand nearby. Despite the simplicity of this test case, it was clearly not done!

    Sure, you can tell me it's more complicated than that, that you have multiple files to deploy, that the coding was correct and tested, just not deployed correctly, that something else that was patched caused the quest to not update, etc. But it all boils down to the testing process, and developers, your testing process is clearly bugged. Please fix it first. Thank you.

    /signed

    Waiting for fanboys to post about how hard it would be for that to happen and how it is a free to play game and we should be happy they update at all. Gee I wonder how other games do it. :/
    I only do fetch quests on dragons most days so my sigil output is severely crippled by this bug.
    Please test moar bettur next tym!

    /signed
  • frishterfrishter Member Posts: 3,522 Arc User
    edited October 2014
    Waiting for fanboys to post about how hard it would be for that to happen and how it is a free to play game and we should be happy they update at all. Gee I wonder how other games do it. :/
    I only do fetch quests on dragons most days so my sigil output is severely crippled by this bug.
    Please test moar bettur next tym!

    /signed

    I so hate any time the free2play argument is brought up as if they didn't make that decision to make more money. They wouldn't do it otherwise, though I think they'd make more if things were changed.

    Anyway yes, testing is really poor in this game and really really lets it down. If it was a rare occurrence, fine bugs happen. Yet it's not, far from it.
  • demonmongerdemonmonger Member, NW M9 Playtest Posts: 3,350 Arc User
    edited October 2014
    That's just it... most people see their work as just a job.
    That means that they do just enough to get by.
    Who cares if your job is to push a button on a wall.
    One day you will fall asleep and not push that button and people will die!
    [SIGPIC][/SIGPIC]
    I hate paying taxes! Why must I pay thousands of dollars in taxes when everything I buy is taxed anyways!
  • slintashslintash Member Posts: 172 Bounty Hunter
    edited October 2014
    This reminds me of the livestream, how they wanted to "show off the new DC".....and the guy playing the DC didn't even know the changes. Better yet, he didn't even notice, somehow, that one ability got changed from "target" to a "line" effect until the last boss.

    I don't know, just feels like they aren't really even trying anymore.
  • zahinderzahinder Member Posts: 897 Arc User
    edited October 2014
    It could be worse. Go look at Champions Online. :)
    Campaign: The Fenwick Cycle NWS-DKR9GB7KH

    Wicks and Things: NW-DI4FMZRR4 : The Fenwick merchant family has lost a caravan! Can you help?

    Beggar's Hollow: NW-DR6YG4J2L : Someone, or something, has stolen away many of the Fenwicks' children! Can you find out what happened to them?

    Into the Fen Wood: NW-DL89DRG7B : Enter the heart of the forest. Can you discover the secret of the Fen Wood?
  • query523query523 Member Posts: 1,515 Arc User
    edited October 2014
    Here's the problem with the F2P argument against quality control. F2P does not mean a non-for-profit. Honestly and developer who thought their game wouls earn more as a sub wouldmake it a sub. Period. Irrefutably. So QC still needs to be part of your business plan.
  • lewstelamon01lewstelamon01 Member Posts: 7,415 Arc User
    edited October 2014
    Petition threads are not true discussion. Rule 3.15 requires that all threads and posts be both constructive AND conducive to discussion.
    Rule 3.15 - No Petitions, Ultimatums or Hostile Demands
    . . . . Please keep feedback constructive and within a format for Community Discussion. Disallowed topics include things like, "Please Nerf This Class" and anything without the direction of a constructive Community Discussion. Also, "Pay to Win" argument threads and posts are prohibited as they always end in circular arguments that are not conductive of a healthy discussion.
    ROLL TIDE ROLL

    Great Weapon Fighter: Because when is today not a good day to die?

    PC and PS4 player. Proud Guildmaster for PS4 Team Fencebane. Rank 5 Officer for PC Team Fencebane. Visit us at http://fencebane.shivtr.com
This discussion has been closed.