test content
What is the Arc Client?
Install Arc

Fix the "For Review" list, please.

raphaeldisantoraphaeldisanto Member Posts: 402 Arc User
edited May 2013 in The Foundry
I have to say - Firstly, the "For Review" thing is a good idea in theory but a terrible idea in practice.

There will always be more content than can be reviewed, even with an army of volunteer reviewers, so that list will always be massively long, and the chances of your quest getting reviewed is minimal, unless we can search for quests that we want to review.

The 'For Review' list is long, unsorted and unmanageable. I can't sort by name, date, or author. I'm sure there's a very great reason why the search filters are enabled on every tab but that one....

I understand that you don't want a glut of "for testing" maps appearing on the real foundry list, but at the same time, real adventures are going to get lost in that same glut of "for testing" maps, just in the 'For Review' list.
[SIGPIC][/SIGPIC]
Post edited by raphaeldisanto on

Comments

  • wuhsinwuhsin Banned Users Posts: 0 Arc User
    edited May 2013
    I have to say - Firstly, the "For Review" thing is a good idea in theory but a terrible idea in practice.

    There will always be more content than can be reviewed, even with an army of volunteer reviewers, so that list will always be massively long, and the chances of your quest getting reviewed is minimal, unless we can search for quests that we want to review.

    The 'For Review' list is long, unsorted and unmanageable. I can't sort by name, date, or author. I'm sure there's a very great reason why the search filters are enabled on every tab but that one....

    I understand that you don't want a glut of "for testing" maps appearing on the real foundry list, but at the same time, real adventures are going to get lost in that same glut of "for testing" maps, just in the 'For Review' list.

    I tried finding my quest under the For Review section, and never could. I saw about 10 different Arena maps, 10 different Zombie Apocolypse Maps, and about 20 maps that are nothing but a small area with a giant mob of enemies. A lot of people are complaining that they put many hours into the storylines of their quests, typing page after page of dialogue, and customizing the look of the encounters/npc's, only to be outranked by a bunch of "easy mob" maps designed for farming.
    [SIGPIC][/SIGPIC]
  • tilt42tilt42 Member Posts: 0 Arc User
    edited May 2013
    The For Review tab is also dreadfully slow. Whenever I open it, the game drops down to 1-3 FPS until I close it. This needs some optimization, or at least pages so that hundreds or thousands of quests aren't shown at the same time.
  • wuhsinwuhsin Banned Users Posts: 0 Arc User
    edited May 2013
    Bumping this just to draw as much attention to the problem as I can. The For Review section is keeping over 99% of publishers from getting any plays/reviews/tips on the quests they worked so hard to publish. The work-arounds that work for 1% aren't working for the rest of us, so please let's get this fixed.
    [SIGPIC][/SIGPIC]
  • mystagoguemystagogue Member Posts: 322 Arc User
    edited May 2013
    Agreed. The strongest (IMO) long term selling point of this game will be user created content. The quicker and more efficiently new content can go to "production", the better.
  • wuhsinwuhsin Banned Users Posts: 0 Arc User
    edited May 2013
    mystagogue wrote: »
    Agreed. The strongest (IMO) long term selling point of this game will be user created content. The quicker and more efficiently new content can go to "production", the better.

    Right, and this has given a bad first impression of the game to a lot of people upon first completing a quest and being unable to share it. Most of us are patient enough to wait a day or two for a fix, but I'm on my second day waiting, and at this point I've just quit playing or working on my second quest until I see this is going to be fixed.
    [SIGPIC][/SIGPIC]
  • mrfalrinthmrfalrinth Member Posts: 124 Bounty Hunter
    edited May 2013
    Maybe implement feature that rewards people for reviewing? With security measure that you can test single "under review" map only once while it is still under review status.
    On top of that anti quick-random-review-rating reward farming feature would be author's made question or two at the end of the story checking if reviewer actually paid attention to the story of the quest. If reviewer cant answer it correctly he may not rate the map (cause he is suspected of farming testing rewards).

    This way we will have incentive for testing under review maps, yet it would be farming proof. And even if author would make some impossible to answer questions, he is punishing himself, cause his map will never get ratings.
  • wuhsinwuhsin Banned Users Posts: 0 Arc User
    edited May 2013
    mrfalrinth wrote: »
    Maybe implement feature that rewards people for reviewing? With security measure that you can test single "under review" map only once while it is still under review status.
    On top of that anti quick-random-review-rating reward farming feature would be author's made question or two at the end of the story checking if reviewer actually paid attention to the story of the quest. If reviewer cant answer it correctly he may not rate the map (cause he is suspected of farming testing rewards).

    This way we will have incentive for testing under review maps, yet it would be farming proof. And even if author would make some impossible to answer questions, he is punishing himself, cause his map will never get ratings.

    Great idea.
    [SIGPIC][/SIGPIC]
  • zaphtasticzaphtastic Member, Neverwinter Beta Users, Neverwinter Guardian Users, Silverstars Posts: 0 Arc User
    edited May 2013
    Yes, I suggested that before as well. Also see this thread for some insight, including a response from badbotlimit (Foundry producer) about possibly implementing some incentives for playing less-known content.

    The gist of the suggestion is to give some sort of reward to players for playing content without many plays (which includes playing the quests in the review queue). Realistically, most players will NOT waste many hours of their time playing 'unproven' content without any reward... just ask anyone who's ever tried playing Random Arc Roulette in COH. So you need incentivization. This can either be a minor reward (like a potion or ID scroll) or a major one on a timer (so you can only get x/week or y/day to prevent abuse). It could also be a Foundry-only reward, such as a healthstone that can only be used on Foundry missions, or a low % chance to get a rare mount/companion. Etc etc.

    Even then, there's a very real possibility that there just aren't going to be enough reviewers for the content... which ultimately reveals the necessity of using some sort of classification criteria (such as tags) to make it all manageable. Ultimately, if the review queue idea doesn't work out, I see authors using friends/guildies (or rating their own quest through alt accounts) to get past the "needs review" hurdle.
  • mrfalrinthmrfalrinth Member Posts: 124 Bounty Hunter
    edited May 2013
    zaphtastic wrote: »
    Yes, I suggested that before as well. Also see this thread for some insight, including a response from badbotlimit (Foundry producer) about possibly implementing some incentives for playing less-known content.

    The gist is to give some sort of reward to players for playing content without many plays (which includes playing the quests in the review queue). This can either be a minor reward (like a potion or ID scroll) or a major one on a timer (so you can only get x/week or y/day to prevent abuse). It could also be a Foundry-only reward, such as a healthstone that can only be used on Foundry missions, or a low % chance to get a rare mount/companion. Etc etc.

    Even then, there's a very real possibility that there just aren't going to be enough reviewers for the content... but let's see how things look in a week or so.

    If you propose rewardbig enough people WILL do what the reward require. Games development is all about leading people with the leesh of their fun and profits and in mmorpg profits translates to fun. And testing a map doesnt take as long as making it, so your "there will never be enough of testers" is simply false. They just need time-worthy reward for reviewing (note: not for farming - my suggestion in previous post shows how to exclude rewarding the farming insetad of reviewing).
  • zaphtasticzaphtastic Member, Neverwinter Beta Users, Neverwinter Guardian Users, Silverstars Posts: 0 Arc User
    edited May 2013
    mrfalrinth wrote: »
    If you propose rewardbig enough people WILL do what the reward require. Games development is all about leading people with the leesh of their fun and profits and in mmorpg profits translates to fun. And testing a map doesnt take as long as making it, so your "there will never be enough of testers" is simply false. They just need time-worthy reward for reviewing (note: not for farming - my suggestion in previous post shows how to exclude rewarding the farming insetad of reviewing).
    Look at it from a pragmatic player's perspective.

    I'm a player who wants to play foundry content (and get rewarded for it). Let's assume playing through a story quest takes half an hour, and playing through an xp farm quest takes 5 minutes. I have one hour of playtime for the Foundry.
    1. I can play one or two of the top 10 / featured story quests. These are guaranteed to be good quality, so I'll get good value for my time. In addition, these are qualified for the daily Astral Diamond quest, which is quite a good payout.
    2. I can play any of the eleventy billion xp farm quests. These don't qualify for the AD quest, but get me an insane amount of xp in little time. I can also play a lot of them for a different scenery (if that matters at all for powerlevelling).
    3. I can play 2-5 random quests in the Foundry. These are likely to not be eligible for the daily AD quest, and - in addition - are very likely to be unenjoyable (even if they have a good rating -- they may just be mass-upvoted by the author's guildies or whatever), and thus a waste of my time. See Sturgeon's Law.
    4. I can play an unknown number of quests in the review queue. This is a strictly worse situation than 3], since I'm playing completely unknown content. It has a VERY HIGH likelihood of being bad. I'm not getting the daily AD reward. In addition, it's very possible I will be unable to finish the quest and get the standard rewards, too (unlike 3]).

    So why would an average player play 4] instead of 3] (and why would an average player play 3] instead of 1])? You'd need incentives that surpass the reward for 1], which counteracts the entire point of the "qualified for daily rewards" system, and instead rewards authors churning out new quests and others playing them for an even bigger bonus.
  • mrfalrinthmrfalrinth Member Posts: 124 Bounty Hunter
    edited May 2013
    zaphtastic wrote: »
    Look at it from a pragmatic player's perspective.

    I'm a player who wants to play foundry content (and get rewarded for it). Let's assume playing through a story quest takes half an hour, and playing through an xp farm quest takes 5 minutes. I have one hour of playtime for the Foundry.
    1. I can play one or two of the top 10 / featured story quests. These are guaranteed to be good quality, so I'll get good value for my time. In addition, these are qualified for the daily Astral Diamond quest, which is quite a good payout.
    2. I can play any of the eleventy billion xp farm quests. These don't qualify for the AD quest, but get me an insane amount of xp in little time. I can also play a lot of them for a different scenery (if that matters at all for powerlevelling).
    3. I can play 2-5 random quests in the Foundry. These are likely to not be eligible for the daily AD quest, and - in addition - are very likely to be unenjoyable (even if they have a good rating -- they may just be mass-upvoted by the author's guildies or whatever), and thus a waste of my time. See Sturgeon's Law.
    4. I can play an unknown number of quests in the review queue. This is a strictly worse situation than 3], since I'm playing completely unknown content. It has a VERY HIGH likelihood of being bad. I'm not getting the daily AD reward. In addition, it's very possible I will be unable to finish the quest and get the standard rewards, too.

    So why would an average player play 4] instead of 3] (and why would an average player play 3] instead of 1])? You'd need incentives that surpass the reward for 1], which counteracts the entire point of the "qualified for daily rewards" system, and instead rewards authors churning out new quests and others playing them for an even bigger bonus.

    It doesnt. Becouse you can review map wwhile it is under review only once. So yeah here is a recipe:

    1. Make Astral Diamonds bonus reward for reviewing the map that is "under review". (and get a lot of volunteers)
    2. Make the reward scale down when map takes less than 25 minutes. (drastic scaling, so it gives like 10% of reward for very short quests - removing them as the best candidates to acumulate most ratings - so people threat them all equally no matter the time)
    3. Make each map be reviewable only once while within this "promotion" of unreviewed maps. (only 1 reward per 1 reviewed map)
    4. Make the author set the question before review window to make sure the reviewer is not mindless farmer giving fake rating.

    So as i said: If the reward is worthwhile, there will be people willing to do what it takes. And by clever secrutiy features you will disable the fake ratings or reward farming, mass produced quests.
  • zaphtasticzaphtastic Member, Neverwinter Beta Users, Neverwinter Guardian Users, Silverstars Posts: 0 Arc User
    edited May 2013
    Oh, I certainly agree with you that some serious incentivization is needed and the system you outlined could work (in theory at least) with the note that the playtime limit could be bypassed by zoning in and afking on the reviewer account until 25 mins were reached. Another potential exploit is "author makes quest on account 2, plays and reviews it on account 1 for the big rewards, repeats this a lot of times". x/day or y/week limitations on the AD reward could work to curb this to a point...

    My point was more around the fact that Cryptic doesn't seem to agree with heavy incentivization, sadly... in fact, they designed the entire "qualified" system to go against rewarding little-known (or unreviewed) content. They do have some solutions in mind, but we don't know specifics. Quoth RoBoBo from that thread (link):
    There are several possible solutions to incentivize play of new quests but we need to weigh each one carefully as it is possible to do strange harm if we don't really think it though.
  • adamjm85adamjm85 Member Posts: 19 Arc User
    edited May 2013
    Agreed. There needs to be incentives for reviewing new Quests. There also needs to be some criteria for what constitutes a "Quest".

    "Quests" where there is no dialog or story and simply an XP Grind should not be allowed to be called Quests in the first place. They should definitely not be allowed to be rated more than 3 stars.

    The review system needs an overhaul. I think once players reach the level of playing foundry quests there should be a random selection system and a "Review a Quest" objective set up with a random un-reviewed quest. That way every new player looks how to review quests.

    I think the search function needs addressing badly also. If we the creators cannot find our own Quest what hope do we have of others finding it to be reviewed?
  • zaphtasticzaphtastic Member, Neverwinter Beta Users, Neverwinter Guardian Users, Silverstars Posts: 0 Arc User
    edited May 2013
    adamjm85 wrote: »
    Agreed. There needs to be incentives for reviewing new Quests. There also needs to be some criteria for what constitutes a "Quest".

    "Quests" where there is no dialog or story and simply an XP Grind should not be allowed to be called Quests in the first place. They should definitely not be allowed to be rated more than 3 stars.

    The review system needs an overhaul. I think once players reach the level of playing foundry quests there should be a random selection system and a "Review a Quest" objective set up with a random un-reviewed quest. That way every new player looks how to review quests.

    I think the search function needs addressing badly also. If we the creators cannot find our own Quest what hope do we have of others finding it to be reviewed?
    I definitely agree about the need for an overhaul on the entire search/browse system.

    However, making it mandatory to have story/dialog/whatever will not deter farmers from making powerlevelling quests. They'll just cut and paste 'Lorem Ipsum' or 'aaaaaaa' into the dialog, and click through it.

    In fact, everyone should read THIS post right now. This phenomenon (players using UGC to powerlevel their characters) is very much not new. Trying to fight it will very likely end in tears.

    It's an interesting idea to have a 'review a random quest' button... though, as I said above, you'd need some really serious incentivization to get players to do this. Why waste an hour of my time playing something really bad, when I could be playing some top-shelf polished quests from the top 10 in the 'best' list?
  • giggliatogiggliato Member Posts: 446 Arc User
    edited May 2013
    Why not just create a set of genres, say XP grind, or lore and puzzles and then let the users sort it all out. as intended.
  • meedacthunistmeedacthunist Member Posts: 3,085
    edited May 2013
    At least there should be a search feature available in the "For Review" list. As for now it's very hard to find anything there.
  • raphaeldisantoraphaeldisanto Member Posts: 402 Arc User
    edited May 2013
    I'm actually not talking about incentives. I'm just talking about being able to -find- the quests I want. I'm not a huge fan of incentivizing things. People should want to do things because they want to do them. If someone has to be bribed into reviewing my quest, I don't want them reviewing it in the first place
    [SIGPIC][/SIGPIC]
  • zaphtasticzaphtastic Member, Neverwinter Beta Users, Neverwinter Guardian Users, Silverstars Posts: 0 Arc User
    edited May 2013
    I'm actually not talking about incentives. I'm just talking about being able to -find- the quests I want. I'm not a huge fan of incentivizing things. People should want to do things because they want to do them. If someone has to be bribed into reviewing my quest, I don't want them reviewing it in the first place
    That's OK, but there's a really really small number of people (mostly other authors) who would even consider doing that... see my list in post #11. I don't see how it's possible to keep the review queue from exploding when new quests are being put in it FAR faster than people are reviewing them. A search field wouldn't HURT, of course, but it wouldn't solve the problem.

    e: and yes, bribing people to play content was a sad reality of COH, even if 'bribing' only meant 'asking them in person really nicely'. Despite my marketing efforts, I got a grand total of 0 plays from 'random people' (ones I didn't specifically ask to play it) over more than a month on one of my (IMO) best story arcs. Then it got Dev's Choiced (COH equivalent of featuring), I got 100+ plays overnight, and I woke up to a crazy number of comments to the effect of 'this was the best story I've ever played!!11'.

    "And so it goes."
  • derangedheroderangedhero Member Posts: 18 Arc User
    edited May 2013
    I have to say - Firstly, the "For Review" thing is a good idea in theory but a terrible idea in practice.

    There will always be more content than can be reviewed, even with an army of volunteer reviewers, so that list will always be massively long, and the chances of your quest getting reviewed is minimal, unless we can search for quests that we want to review.

    The 'For Review' list is long, unsorted and unmanageable. I can't sort by name, date, or author. I'm sure there's a very great reason why the search filters are enabled on every tab but that one...

    I cannot put enough stress in how vital a working search system is for the Foundry's health.

    Currently, it is not possible to find a quest that is marked "for review" by searching by name or author.
    Since manually scrolling through tens or hundreds of for-review quests in search of the one we want is neither quick nor easy, it will mean that people will often give up searching for any new missions they hear friends talking about, which will in time discourage authors from creating new content.

    Could we please get a way to search in this category too, for the sake of new and future UGC? :)
    ---
    [SIGPIC]Or am I?[/SIGPIC]
    This loony is also known as @Derangement.
  • jdnycjdnyc Member, Neverwinter Beta Users, Neverwinter Guardian Users, Silverstars Posts: 334 Bounty Hunter
    edited May 2013
    Part of the issue lies with the preview function not working as intended. People are publishing their quests to 'test' what they've done.
    The review section needs a search function. It needs a peer review function like the regular section. That allows those higher rated to move up. It needs to not be a scroll option but split into pages. The scroll function bogs the game down trying to load all of them at once. You need a way to flag a your foundry quest as private for those that wish to test their content and remove them from the public for the time being.
  • raphaeldisantoraphaeldisanto Member Posts: 402 Arc User
    edited May 2013
    Well, it isn't and I agree. Which is why I said in the first post that realistically, there'll always be more content than can be reviewed. You can't make people do things they don't want to do, and 99% of the people out there:

    a) don't care about the foundry or user-generated content
    b) just want to hit max level as fast as possible and be "uber"

    I'll be honest - my biggest frustration right now comes from my friends not being able to find (and test) an instance that I'm writing specifically for them.

    I actually don't care about whether my quests are popular or not. I don't care whether they're featured or not. I don't make them for the wider population. I don't even care whether or not my quests get out of 'For Review', except that that'll make them easier for my friends to find.

    In fact, if there was a way to subscribe to a foundry author -WITHOUT- needing to find one of their quests in the list, I probably wouldn't even have started this thread in the first place, all my friends would have been able to subscribe to me and find my quests easily. :D
    [SIGPIC][/SIGPIC]
  • mrfalrinthmrfalrinth Member Posts: 124 Bounty Hunter
    edited May 2013
    Another way to deal with unreviewed dusted quests which entertaining potential is being wasted is to implement a new mechanic to the game:

    Random Foundry Review

    It gives you random unreviewed foundry quest and if you complete it and answer author's questions about its story, you can review it and then get bonus reward. However you can take the new random foundry quest only once every 30 minutes.

    It would also have "report farm quest" and "report broken quest" buttons, and after acumulating enough of farm quest reports, its being sent to GM which can ban the map and the author from using Foundry for 2 months. And if it accumulated enough of "broken quest" its being withdrawed from the foundry and gives a message to the author in the foundry that his quest is reported as broken - and shows the message players left when using report broken quest function. Author may re-publish the quest after 3 days cooldown is over.

    On top of that i would make the foundry the way that each author can publish only 1 map every 3 days and no under review map can be played more than twice on same account untill it goes public.

    Another feature would be to make the random finder weight the maps with least reports more than the ones who got such reports. So players would more often play maps that are not suspicious of being broken or farm quests.
  • tiszapatiszapa Member, Neverwinter Beta Users Posts: 0 Arc User
    edited May 2013
    I'd love to see some sorting and search function integrated into the "For Review" section. I can't even find my own quest in there... :(
  • dazzle999nldazzle999nl Member Posts: 14 Arc User
    edited May 2013
    manually scrolling through tens or hundreds of for-review quests in search of the one we want is neither quick nor easy

    which is impossible @ 1 frame per second since scrolling goes quicker than the actual onscreen feedback meaning you will miss maps in the progress making the manual search impossible...
    and dont give me the the whole your videocard might not be good nuff thing i have dual nvidia titans
Sign In or Register to comment.