Short and Sweet
Moderator: EN - Forum Moderators
Re: Short and Sweet
Is me. For past 3 days.
- Ferdielance
- Posts: 778
- Joined: Sun Mar 09, 2008 12:46 am
- Gender: Male
- Spoken languages: English
Re: Short and Sweet
For the sake of transparency, Enthalpy and I would like to explain our process for rating and ranking cases. As required by comp rules, each case must be evaluated in "at least five" categories.
We gave very few restrictions for this comp. As noted in the intro post for the competition, cases had to be "at or under 4,000 frames," and should "tell a complete story" and "not waste frames." These restrictions give us two of our judging categories: completeness (Does the case tell a complete, satisfying story with a beginning, middle, and end?) and tightness/efficiency (Does the case waste frames, or does every frame serve a purpose - establishing character/atmosphere, advancing the plot, etc?). The other three judging categories are standard ones: characterization/dialogue, gameplay/puzzles, presentation.
Not every category is weighted equally for every case. Some cases are not puzzle-focused. For those, character development is more important. Other cases are pure puzzle-boxes. In those cases, puzzles are naturally given more weight in the case's final ranking.
Scoring:
Enthalpy and I play the cases on our own, taking notes as we go. We discuss them in chat to make sure we haven't missed major details and understand them fully. We write up reviews, and assign each case a score from 1 to 100. The final ranking is based on the sum of the ranking given to each case. For example, if I gave a case 50 and Enthalpy gave it 75, its final score would be 125/200. Although we will share detailed reviews of the cases, these final scores will not be shared unless the author requests a private PM with detailed scoring. If a case ranks low, we do not want to discourage future entrants by publicizing a low score! Only rankings will be shared.
Scoring scale:
How points from 1 - 100 are assigned to a case are at the discretion of the individual judge. In my case, I assign scores for each grading category, then weight them if necessary for a given case, add them up, and make that the score. I will also make Stream Of Consciousness notes available by PM to authors on request, but not to the public, as my comments may ramble or show other qualities that I'd rather not have in an official judging post.
Any questions?
We gave very few restrictions for this comp. As noted in the intro post for the competition, cases had to be "at or under 4,000 frames," and should "tell a complete story" and "not waste frames." These restrictions give us two of our judging categories: completeness (Does the case tell a complete, satisfying story with a beginning, middle, and end?) and tightness/efficiency (Does the case waste frames, or does every frame serve a purpose - establishing character/atmosphere, advancing the plot, etc?). The other three judging categories are standard ones: characterization/dialogue, gameplay/puzzles, presentation.
Not every category is weighted equally for every case. Some cases are not puzzle-focused. For those, character development is more important. Other cases are pure puzzle-boxes. In those cases, puzzles are naturally given more weight in the case's final ranking.
Scoring:
Enthalpy and I play the cases on our own, taking notes as we go. We discuss them in chat to make sure we haven't missed major details and understand them fully. We write up reviews, and assign each case a score from 1 to 100. The final ranking is based on the sum of the ranking given to each case. For example, if I gave a case 50 and Enthalpy gave it 75, its final score would be 125/200. Although we will share detailed reviews of the cases, these final scores will not be shared unless the author requests a private PM with detailed scoring. If a case ranks low, we do not want to discourage future entrants by publicizing a low score! Only rankings will be shared.
Scoring scale:
Unfinished cases may receive less detailed public reviews, as they are not finished products and thus should not undergo the same degree of public scrutiny. Instead, private PMs with suggestions will be sent to their authors.100: Unachievably good. Nothing gets 100, ever.
90 - 99: Excellent.
80 - 89: Good.
70 - 79: Solid enough. Not going to stand out in comp history, but worth playing.
60 - 69: A bit weak.
50 - 59: Decidedly weak, flawed, needs much reworking.
40 - 49: Possibly unsalvageable.
30 - 39: One step above a troll entry.
0 - 29: Troll entry.
How points from 1 - 100 are assigned to a case are at the discretion of the individual judge. In my case, I assign scores for each grading category, then weight them if necessary for a given case, add them up, and make that the score. I will also make Stream Of Consciousness notes available by PM to authors on request, but not to the public, as my comments may ramble or show other qualities that I'd rather not have in an official judging post.
Any questions?
"A slow sort of country!" said the Queen. "Now, here, you see, it takes all the running you can do, to keep in the same place. If you want to get somewhere else, you must run at least twice as fast as that!"
- Bad Player
- Posts: 7228
- Joined: Wed May 20, 2009 10:53 pm
- Gender: Male
- Spoken languages: American
- Location: Under a bridge
Re: Short and Sweet
That's an interesting way to judge a case. I don't believe I've seen one judged QUITE like that, I may be mistaken, though.
Good luck to the 6 who entered! I, personally, don't have a favorite, so consider me unbiased.
I want Zeel to win
Good luck to the 6 who entered! I, personally, don't have a favorite, so consider me unbiased.
I want Zeel to win
- Bad Player
- Posts: 7228
- Joined: Wed May 20, 2009 10:53 pm
- Gender: Male
- Spoken languages: American
- Location: Under a bridge
Re: Short and Sweet
How much weight do you give to your secret pigeon category that you conveniently neglected to mention?Ferdielance wrote:Any questions?
Re: Short and Sweet
I'd say he was pretty upfront with this requirement.Ferdielance wrote:
If you would like more structure...
* Pigeons.
Re: Short and Sweet
Ferdie is secretly Mike Tyson, so any pigeon entries get 1st place.Bad Player wrote:How much weight do you give to your secret pigeon category that you conveniently neglected to mention?Ferdielance wrote:Any questions?
- Ferdielance
- Posts: 778
- Joined: Sun Mar 09, 2008 12:46 am
- Gender: Male
- Spoken languages: English
Re: Short and Sweet
Enth has given me permission to start posting my reviews. I'm going to keep them relatively low in spoilers, so they should be something people can read without having played the cases first! I will spoil things that become apparent quickly, of course; I'm going to adhere to the standards of a reasonably polite movie review in deciding what to spoil or not spoil.
(Enth's reviews may be more spoilery, however.)
And the random number generator says the first review to post is...
And the second review to be posted is...
(Enth's reviews may be more spoilery, however.)
And the random number generator says the first review to post is...
Spoiler : A Disappearing Turnabout, by clcman :
Spoiler : Turnabout Truth, by DragonTrainer :
"A slow sort of country!" said the Queen. "Now, here, you see, it takes all the running you can do, to keep in the same place. If you want to get somewhere else, you must run at least twice as fast as that!"
- Zeel1™
- Posts: 3747
- Joined: Thu Jun 03, 2010 10:29 pm
- Gender: Male
- Spoken languages: English
- Location: Nobody uses this for what it's intended for.
Re: Short and Sweet
I forgot how nervous I always get around this point... ^^'
Re: Short and Sweet
It's the final countdown!
- Ferdielance
- Posts: 778
- Joined: Sun Mar 09, 2008 12:46 am
- Gender: Male
- Spoken languages: English
Re: Short and Sweet
More reviews.
Spoiler : Tap's Turnabout Remembrances :
Spoiler : RoCo-X's A Deutsch Dilemma :
"A slow sort of country!" said the Queen. "Now, here, you see, it takes all the running you can do, to keep in the same place. If you want to get somewhere else, you must run at least twice as fast as that!"
- clcman
- Posts: 1362
- Joined: Tue Apr 26, 2011 3:40 pm
- Gender: Male
- Spoken languages: English
- Location: Classified
Re: Short and Sweet
Well, that was about as good as I was hoping for. I really DO plan on finishing this case, and I'm glad that everything that was actually made was satisfactory. And the stream-of-consciousness notes would be very helpful. Thanks!Ferdielance wrote:Enth has given me permission to start posting my reviews. I'm going to keep them relatively low in spoilers, so they should be something people can read without having played the cases first! I will spoil things that become apparent quickly, of course; I'm going to adhere to the standards of a reasonably polite movie review in deciding what to spoil or not spoil.
(Enth's reviews may be more spoilery, however.)
And the random number generator says the first review to post is...
Spoiler : A Disappearing Turnabout, by clcman :
A Less BASEic Turnabout Part 1 is now in beta. Stand by for further orders.
What do REAL, NON-BRIBED people have to say about HTB!?
"This really changed the way I thought about Phoenix as a character. ...Wow." - Reecer6
"HTB! contains truths that might be hard to stomach, but had to be unveiled nonetheless." - Blackrune
"This deserves a best plot twist award." - Evo
"It changed my life, and it can change yours too. For the better, I mean." - Calvinball
"I will never look at Phoenix Wright the same way again" - PhoenixRises123
"omg best thing on aao" - AceAttorneyMaster111
DISCOVER THE TRUTH YOU NEVER KNEW YOU DIDN'T KNOW IN HTB! PROLOGUE AND PART 1, AVAILABLE NOW!!
"Those people who think they know everything are a great annoyance to those of us who do." -Isaac Asimov
"For every complex problem, there is an answer that is clear, simple and wrong." -H. L. Mencken
What do REAL, NON-BRIBED people have to say about HTB!?
"This really changed the way I thought about Phoenix as a character. ...Wow." - Reecer6
"HTB! contains truths that might be hard to stomach, but had to be unveiled nonetheless." - Blackrune
"This deserves a best plot twist award." - Evo
"It changed my life, and it can change yours too. For the better, I mean." - Calvinball
"I will never look at Phoenix Wright the same way again" - PhoenixRises123
"omg best thing on aao" - AceAttorneyMaster111
DISCOVER THE TRUTH YOU NEVER KNEW YOU DIDN'T KNOW IN HTB! PROLOGUE AND PART 1, AVAILABLE NOW!!
"Those people who think they know everything are a great annoyance to those of us who do." -Isaac Asimov
"For every complex problem, there is an answer that is clear, simple and wrong." -H. L. Mencken
- Enthalpy
- Community Manager
- Posts: 5172
- Joined: Wed Jan 04, 2012 4:40 am
- Gender: Male
- Spoken languages: English, limited Spanish
Re: Short and Sweet
And now for the start of your other judge's reviews. These will tend to have more spoilers, though I'll tend to avoid them.
clcman's A Disappearing Turnabout
DragonTrainer's Turnabout Truth
clcman's A Disappearing Turnabout
Spoiler : :
Spoiler : :
[D]isordered speech is not so much injury to the lips that give it forth, as to the disproportion and incoherence of things in themselves, so negligently expressed. ~ Ben Jonson
Re: Short and Sweet
Ferdielance wrote:More reviews.
Just wanted to take the opportunity to respond to your review since I wanted to clarify some points, although you definitely figured out "where" I was going with the case.
Spoiler : Tap's Turnabout Remembrances :
- Ferdielance
- Posts: 778
- Joined: Sun Mar 09, 2008 12:46 am
- Gender: Male
- Spoken languages: English
Re: Short and Sweet
My last reviews!
Spoiler : Spyromed's Grave of the Turnabout :
Spoiler : DWaMnigma's The Assistant's Turnabout :
Spoiler : Zeel1's Turnabout Time Limit :
"A slow sort of country!" said the Queen. "Now, here, you see, it takes all the running you can do, to keep in the same place. If you want to get somewhere else, you must run at least twice as fast as that!"