glyphstrip FAQ button
Halo.bungie.org
glyphstrip
Frequently Asked Forum Questions
 Search the HBO News Archives

Any All Exact 
Search the Halo Updates DBs

Halo Halo2 
Search Older Posts on This Forum:
Posts on Current Forum | Archived Posts


Re: DMR Study Update #3 (aka for Hoovaloov)
Posted By: HoovaloovDate: 1/24/12 5:10 a.m.

In Response To: Re: DMR Study Update #3 (aka for Hoovaloov) (RC Master)


: It was a two leveled critique. One that you should treat it fairly if you're
: going to include it, and two that even if you do, I don't think it has
: much relevence anyway. One does not preclude the other.

Ok, I can respect that. Also, if I remember correctly, you were saying that it was unfair to call a 12% and 4% increase at short and medium range significant, while saying a 7% decrease at long range insignificant, right? I still say that the gains made at short and medium range will manifest themselves more often in the real world than the decrease at long range.

Perhaps my logic is flawed, but try this analogy on for size (also realize that these numbers come from my friend Joel's equations, they don't seem to match the "real world" numbers I got at all, so I'm not talking about the actual percentages as much as why I think similar percentages can be called more or less significant):

How noticeable the change is is directly related to the probability of you getting that result in the first place. Let's imagine a coin with pace written on one side and spam on the other. But on the spam side, I glued a lead weight to it (long range). That coin will hardly ever land spam up, no matter how many times I flip it. The lead weight (long range) means pace wins an overwhelmingly large majority of the time.

Now what if I cut a small piece off of the lead weight, but leave most of it stuck to the spam side. I just increased the chances of the coin landing spam, right? (this is what the TU does, slightly increase the spam chances) But it will still hardly ever land spam up because there's still a lot of the lead weight (long range) glued to the spam side. You won't see the increase manifest itself because the percentage is so low anyway (22%). This example shows the difference an extra 7% spam kills makes at long range. It's not very noticeable because the coin lands pace up an overwhelming majority of the time even though spam is increased by 7%.

Now imagine that I glue a bit of wood (short range) to the pace side of a new coin. The coin now wants to land spam up, but you can imagine it landing pace up sometimes now, but mostly spam. Now I'll cut off most of the wood stuck to the coin, improving the chances of pace by 12%, you'll really start to notice it because the coin is almost evenly weighted again (53%-47% spam-pace). This example shows the difference an extra 12% can make between 65% pace and 53% pace. It's pretty noticeable because when you increased your chances by 12%, you going from large majority of spam wins to almost a 50-50 toss up. The change will manifest itself more often.

I realize that this is just an analogy, so it doesn't quite do it justice. But I think the logic makes sense. Winning at short range by pacing goes up 12%, but that 12% puts us very close to 50-50 odds with Joel's numbers. We just went from a small minority winning percentage to almost dead even. But at long range, the TU's 7% increase in spam wins just turns spam wins from being an extremely rare occurrence to a very rare occurrence.

Once again, please realize that I am using Joel's numbers because that's the context you used to point out that I was being "biased." I think we both agree that Joel's numbers don't match up with the real world very well.

----------------------------------------------------------------------------

: Hold up. Firstly, the quoted margin of difference is rather a retreat from
: the initial conclusions of your article: where the difference at short and
: medium range was 12% points, not 10.7% and 6.4%. To declare your
: conclusion now stronger seems illogical unless you are using some other
: frame of reference?

Yes, I was saying my conclusion is stronger because my frame of reference was Joel's numbers from Update #2. Update #3 of the study provided us with percentages that, interestingly enough, closely matched the winning percentages from the original spreadsheet. Since these numbers (+10% short, +6% med, -1% long) ended up matching my conclusion more closely than Joel's "theoretically ideal" numbers (+12% short, +4% med, -7% long), I was pointing out that the conclusion had gotten stronger since Update #2. Sorry for the confusion. I was comparing Update #3's results with Update #2's and observed that Update #3's results were stronger.

Also, I talked to Joel quite a while about his equations. I asked him why his equations came up with such a different result than my "1000 random samples" test. He said the difference is due to how much variance there is in the empirical data. He thought the two numbers would converge somewhere as more data was added to the sample set. In other words, his equations don't work very well with a small sample size. But that's all we have to work with, for now.

----------------------------------------------------------------------------

: Could you talk a little about how you made that? I looked at the spreadsheet
: and it wasn't immediately obvious to me. Did you generate the random
: numbers over and over and manually copy over the totals to the table on
: the right?

I suppose that wasn't very clear, since I don't think Google Docs uploads macros. I coded myself a custom macro in Excel to do the heavy lifting.

1) Random numbers are generated in those columns.
2) Pacing times and spamming times are "linked" to the random numbers.
3) The random numbers are sorted.
4) This shuffles the pacing and spamming columns randomly and independently.
5) The newly shuffled pacing and spamming numbers are put into the "Pace Selection" and "Spam Selection" columns.
6) A line-by-line comparison takes place between the two "Selection" columns and chooses the lowest number from each line, and displays the winner of each line.
7) The total pace wins out of those 25 simulated 1v1s are summed for all six scenarios (100% & 85% for short, med, and long range).
8) The macro takes all six totals and writes them to a line in the table to the right.
9) Steps 1-8 are repeated 999 more times.
10) I averaged the total wins for each range and bloom setting, and compared the averages.

That's where I get the +10% at short, +6% at med, and -1% at long range results from. And these are much more "real world" results because this is as close as it gets to a real 1v1 with the numbers. So I think these empirical data sets paint us a better picture of what's really going on than my friend Joel's "theoretically ideal" results. What do you think?

It's like we have two decks of 25 cards, one for pace and one for spam. Then we each take a deck, shuffle it, and play through all 25 cards. I tally up how many times in the game my cards beat yours. Then we reshuffle and play again for 1000 times total. Then I average my wins at the end. And do this for all six scenarios.

----------------------------------------------------------------------------

: Odds are at short range that spamming will still win, even if the rate is
: reduced. At medium range, pacing was always predicted to win overall,
: though your data suggests that rate is now increased Though you have not
: presented a line of reasoning that suggests this difference is detectible
: at the gameplay level and does, in fact, achieve your stated conclusion of
: discouraging spamming.

If you're asking what the threshold of detectibility is, or how much of an increase is worth it, then honestly, we haven't defined it yet. But let's give it a shot.

Let's say we play a game to 25 kills, a 1v1. We each will only fire our DMR one way: I'll pace and you'll spam all the time. According to my data, at short range, in 100% bloom, I have a 28% chance of winning any given encounter. This means in a game to 25, you should win 25-10. Now let's do the same thing in 85% bloom, at short range. Now I have a 38% chance of winning any given encounter. This means in a game to 25, you should win 25-15. I got 5 more kills this time. Is that noticeable/significant? Yeah, definitely. Big improvement for me.

What about medium range? In 100% bloom, I have a 63% chance of wining a given encounter. So in a game to 25, I should win 25-15. Now in 85% bloom, I have a 69% chance of winning a given encounter. So in a game to 25, I should win 25-11. You got 4 less kills. Big improvement for me.

What about long range? In 100% bloom, I have a 85% chance of winning any given encounter. So in a game to 25, I should win 25-4. Now in 85% bloom, I have a 84% chance of winning a given encounter. So in a game to 25, I should win 25-5. You just got one more kill. Not a big deal, really.

So yes, at short and medium range, the increase in winning percentage is very noticeable, but not so much at long range since the 100% and 85% bloom result in virtually the same pacing winning percentage.

----------------------------------------------------------------------------

: But wasn't the premise of the article the rate difference between the two?
: Does 100%'s extra expansion and error rate with spamming make the final
: pacehot a pacer can achieve more important than in 85%? Goes back to more
: testing needed.

I don't really understand your point here. This is in context of the DMR being fired properly. My point is that I was defining pacing as a very strict thing - all shots must wait for fully reset reticule. This leads to much slower kill times than "optimal" DMR firing (i.e. a few quick bodyshots, short pause, bodyshot + quick pacehot or something like that). So optimal DMR firing would probably get close to 50-50 with spammers in 100% bloom, and maybe even overtake them in 85% bloom. The only way to figure this out would be to figure out the total time for an optimal DMR kill. Then we can replace that time with all the paced times in the spreadsheet, and run the simulation 1000 (or 25,000 :) times.

So let's try to figure that out. Since spamming is the most likely to win at close range, let's start with that. I just went back and watched my videos - in both 100% bloom and 85% bloom short range tests, the first 4 spam shots always hit the target, popping the shields. The problem spamming had at short range was landing that last pacehot because the bloom was maxed out by then.

A spam/max ROF fire shot is 12 frames in both 100% and 85% bloom. For the first 3 bodyshots, that's 36 frames. Then after the 4th bodyshot, we let the reticule fully reset, which takes 15 frames in 100% and 13 frames in 85%. Also, add the 2 frames it takes the last shot to register. So that means in 100%, an "optimal" kill would be 36+15+2=53 frames. For 85%, it's 51 frames. Before I plug that into my Battle Simulation program, what do you think of these numbers. Reasonable?

----------------------------------------------------------------------------

: Spammers have larger targets and can recover more quickly (max ROF - 12
: frames) from a missed shot than a pacer can (must wait for reset). Yes, we
: can look at the case that they both miss a shot (reticle completely
: off-target). Maybe even two. What happens then?

85% bloom takes away the one shot "cushion" the spammer has. He can no longer miss once and recover to win the encounter against the pacer like he could in 100% bloom. Therefore, 85% bloom rewards the accuracy of pacing more than 100% does by punishing spamming. It's much riskier to spam in 85% bloom because the pacer's ROF is faster. He can overtake the spammer if he misses.

----------------------------------------------------------------------------

: On the same token let me quote you
: The point I'm proving is that you're not looking at the whole picture either :)

I think I was looking at the whole picture, which is that the results of experiment is getting to the underlying changes the TU makes to the win probabilities of pacing and spamming. I removed almost all the variables, so pretty much all that's left is the TU changing things. Any changes such as aiming at a different target, factoring in player accuracy, movement, all these things are affected equally by the TU's changes.

You were pointing out very specific 1v1 encounters to make a point, I was saying that the large trend of the TU is that pacing wins are increased at short & medium range, and at long range is virtually the same as 100% bloom.

But maybe I totally don't understand your point. :)

----------------------------------------------------------------------------

: Part in bold: for the DMR? The DMR only becomes a 4 shot if you've taken any
: other shield damage (which is funky). Needle Rifle is 6 shots on it's own
: with bleedthrough, 9 with body shots.

Sorry - my hypothesis was two-fold. The first being that the NR is the gun to use in the TU. It clearly has some funky bullet magnetism stuff going on, and the reticule resets faster than the DMR anyway. It's a pacehot machine in the TU. The second part of the hypothesis was that the best way to fire either gun (DMR or NR) would be to spam 3 bodyshots (if medium/long range), pause, 1 bodyshot + 1 pacehot. Or spam 4 bodyshots (if short) needed to pop the shields, and then go for the pacehot. That's how I try to play anyway.

----------------------------------------------------------------------------

Sorry for the crazy long post. I'll upload the maps and gametypes for you later today. How should I let you know when they're in there? Gamertag = TTL Hoovaloov

Also, I think I'm going to re-write the article in a new post sometime soon that excludes all the early calculations that we both agreed aren't accurate. The way it stands now is kind of mess since I updated it three times. :)

Good discussion, RC. It's been fun fleshing out this study. As iron sharpens iron...


Message Index




Replies:

Statistical Analysis of DMR BehaviorHoovaloov 1/17/12 6:22 a.m.
     Re: Statistical Analysis of DMR BehaviorDEEP NNN 1/17/12 7:27 a.m.
           Re: Statistical Analysis of DMR BehaviorHoovaloov 1/17/12 7:46 a.m.
     Your analysis is grossly incompleteRC Master 1/17/12 10:12 a.m.
           Also, a problem of definition.uberfoop 1/17/12 11:30 a.m.
                 Re: Also, a problem of definition.Hoovaloov 1/17/12 4:59 p.m.
                       Re: Also, a problem of definition.RC Master 1/17/12 7:49 p.m.
                             Re: Also, a problem of definition.Hoovaloov 1/17/12 8:17 p.m.
                                   Re: Also, a problem of definition.RC Master 1/18/12 9:35 a.m.
                                         Re: Also, a problem of definition.Hoovaloov 1/18/12 4:29 p.m.
                                               Re: Also, a problem of definition.RC Master 1/20/12 9:48 p.m.
           Re: Your analysis is grossly incompleteFyreWulff 1/17/12 12:32 p.m.
                 Re: Your analysis is grossly incompleteFyreWulff 1/17/12 12:33 p.m.
                 Re: Your analysis is grossly incompleteSchooly D 1/17/12 1:11 p.m.
                       Re: Your analysis is grossly incompletekatancik 1/17/12 1:36 p.m.
                             Re: Your analysis is grossly incompleteHoovaloov 1/17/12 5:30 p.m.
                       Re: Your analysis is grossly incompleteFyreWulff 1/17/12 2:26 p.m.
                             Re: Your analysis is grossly incompleteHoovaloov 1/17/12 5:36 p.m.
                                   Re: Your analysis is grossly incompleteFyreWulff 1/17/12 6:12 p.m.
                                         Re: Your analysis is grossly incompleteFyreWulff 1/17/12 6:28 p.m.
                                         Re: Your analysis is grossly incompleteHoovaloov 1/18/12 1:56 a.m.
                       Re: Your analysis is grossly incompleteHoovaloov 1/17/12 5:21 p.m.
                 Re: Your analysis is grossly incompleteHoovaloov 1/17/12 5:14 p.m.
           Re: Your analysis is grossly incompleteHoovaloov 1/17/12 4:54 p.m.
                 Re: Your analysis is grossly incompleteuberfoop 1/17/12 5:13 p.m.
                       Re: Your analysis is grossly incompleteHoovaloov 1/17/12 5:19 p.m.
                             Re: Your analysis is grossly incompleteuberfoop 1/17/12 7:32 p.m.
                                   Re: Your analysis is grossly incompleteHoovaloov 1/17/12 8:21 p.m.
                                   Re: Your analysis is grossly incompleteHoovaloov 1/18/12 2:03 a.m.
                                   DMR Study Update #2 (aka for uberfoop)Hoovaloov 1/20/12 7:42 a.m.
                                         Re: DMR Study Update #2 (aka for uberfoop)uberfoop 1/20/12 2:00 p.m.
                                               Re: DMR Study Update #2 (aka for uberfoop)Hoovaloov 1/20/12 5:16 p.m.
                                         Re: DMR Study Update #2 (aka for uberfoop)RC Master 1/20/12 2:29 p.m.
                                               Re: DMR Study Update #2 (aka for uberfoop)Hoovaloov 1/20/12 6:42 p.m.
                                                     Re: DMR Study Update #3 (aka for Hoovaloov)RC Master 1/23/12 9:49 p.m.
                                                           Re: DMR Study Update #3 (aka for Hoovaloov)Hoovaloov 1/24/12 5:10 a.m.
                                                                 Edit: "pacehot" should be "headshot"Hoovaloov 1/24/12 11:39 a.m.
                                                                 re: DMR Study Update (new spreadsheet)RC Master 1/27/12 6:15 a.m.
                                                                       Re: re: DMR Study Update (new spreadsheet)Hoovaloov 1/28/12 6:20 a.m.
                                                                             Re: re: DMR Study Update (new spreadsheet)RC Master 1/28/12 11:28 a.m.
                                                                                   Re: re: DMR Study Update (new spreadsheet)Gravemind 1/28/12 2:01 p.m.
                                                                                         Re: re: DMR Study Update (new spreadsheet)RC Master 1/28/12 5:52 p.m.
                                                                                               Re: re: DMR Study Update (new spreadsheet)Gravemind 1/28/12 10:39 p.m.
                                                                                                     Whole Sandbox Is Not BrokenHoovaloov 1/31/12 4:09 p.m.
                                                                                                           I agree but...Spec ops Grunt 1/31/12 4:38 p.m.
                                                                                                                 Re: I agree but...Hoovaloov 1/31/12 4:45 p.m.
                                                                                                           No no no no no no!!!Bryan Newman 1/31/12 5:48 p.m.
                                                                                                                 Re: No no no no no no!!!Phoenix_9286 1/31/12 6:13 p.m.
                                                                                                                       I meant no disrespect...Bryan Newman 1/31/12 6:51 p.m.
                                                                                                                 Re: No no no no no no!!!kidtsunami 1/31/12 6:13 p.m.
                                                                                                           Re: Whole Sandbox Is Not BrokenSEspider 1/31/12 9:26 p.m.
                                                                                                                 Re: Whole Sandbox Is Not BrokenSpec ops Grunt 1/31/12 9:36 p.m.
                                                                                                           Re: Whole Sandbox Is Not BrokenRC Master 2/1/12 5:41 a.m.
                                                                                                                 Re: Whole Sandbox Is Not BrokenHoovaloov 2/1/12 12:33 p.m.
                                                                                                           Re: Whole Sandbox Is Not BrokenGravemind 2/3/12 4:06 a.m.
                                                                                               Re: re: DMR Study Update (new spreadsheet)General Vagueness 1/29/12 12:03 a.m.
                                                                                                     Re: re: DMR Study Update (new spreadsheet)RC Master 1/29/12 12:42 a.m.
                                                                                                           Re: re: DMR Study Update (new spreadsheet)General Vagueness 1/29/12 12:50 a.m.
                                                                                                                 Re: re: DMR Study Update (new spreadsheet)RC Master 1/29/12 12:54 a.m.
                                                                                                                       Re: re: DMR Study Update (new spreadsheet)General Vagueness 1/30/12 2:02 p.m.
                                                                                                                             Re: re: DMR Study Update (new spreadsheet)RC Master 1/30/12 9:59 p.m.
                                                                                   Re: re: DMR Study Update (new spreadsheet)Hoovaloov 1/30/12 9:22 a.m.
                                                                                         Re: re: DMR Study Update (new spreadsheet)RC Master 2/1/12 6:46 a.m.
                                                                                               All this said...RC Master 2/1/12 6:53 a.m.
                                                                                                     Re: All this said...DEEP NNN 2/1/12 7:43 a.m.
                                                                                                           Re: All this said...Hoovaloov 2/1/12 2:49 p.m.
                                                                                                                 Re: All this said...Louis Wu 2/1/12 3:00 p.m.
                                                                                                                       Re: All this said...Hoovaloov 2/1/12 3:21 p.m.
                                                                                                                             even if we hate the TUkidtsunami 2/1/12 3:50 p.m.
                                                                                                                                   Re: even if we hate the TUHoovaloov 2/1/12 4:10 p.m.
                                                                                                                                         Re: even if we hate the TUFyreWulff 2/2/12 12:39 p.m.
                                                                                                                                   Re: even if we hate the TUGravemind 2/1/12 6:52 p.m.
                                                                                                                       Re: All this said...CaneCutter 2/1/12 4:48 p.m.
                                                                                                                             Make "me" the happiest... *NM*CaneCutter 2/1/12 4:49 p.m.
                                                                                                                       Re: All this said...Gravemind 2/1/12 6:42 p.m.
                                                                                                                             Re: All this said...Hoovaloov 2/1/12 7:12 p.m.
                                                                                                                                   Re: All this said...Gravemind 2/2/12 2:23 a.m.
                                                                                                                                         Re: All this said... *IMG*Hoovaloov 2/2/12 3:28 a.m.
                                                                                                                             Re: All this said...RC Master 2/2/12 6:58 a.m.
                                                                                                                                   Re: All this said...Gravemind 2/2/12 7:36 a.m.
                                                                                                                                         wut?RC Master 2/2/12 7:46 a.m.
                                                                                                                                               Re: wut?Gravemind 2/2/12 8:28 a.m.
                                                                                                                                                     Oh, wow...RC Master 2/2/12 9:21 a.m.
                                                                                                                 Re: All this said...DEEP NNN 2/1/12 3:52 p.m.
                                                                                                                       Re: All this said...Hoovaloov 2/1/12 4:19 p.m.
                                                                                                                             Re: All this said...DEEP NNN 2/1/12 5:54 p.m.
                                                                                                                                   Re: All this said...RC Master 2/1/12 6:16 p.m.
                                                                                                                                   Re: All this said...Hoovaloov 2/1/12 6:21 p.m.
                                                                                                                                         Re: All this said...Louis Wu 2/1/12 6:31 p.m.
                                                                                                                                               ditto *NM*kidtsunami 2/1/12 6:40 p.m.
                                                                                                                                               Re: All this said...Hoovaloov 2/1/12 6:58 p.m.
                                                                                                                                         Re: All this said...DEEP NNN 2/1/12 6:47 p.m.
                                                                                                                                               Re: All this said...Hoovaloov 2/1/12 6:51 p.m.
                                                                                                                                                     Re: All this said...DEEP NNN 2/1/12 8:28 p.m.
                                                                                                                 Re: All this said...DEEP NNN 2/1/12 4:08 p.m.
                                                                                               Re: re: DMR Study Update (new spreadsheet)Hoovaloov 2/1/12 2:02 p.m.
     Re: Statistical Analysis of DMR BehaviorDEEP NNN 1/17/12 5:04 p.m.
           Re: Statistical Analysis of DMR BehaviorHoovaloov 1/17/12 5:28 p.m.
                 Re: Statistical Analysis of DMR BehaviorDEEP NNN 1/17/12 6:13 p.m.
     More numbers, better pictureRC Master 1/17/12 7:43 p.m.
           Blog Post UpdatedHoovaloov 1/18/12 1:27 a.m.
                 You misunderstand what the median is...RC Master 1/18/12 9:51 a.m.
                       Chart Updated with MediansHoovaloov 1/18/12 10:18 p.m.
     Apparently I'm a troll?RC Master 1/20/12 6:43 p.m.
           Dude. *NM*kanbo 1/20/12 6:54 p.m.
           Re: Apparently I'm a troll?DEEP NNN 1/20/12 7:04 p.m.
           I think there was trolling involved.NsU Soldier 1/20/12 7:08 p.m.
           Re: Apparently I'm a troll?SonofMacPhisto 1/20/12 7:08 p.m.
           Re: Apparently I'm a troll?Flynn J Taggart 1/20/12 8:54 p.m.
           Re: Apparently I'm a troll?Hoovaloov 1/25/12 6:45 p.m.
     DMR Study Maps+Gametypes Available In File ShareHoovaloov 1/27/12 3:29 a.m.
           Re: DMR Study Maps+Gametypes Available In File ShaRC Master 1/27/12 6:16 a.m.



contact us

The HBO Forum Archive is maintained with WebBBS 4.33.