glyphstrip FAQ button
Halo.bungie.org
glyphstrip
Frequently Asked Forum Questions
 Search the HBO News Archives

Any All Exact 
Search the Halo Updates DBs

Halo Halo2 
Search Older Posts on This Forum:
Posts on Current Forum | Archived Posts


re: DMR Study Update (new spreadsheet)
Posted By: RC MasterDate: 1/27/12 6:15 a.m.

In Response To: Re: DMR Study Update #3 (aka for Hoovaloov) (Hoovaloov)


: Ok, I can respect that.

Cool. I think we've delt with the next few paragraphs well enough on TTL so I'll skip over those.

: Yes, I was saying my conclusion is stronger because my frame of reference was
: Joel's numbers from Update #2. Update #3 of the study provided us with
: percentages that, interestingly enough, closely matched the winning
: percentages from the original spreadsheet. Since these numbers (+10%
: short, +6% med, -1% long) ended up matching my conclusion more closely
: than Joel's "theoretically ideal" numbers (+12% short, +4% med,
: -7% long), I was pointing out that the conclusion had gotten stronger
: since Update #2. Sorry for the confusion. I was comparing Update #3's
: results with Update #2's and observed that Update #3's results were
: stronger.

Right ok, I understand now.

: Also, I talked to Joel quite a while about his equations. ...
: He thought the two numbers would converge
: somewhere as more data was added to the sample set.

I've thought about it a bit more, and normal distributions should be a good fit for the pacing curve, and good fits for each individual spamming spike, but they'll never be a good fit for whole of the spamming results because of the gaps in between where it's possible for a spammer to fire.

So, if you wanted to use normal distributions to model the spamming probability, it'd have to be the sum of several normal distributions centered around each peak. Which gets more complicated...

: I suppose that wasn't very clear, since I don't think Google Docs uploads
: macros. I coded myself a custom macro in Excel to do the heavy lifting.

Ah right. Well if G Docs has macros I've no idea where they are anyway! Thanks for explaining it, I didn't really want to comment on that part until I understood what you were doing.

: What do you think?

Since the order of the wins don't matter (you just count the wins in each set), you could have gotten away with only randomising the spam wins order.

: It's like we have two decks of 25 cards, one for pace and one for spam. Then
: we each take a deck, shuffle it, and play through all 25 cards. I tally up
: how many times in the game my cards beat yours. Then we reshuffle and play
: again for 1000 times total. Then I average my wins at the end. And do this
: for all six scenarios.

Problem is, this isn't a good model of what actually happens. A closer analogy is:
We each have a deck of 25 cards. We shuffle them, draw the top one, and declare a winner (or not) of this battle. Then we put the card back in our decks reshuffle it, and play again.

See, the way you've set it up, if I draw a card that says '49 frames', that stops me from drawing that card again in our 25 card run. When in actuality, when I'm firing my DMR, I could randomly draw it multiple times to beat many of your cards. Yeah, maybe your method doesn't end up too far off the mark anyway, but there is a much more elegant, straightforward way of doing it and we don't need 1,000 sets of 25 card runs, we just need to look at 625 possiblities (25 * 25).

Take a look at this Google Spreadsheet.

Thats not even the most elegant way of doing it - since there are duplicates in every sample, you could just have the unique combinations and then also have the frequency of each card in each of the pacing and spam sets. Doing that would also lend itself to adding more test data more easily. You can see an attempt of this on the page 'Unique Possibilites'. But unfortunately I can't seem to figure out a way to combine the frequency weights to get even basic stats out of it.

I'm not done with this spreadsheet yet - some niceities aren't all there, and there are a wealth of derived stats you can do which I haven't even begun with.

Regardless, this spreadsheet should still get the point across that you don't need to worry about random numbers and samples of potential DMR battle series or whatever since you can actually enumerate all the possibilites with the given samples from both pacing and spamming style of shooting.

Lag Tolerance


If you're looking at that spreedsheet you're probably wondering what all the blue boxes are. This is an extension of what I was talking about at the end of this post about pings in games. I believe this is quite an important issue to discuss and include in the analysis since Reach is a game which is primarily played across the internet and that mode of play is most player's frame of reference - does the fact that your pacing killed the other guy matter as much if he simultaneously killed you with his spamming? I don't think it does since your pacing clearly gave you no advantage in that case.

At the very least you should model strict draws - where both spamming and pacing kill in the same number of frames - as one would assume that even when played locally or LAN this theoretical situation would result in a mutual kill and give no real 'win' to either player. I noticed you didn't do this in your simulation.

Given that we know that there is some lag tolerance above that, I think it would be a mistake not to include higher frame differences as being 'draws'.

I suggested 3 frames (100ms) either side (pacer could be either host or client) as a start and that is what I began to include in the first spreadsheet. JonnyOThan thinks thats even on the low side for the amount it may actually allow. I have personally seen a 5 frame difference between when I fired and when the opponent fired and we both ended up dying, just a few days ago. We could have been both clients, granted, and that is of course going to make the lag between the two higher in any discussion. I'm sure if we paid attention we could find examples higher than 5 frames anyway.

So, 3 frames is not unreasonable for a 'draw' consideration (no benefit to either side) and this is what I modelled on the 'possibility matrix' sheet. You can see that things start to look a bit different when you take this into account - as I suspected when I first saw the data.

If you look at the absolutist stance where a difference of 1 frame is a 'win' then sure, you might still be able to conclude that in theory the 85% Bloom DMR rewards 'pacing' more than 100% bloom did. However, the reality of the situation is that there is lag, and when you start to compensate for it, you end up with a lot of draws on the tables.

I'm not sure that such an increase in no-one winning (or who wins being entirely up to lag) is desireable. Wasn't randomness and inconsistency one of the complaints? One of the things that 85% was trying to solve? It seems you just shift that randomness of the shots into more randomness of who will win - perhaps no-one will, perhaps it'll be decided on lag.

The second sheet in that doc - 'Win Margin' - goes into more depth about this. It shows the number of frames of difference (negative is better for spam, positive is better for pacing) and then colour codes it for three levels of lag tolerance and absolute draws.
Absolute draws are Dark Blue,
Draws within 3 frames are light Blue,
Draws with 6 frames are lightly coloured red for spam, green for pace,
Draws with 9 frames are slightly darker coloured for their respective sides.
Anything above 9 frames difference is considered an 'absolute win' on that sheet and is darkest coloured.

Even the 9 frame draw represents about 150ms ping between host and client (300ms each way) which can still happen (though of course I don't know if the lag compensation allows that, and yes JonnyOThan did say it was more complicated than that). Or if you consider players on two different client boxes, you might consider that as 75ms ping between each client and the host. Let me explain that example:

Client 1 fires a killing blow on Client 2.
75ms later, Client 1's shot arrives on the host. Host relays this to Client 2.
Just before the packet of Client 1's shot arrives, Client 2 fires a killing blow on Client 1, sends this to host.
75ms after the host thinks client 2 is dead, the packet arrives at Client 2,
75ms after that, Client 2's killing blow of Client 1 arrives on host - within 150ms (4.5 frames) of when it killed client 2 on host, so it awards the 'simultaneous' kill to client 2, and kills client 1 as well. Sends the information that Client 1 is now dead to Client 1.
75ms later, Client 1 receives the information it is now dead, and kills itself off.

So on Client 1's Xbox, it looks like they died from a player they should have killed 9 frames ago - but in the context of lag, it's still fair, because Client 2 thought they were still alive when they fired, and it's hitscan to make shots reliable anyway!

If you don't want to agree to the lag compensation thing right away then please, lets discuss it.

In the mean time, feel free to take a look at the page 'Absolute (no lag)' - there the draw tolerance is set to zero. The numbers there are close to what you got anyway, but this is a much better way of getting there and should be easier to understand too.

: If you're asking what the threshold of detectibility is, or how much of an
: increase is worth it, then honestly, we haven't defined it yet. But let's
: give it a shot.

: Let's say we play a game to 25 kills, a 1v1. We each will only fire our DMR
: one way: I'll pace and you'll spam all the time. According to my data, at
: short range, in 100% bloom, [...] you should win 25-10.
: In 85% bloom, you should win 25-15. I got 5 more kills this time.

Ok, let me talk about why I don't think the results at short-range (in any of the analyses) are necessarily a good thing here since you have an issue with that.

Firstly, look at it with lag compensation factored into it. There is a greater direct overlap between between the possibilities, and the question of 'who wins' is muddier. But both of them have less outright wins in 85% than 100%.

Secondly, even without lag compensation, the 'what strategy should you use' gets less clear. In 100% bloom, the smart man's money - the person who understood bloom and what your chances were - would bet on spamming over pacing from your data (figures quoted at the end of Update #3) and techniques. In 85%, smart man is still betting on spamming, but the odds are reduced. This means there is less difference between the strategies - which is obvious because Spam is still ROF locked, and pacing can fire faster than before with full reset.

Instead of 'rewarding' the pacer, what you've actually done is punish smart man - the person with the greater knowledge and insight is now going to lose individual fights more often.

Smart man would of course switch to using pacing at medium and long range.

But again, when you factor in lag, smart man(now pacing) is punished in 85% with less outright wins. Yes, smart man/pacer also doesn't outright lose as much as either, but lets look at the score difference in a game to 100 kills:

Medium Range
100% bloom
- pacer gets a kill 64% of time
- Spammer gets a kill 40.8% of time.

Score 100-64 -- pacer wins by 36

85% bloom
- pacer gets a kill 75.2% of time
- spammer gets a kill 51.68% of time

Score 100-69 -- pacer wins by 31

Spammer gains 5 kills

Weird huh?

I'll do the same thing for short and Long range:

Close Range
100% bloom
- pacer gets a kill 28% of time
- Spammer gets a kill 74.56% of time.

Score 38-100 -- spammer wins by 62

85% bloom
- pacer gets a kill 40% of time
- spammer gets a kill 79.52% of time

Score 100-50 -- spammer wins by 50

Pacer gains 12 kills

Long Range
100% bloom
- pacer gets a kill 87.52% of time
- Spammer gets a kill 16.16% of time.

Score 100-18 -- pacer wi50/88ns by 82

85% bloom
- pacer gets a kill 88% of time
- spammer gets a kill 20% of time

Score 100-22 -- pacer wins by 78

Spammer gains 4 kills

For a standard game to 50 kills you can half all that - Pacer gains 6 in Short Range, Spammer gains 2 at mid-range and 2 at long range.

So at short range, the increase in winning percentage is noticable, but smart man's money is still betting on spamming. At medium and long range, the difference isn't much, but is actually in favour of spamming.

: ----------------------------------------------------------------------------

: A spam/max ROF fire shot is 12 frames in both 100% and 85% bloom. For the
: first 3 bodyshots, that's 36 frames. Then after the 4th bodyshot, we let
: the reticule fully reset, which takes 15 frames in 100% and 13 frames in
: 85%.

From the bloom you get after firing 4 shots at max ROF? It's really just 3 extra frames?

: Also, add the 2 frames it takes the last shot to register. So that
: means in 100%, an "optimal" kill would be 36+15+2=53 frames. For
: 85%, it's 51 frames. Before I plug that into my Battle Simulation program,
: what do you think of these numbers. Reasonable?

They certainly sound reasonable but I haven't looked at the reset rates in any great depth myself so I'm just taking your word for it on that front. They also sound insanely quick - particularly the 100% one compared to the spam times. Like, seriously. Go look at what that implies in short-range... thats... insane.

: 85% bloom takes away the one shot "cushion" the spammer has. He can
: no longer miss once and recover to win the encounter against the pacer
: like he could in 100% bloom.

But the spammer doesn't have a very good chance to hit on the 5th and 6th shots anyway. Look at where the quartile distribution is.

: Therefore, 85% bloom rewards the accuracy of
: pacing more than 100% does by punishing spamming. It's much riskier to
: spam in 85% bloom because the pacer's ROF is faster than it is in 100%
: He can overtake the spammer if he misses.

Conversely, if the pacer misses and the spammer remains on-target, suddenly the spammer has a good chance to win on the 6th shot (which was my point) - again, quartiles.

: You were pointing out very specific 1v1 encounters to make a point, I was
: saying that the large trend of the TU is that pacing wins are increased at
: short & medium range, and at long range is virtually the same as 100%
: bloom.

Hmm. I guess I just had a problem how it seemed to be that you were just quoting the 6 pacing win percentage figures as 'the whole story' when this data actually says a lot more than that.

: The second part of the hypothesis was that the best way to fire
: either gun (DMR or NR) would be to spam 3 bodyshots (if medium/long
: range), pause, 1 bodyshot + 1 pacehot. Or spam 4 bodyshots (if short)
: needed to pop the shields, and then go for the pacehot. That's how I try
: to play anyway.

In TU or default?

JonnyOThan reckons bursts of 2 are optimal for both weapons. At least in terms of bloom, in 100%. I tried it a little with the DMR in some TU BTB and it still seemed to work pretty nicely until I started freaking out when they were firing back :P

: Sorry for the crazy long post. I'll upload the maps and gametypes for you
: later today. How should I let you know when they're in there? Gamertag =
: TTL Hoovaloov

Email, XBL PM, message here. Whatever. I might not have time to get around to doing testing for a while though. I have masses of Uni work and even more personal projects to do. Constructing the new spreadsheet took a while as well 0.o


Message Index




Replies:

Statistical Analysis of DMR BehaviorHoovaloov 1/17/12 6:22 a.m.
     Re: Statistical Analysis of DMR BehaviorDEEP NNN 1/17/12 7:27 a.m.
           Re: Statistical Analysis of DMR BehaviorHoovaloov 1/17/12 7:46 a.m.
     Your analysis is grossly incompleteRC Master 1/17/12 10:12 a.m.
           Also, a problem of definition.uberfoop 1/17/12 11:30 a.m.
                 Re: Also, a problem of definition.Hoovaloov 1/17/12 4:59 p.m.
                       Re: Also, a problem of definition.RC Master 1/17/12 7:49 p.m.
                             Re: Also, a problem of definition.Hoovaloov 1/17/12 8:17 p.m.
                                   Re: Also, a problem of definition.RC Master 1/18/12 9:35 a.m.
                                         Re: Also, a problem of definition.Hoovaloov 1/18/12 4:29 p.m.
                                               Re: Also, a problem of definition.RC Master 1/20/12 9:48 p.m.
           Re: Your analysis is grossly incompleteFyreWulff 1/17/12 12:32 p.m.
                 Re: Your analysis is grossly incompleteFyreWulff 1/17/12 12:33 p.m.
                 Re: Your analysis is grossly incompleteSchooly D 1/17/12 1:11 p.m.
                       Re: Your analysis is grossly incompletekatancik 1/17/12 1:36 p.m.
                             Re: Your analysis is grossly incompleteHoovaloov 1/17/12 5:30 p.m.
                       Re: Your analysis is grossly incompleteFyreWulff 1/17/12 2:26 p.m.
                             Re: Your analysis is grossly incompleteHoovaloov 1/17/12 5:36 p.m.
                                   Re: Your analysis is grossly incompleteFyreWulff 1/17/12 6:12 p.m.
                                         Re: Your analysis is grossly incompleteFyreWulff 1/17/12 6:28 p.m.
                                         Re: Your analysis is grossly incompleteHoovaloov 1/18/12 1:56 a.m.
                       Re: Your analysis is grossly incompleteHoovaloov 1/17/12 5:21 p.m.
                 Re: Your analysis is grossly incompleteHoovaloov 1/17/12 5:14 p.m.
           Re: Your analysis is grossly incompleteHoovaloov 1/17/12 4:54 p.m.
                 Re: Your analysis is grossly incompleteuberfoop 1/17/12 5:13 p.m.
                       Re: Your analysis is grossly incompleteHoovaloov 1/17/12 5:19 p.m.
                             Re: Your analysis is grossly incompleteuberfoop 1/17/12 7:32 p.m.
                                   Re: Your analysis is grossly incompleteHoovaloov 1/17/12 8:21 p.m.
                                   Re: Your analysis is grossly incompleteHoovaloov 1/18/12 2:03 a.m.
                                   DMR Study Update #2 (aka for uberfoop)Hoovaloov 1/20/12 7:42 a.m.
                                         Re: DMR Study Update #2 (aka for uberfoop)uberfoop 1/20/12 2:00 p.m.
                                               Re: DMR Study Update #2 (aka for uberfoop)Hoovaloov 1/20/12 5:16 p.m.
                                         Re: DMR Study Update #2 (aka for uberfoop)RC Master 1/20/12 2:29 p.m.
                                               Re: DMR Study Update #2 (aka for uberfoop)Hoovaloov 1/20/12 6:42 p.m.
                                                     Re: DMR Study Update #3 (aka for Hoovaloov)RC Master 1/23/12 9:49 p.m.
                                                           Re: DMR Study Update #3 (aka for Hoovaloov)Hoovaloov 1/24/12 5:10 a.m.
                                                                 Edit: "pacehot" should be "headshot"Hoovaloov 1/24/12 11:39 a.m.
                                                                 re: DMR Study Update (new spreadsheet)RC Master 1/27/12 6:15 a.m.
                                                                       Re: re: DMR Study Update (new spreadsheet)Hoovaloov 1/28/12 6:20 a.m.
                                                                             Re: re: DMR Study Update (new spreadsheet)RC Master 1/28/12 11:28 a.m.
                                                                                   Re: re: DMR Study Update (new spreadsheet)Gravemind 1/28/12 2:01 p.m.
                                                                                         Re: re: DMR Study Update (new spreadsheet)RC Master 1/28/12 5:52 p.m.
                                                                                               Re: re: DMR Study Update (new spreadsheet)Gravemind 1/28/12 10:39 p.m.
                                                                                                     Whole Sandbox Is Not BrokenHoovaloov 1/31/12 4:09 p.m.
                                                                                                           I agree but...Spec ops Grunt 1/31/12 4:38 p.m.
                                                                                                                 Re: I agree but...Hoovaloov 1/31/12 4:45 p.m.
                                                                                                           No no no no no no!!!Bryan Newman 1/31/12 5:48 p.m.
                                                                                                                 Re: No no no no no no!!!Phoenix_9286 1/31/12 6:13 p.m.
                                                                                                                       I meant no disrespect...Bryan Newman 1/31/12 6:51 p.m.
                                                                                                                 Re: No no no no no no!!!kidtsunami 1/31/12 6:13 p.m.
                                                                                                           Re: Whole Sandbox Is Not BrokenSEspider 1/31/12 9:26 p.m.
                                                                                                                 Re: Whole Sandbox Is Not BrokenSpec ops Grunt 1/31/12 9:36 p.m.
                                                                                                           Re: Whole Sandbox Is Not BrokenRC Master 2/1/12 5:41 a.m.
                                                                                                                 Re: Whole Sandbox Is Not BrokenHoovaloov 2/1/12 12:33 p.m.
                                                                                                           Re: Whole Sandbox Is Not BrokenGravemind 2/3/12 4:06 a.m.
                                                                                               Re: re: DMR Study Update (new spreadsheet)General Vagueness 1/29/12 12:03 a.m.
                                                                                                     Re: re: DMR Study Update (new spreadsheet)RC Master 1/29/12 12:42 a.m.
                                                                                                           Re: re: DMR Study Update (new spreadsheet)General Vagueness 1/29/12 12:50 a.m.
                                                                                                                 Re: re: DMR Study Update (new spreadsheet)RC Master 1/29/12 12:54 a.m.
                                                                                                                       Re: re: DMR Study Update (new spreadsheet)General Vagueness 1/30/12 2:02 p.m.
                                                                                                                             Re: re: DMR Study Update (new spreadsheet)RC Master 1/30/12 9:59 p.m.
                                                                                   Re: re: DMR Study Update (new spreadsheet)Hoovaloov 1/30/12 9:22 a.m.
                                                                                         Re: re: DMR Study Update (new spreadsheet)RC Master 2/1/12 6:46 a.m.
                                                                                               All this said...RC Master 2/1/12 6:53 a.m.
                                                                                                     Re: All this said...DEEP NNN 2/1/12 7:43 a.m.
                                                                                                           Re: All this said...Hoovaloov 2/1/12 2:49 p.m.
                                                                                                                 Re: All this said...Louis Wu 2/1/12 3:00 p.m.
                                                                                                                       Re: All this said...Hoovaloov 2/1/12 3:21 p.m.
                                                                                                                             even if we hate the TUkidtsunami 2/1/12 3:50 p.m.
                                                                                                                                   Re: even if we hate the TUHoovaloov 2/1/12 4:10 p.m.
                                                                                                                                         Re: even if we hate the TUFyreWulff 2/2/12 12:39 p.m.
                                                                                                                                   Re: even if we hate the TUGravemind 2/1/12 6:52 p.m.
                                                                                                                       Re: All this said...CaneCutter 2/1/12 4:48 p.m.
                                                                                                                             Make "me" the happiest... *NM*CaneCutter 2/1/12 4:49 p.m.
                                                                                                                       Re: All this said...Gravemind 2/1/12 6:42 p.m.
                                                                                                                             Re: All this said...Hoovaloov 2/1/12 7:12 p.m.
                                                                                                                                   Re: All this said...Gravemind 2/2/12 2:23 a.m.
                                                                                                                                         Re: All this said... *IMG*Hoovaloov 2/2/12 3:28 a.m.
                                                                                                                             Re: All this said...RC Master 2/2/12 6:58 a.m.
                                                                                                                                   Re: All this said...Gravemind 2/2/12 7:36 a.m.
                                                                                                                                         wut?RC Master 2/2/12 7:46 a.m.
                                                                                                                                               Re: wut?Gravemind 2/2/12 8:28 a.m.
                                                                                                                                                     Oh, wow...RC Master 2/2/12 9:21 a.m.
                                                                                                                 Re: All this said...DEEP NNN 2/1/12 3:52 p.m.
                                                                                                                       Re: All this said...Hoovaloov 2/1/12 4:19 p.m.
                                                                                                                             Re: All this said...DEEP NNN 2/1/12 5:54 p.m.
                                                                                                                                   Re: All this said...RC Master 2/1/12 6:16 p.m.
                                                                                                                                   Re: All this said...Hoovaloov 2/1/12 6:21 p.m.
                                                                                                                                         Re: All this said...Louis Wu 2/1/12 6:31 p.m.
                                                                                                                                               ditto *NM*kidtsunami 2/1/12 6:40 p.m.
                                                                                                                                               Re: All this said...Hoovaloov 2/1/12 6:58 p.m.
                                                                                                                                         Re: All this said...DEEP NNN 2/1/12 6:47 p.m.
                                                                                                                                               Re: All this said...Hoovaloov 2/1/12 6:51 p.m.
                                                                                                                                                     Re: All this said...DEEP NNN 2/1/12 8:28 p.m.
                                                                                                                 Re: All this said...DEEP NNN 2/1/12 4:08 p.m.
                                                                                               Re: re: DMR Study Update (new spreadsheet)Hoovaloov 2/1/12 2:02 p.m.
     Re: Statistical Analysis of DMR BehaviorDEEP NNN 1/17/12 5:04 p.m.
           Re: Statistical Analysis of DMR BehaviorHoovaloov 1/17/12 5:28 p.m.
                 Re: Statistical Analysis of DMR BehaviorDEEP NNN 1/17/12 6:13 p.m.
     More numbers, better pictureRC Master 1/17/12 7:43 p.m.
           Blog Post UpdatedHoovaloov 1/18/12 1:27 a.m.
                 You misunderstand what the median is...RC Master 1/18/12 9:51 a.m.
                       Chart Updated with MediansHoovaloov 1/18/12 10:18 p.m.
     Apparently I'm a troll?RC Master 1/20/12 6:43 p.m.
           Dude. *NM*kanbo 1/20/12 6:54 p.m.
           Re: Apparently I'm a troll?DEEP NNN 1/20/12 7:04 p.m.
           I think there was trolling involved.NsU Soldier 1/20/12 7:08 p.m.
           Re: Apparently I'm a troll?SonofMacPhisto 1/20/12 7:08 p.m.
           Re: Apparently I'm a troll?Flynn J Taggart 1/20/12 8:54 p.m.
           Re: Apparently I'm a troll?Hoovaloov 1/25/12 6:45 p.m.
     DMR Study Maps+Gametypes Available In File ShareHoovaloov 1/27/12 3:29 a.m.
           Re: DMR Study Maps+Gametypes Available In File ShaRC Master 1/27/12 6:16 a.m.



contact us

The HBO Forum Archive is maintained with WebBBS 4.33.