Unofficial Review – How MGS chooses their reviewers, a non-scientific study of 18 months of member reviews.

[TBT]

1 minute ago, xOldBenKenobiX said:

I am super impressed and happy that the new way to apply for testing opportunities is driving so much traffic to the forum, I do not the details of how that data is extracted by the mods, but I would assume that with the new format, there are filters that can be applied to make that almost 6k applications, so the mods have a more manageable list of applicants to look at.

I had mentioned to @GolfSpy_THV how please I was on the new application process when it first went live.

And maybe with the forum growing and we hopefully retaining some of the traffic that comes in just for testing opportunities, there will be more official testing from different OEMs, as well as new opportunities for new MODs and behind the scenes staff.

As for the 5701 applications I would think that in the past it meant that Rob @Golfspy_CG2 and the other mods spent countess hours looking and researching applicants to narrow down the field.

Can you imagine if you had to go through 5700 applicants the old way, where they basically had to weed their way through pages and pages in a thread to pick out the actual applicant posts and filter out the posts that were just banter??? That had to be crazy!

 

This way they are presented with a list or a spreadsheet of applicants and as you said I am sure they can filter that list several ways to reduce the overall numbers.

[xOldBenKenobiX]

3 minutes ago, TBT said:

Can you imagine if you had to go through 5700 applicants the old way, where they basically had to weed their way through pages and pages in a thread to pick out the actual applicant posts and filter out the posts that were just banter??? That had to be crazy!

 

This way they are presented with a list or a spreadsheet of applicants and as you said I am sure they can filter that list several ways to reduce the overall numbers.

I can and only want to have to imagine it, I tried before going back and reading pages of applications just for fun, spoiler alert, I was wrong, it was not fun at all.

75% of my work is done with excel and power queries, so I can attest that, a good database foundation makes is much easier to do my full time job, I can hope that it makes it easier for the mods too.

[GolfSpy BOS]

5 minutes ago, xOldBenKenobiX said:

I can and only want to have to imagine it, I tried before going back and reading pages of applications just for fun, spoiler alert, I was wrong, it was not fun at all.

75% of my work is done with excel and power queries, so I can attest that, a good database foundation makes is much easier to do my full time job, I can hope that it makes it easier for the mods too.

Sounds like my day job... have you tried using Alteryx at all?  Super powerful tool for large datasets.  It's saved me a bunch of time!

[xOldBenKenobiX]

Just now, B.Boston said:

Sounds like my day job... have you tried using Alteryx at all?  Super powerful tool for large datasets.  It's saved me a bunch of time!

I have not, I will have to take a look, luckily for me, my organization is changing to using some other nifty tools that work with PowerBI and sooner than later my excel usage should be reduced to almost none.

[GolfSpy BOS]

5 minutes ago, xOldBenKenobiX said:

I have not, I will have to take a look, luckily for me, my organization is changing to using some other nifty tools that work with PowerBI and sooner than later my excel usage should be reduced to almost none.

Now I take a lot of excel flat files/database links, push them through an Alteryx model, and output the results to a Power BI dashboard... it's sooo much better than building presentations in Power Point or constantly building charts/graphs in excel.

Side note:  Sorry to 99% of the forums members who don't understand what I just wrote and could care less about excel.   

[ejgaudette]

6 minutes ago, xOldBenKenobiX said:

I have not, I will have to take a look, luckily for me, my organization is changing to using some other nifty tools that work with PowerBI and sooner than later my excel usage should be reduced to almost none.

I live in Power BI for my job and love it. Coming from Excel it was easy to pick up and get running on it. Its a great tool for visualizations and such, our org is moving almost exclusively to Power BI (our team has but other analytics teams are still moving over). I hope you like it too and happy to share more about the tool if you like.

1 minute ago, B.Boston said:

Now I take a lot of excel flat files/database links, push them through an Alteryx model, and output the results to a Power BI dashboard... it's sooo much better than building presentations in Power Point or constantly building charts/graphs in excel.

Side note:  Sorry to 99% of the forums members who don't understand what I just wrote and could care less about excel.   

Hey as a proud member of that 1% keep it coming. Power BI and data management talk all day!

[xOldBenKenobiX]

Just now, B.Boston said:

Now I take a lot of excel flat files/database links, push them through an Alteryx model, and output the results to a Power BI dashboard... it's sooo much better than building presentations in Power Point or constantly building charts/graphs in excel.

Side note:  Sorry to 99% of the forums members who don't understand what I just wrote and could care less about excel.   

I hate making power points from excel data, the main issue is that with my position, I have to present general quality data to our end clients.

For anyone that does not know, I am part of the internal inspection and quality assurance team of my company, so aside from listening to call recordings and ensuring that our IT agents are providing the appropriate support that meets the expected contractual obligations, I get to present that data to the client end, that means a lot filtration and graph creation for weekly reports, so I cannot be more excited to get it integrated to PowerBI.

Sorry for the side chatter everyone.

 

[xOldBenKenobiX]

4 minutes ago, ejgaudette said:

I live in Power BI for my job and love it. Coming from Excel it was easy to pick up and get running on it. Its a great tool for visualizations and such, our org is moving almost exclusively to Power BI (our team has but other analytics teams are still moving over). I hope you like it too and happy to share more about the tool if you like.

Hey as a proud member of that 1% keep it coming. Power BI and data management talk all day!

I am excited for the PowerBi implementation, a lot parts of our org are still using excel to upload and retrieve data to and from our SQL servers, but it is not practical and it takes forever, we have other tools that are much easier and cleaner to use for a day to day data creation and management that will go nicely with PowerBI

[GolfSpy AFG]

So, in an attempt to get this thread back on the rails (thanks for the software geek-out @B.Bostonand @xOldBenKenobiX ), I have to admit I've always been curious and would love to see a story or write-up from our mods along the lines of a day or week in the life of an MGS mod.  I know they're plenty busy already, and they can't spill all the beans about how a tester selection went down, but I'd be curious about anything they can/would share along those lines, as well as OEM interactions, other MGS mod duties, and then balancing it all with their day jobs, family, own golf game, etc.  Just food for thought @Golfspy_CG2, @GolfSpy MPR, @GolfSpy_THV ...

[Vegan_Golfer_PNW]

1 hour ago, Golfspy_CG2 said:

Where he was probably close to spot on is the reputation mean of 1.92  This is a number we look at as it separates those members who may have a high volume of posts just due to the number of years they've been hear and applying for 30 tests a year will add up.  But the reputation points that are earned for providing  quality posts will be indicated in this number.   Reputations of 2.0 or higher will go a long way in breaking any possible tie breakers when it comes down to the last spot in a test.

Even though I will be a two time tester I need to get my content rating higher...

 

I love these stats and like others have said. Goes to show the great work everyone here does. The MGS mission is strong and alive and well. It has really helped me appreciate the game more. 

[Kanoito]

4 minutes ago, Getoffmylawn said:

So, in an attempt to get this thread back on the rails (thanks for the software geek-out @B.Bostonand @xOldBenKenobiX ), I have to admit I've always been curious and would love to see a story or write-up from our mods along the lines of a day or week in the life of an MGS mod.  I know they're plenty busy already, and they can't spill all the beans about how a tester selection went down, but I'd be curious about anything they can/would share along those lines, as well as OEM interactions, other MGS mod duties, and then balancing it all with their day jobs, family, own golf game, etc.  Just food for thought @Golfspy_CG2, @GolfSpy MPR, @GolfSpy_THV ...

That would definitely be cool. An article similar to "life inside the ropes" or "tour pro undercover" tons of funny anecdotes and insights.

[xOldBenKenobiX]

11 minutes ago, Getoffmylawn said:

So, in an attempt to get this thread back on the rails (thanks for the software geek-out @B.Bostonand @xOldBenKenobiX ), I have to admit I've always been curious and would love to see a story or write-up from our mods along the lines of a day or week in the life of an MGS mod.  I know they're plenty busy already, and they can't spill all the beans about how a tester selection went down, but I'd be curious about anything they can/would share along those lines, as well as OEM interactions, other MGS mod duties, and then balancing it all with their day jobs, family, own golf game, etc.  Just food for thought @Golfspy_CG2, @GolfSpy MPR, @GolfSpy_THV ...

A day in the life of a mod should be awesome, also sometime we should try and get the mods together for a day of golf and mod appreciation.

[Golfspy_CG2]

1 hour ago, TBT said:

Can you imagine if you had to go through 5700 applicants the old way, where they basically had to weed their way through pages and pages in a thread to pick out the actual applicant posts and filter out the posts that were just banter??? That had to be crazy!

 

This way they are presented with a list or a spreadsheet of applicants and as you said I am sure they can filter that list several ways to reduce the overall numbers.

I don't have to imagine, I lived it

 

14 minutes ago, Getoffmylawn said:

So, in an attempt to get this thread back on the rails (thanks for the software geek-out @B.Bostonand @xOldBenKenobiX ), I have to admit I've always been curious and would love to see a story or write-up from our mods along the lines of a day or week in the life of an MGS mod.  I know they're plenty busy already, and they can't spill all the beans about how a tester selection went down, but I'd be curious about anything they can/would share along those lines, as well as OEM interactions, other MGS mod duties, and then balancing it all with their day jobs, family, own golf game, etc.  Just food for thought @Golfspy_CG2, @GolfSpy MPR, @GolfSpy_THV ...

You mean to get me to talk about myself or tell stories.   Man, such a large ask...ha

1 minute ago, xOldBenKenobiX said:

A day in the life of a mod should be awesome, also sometime we should try and get the mods together for a day of golf and mod appreciation.

We have tried to organize a Staff Golf Outing for a few years, going back to when @GolfSpy Barbajo ran this joint.  He tried and extended an invite to all of us to a very nice course that has been the site of multiple WGC's but alas it didn't work out schedule wise for us. 

It along with a national/regional type of MGS Member outing is something I still have on my table.

[golfish!]

12 minutes ago, Golfspy_CG2 said:

I don't have to imagine, I lived it

 

You mean to get me to talk about myself or tell stories.   Man, such a large ask...ha

We have tried to organize a Staff Golf Outing for a few years, going back to when @GolfSpy Barbajo ran this joint.  He tried and extended an invite to all of us to a very nice course that has been the site of multiple WGC's but alas it didn't work out schedule wise for us. 

It along with a national/regional type of MGS Member outing is something I still have on my table.

Regional member outings would be nice! Get to see the faces behind some of these posts...or maybe not in some cases...xP

[GolfSpy BOS]

4 minutes ago, golfish! said:

Regional member outings would be nice! Get to see the faces behind some of these posts...or maybe not in some cases...xP

I know I've posted in the NE regional thread about tournaments and such.  I'm going on a trip in June and there will be a few other Spies there for some sounds too.  You could start in that thread for where you live and see who's close by! 

 

[tony@CIC]

@TBS great thread! I'm a bit late and would only reiterate the comments many have made - including the commitment to give timely, honest and thorough feedback to the Forum members. The work clearly falls under my category of 'careful what you ask for'.

As someone who was first selected to be a tester for C-300 in 2019, I can say I had no idea of the work involved. Most first time testers probably end up feeling the same because while we think we know what's involved, we're too pumped up from being selected to think about the testing details and the time commitment. And it doesn't end with the final (stage) write-up. One only has to see the ongoing SuperSpeed thread to see that we still get posts a year later. 

Would I do it again - of course. I think it's a great experience, and a way to give unique, unfiltered insight on products back to the Forum. 

[sirchunksalot]

First off, great thread @TBS and it's been both interesting and enlightening to read all the discussion that this thread has inspired. I can only agree with the thoughts that have already been brought up, I think everyone else has covered it well.

My advice would be to simply become involved, we have many great voices in this community and having more is better. My first visit to the forum was while looking at iron reviews and, like many others, became a member because of the review opportunities. But now, it's so much more than that. The people here I've had a chance to get to know, even if just through reading here, make this a great place to spend time and talk about this game we all love. 

 

 

 

[fixyurdivot]

Interesting read/analysis.  Wow... almost $120,000 in equipment in 18 months... so very cool!!  I hadn't been with MGS too long when selected to test the PING G410P driver.  I recall just having returned from a round in Yuma, AZ and seeing the notice.  To be brutally honest, my excitement was quickly overcome with shear panic.  My thoughts quickly became... "I've never done a review like this", "I'm going to make a mess of things", the other spies will laugh at me". .  I managed my way through that learning curve and, hopefully, did it justice.  I'm still playing that driver and, with the recent shaft upgrade, doubt it will be pulled anytime soon.  Loving it so much, I've not applied for any driver test since (well, almost did on the Titleist ).

I have since been selected for the Maxfli Tour/Tour X balls, and the AlignXL Ball Marks and gave those reviews my full effort. The whole MGS Official Reviewer program is really unique and has provided me SO MUCH valuable information.  Where else can you obtain unbiased, call it like it is, feedback on the latest equipment/innovations in golf?  Marketing bling and exaggerated claims put to the test.  Between these and the MGS Hit Squad Tests, the OEM's have no where to run baby, no where to hide.

Shout out to the staff on doing a great job and to the various OEM's who are offering up their products for review!  Let's keep the nozzle on that firehose wide open.

 

[Tom the Golf Nut]

Great work on gathering all the data @TBS it must have taken quite some time.

I could have been referred to as a stalker when I first joined. All I was interested in was the reviews and most wanted testing results. It helped me narrow down some equipment choices. I'd go buy and go into sleep mode on the site. It wasn't until someone had a question about something that I was very knowledgeable about before I got involved in the forum posting. 

My story is probably similar to others. Stalking and reading but not contributing much in the beginning.  But once you get involved your hooked. The first time I was selected to test something it was a full set of irons. Probably not the norm but my handicap probably fit the need for the type of clubs to be tested. As others have stated that they don't apply for everything, I follow the same thought. It has to be something I want to try. If it is something that I wouldn't use, why would I want to test it. If it is something that I wanted to try, and was selected and it just doesn't work for me, I would have no problem giving it to another spy to try. I wouldn't try to sell it to make a buck. That's not what we are about or at least we shouldn't be.

Testing is a privilege and should be treated as such. There is a lot of work involved. But it can be a lot of fun on the way. Whenever I test I get other golfers opinions as well. I know some pretty good golfers and I let them hit the clubs or try the ball. I would have never given a thought to a direct to consumer brand it it weren't for that opportunity. Thanks MGS. They stayed in the bag. My second opportunity was for a dozen balls. I wrote the brand off years ago. But doing a full honest test was enlightening and I was impressed with how the model performed for the price. 

In closing, thanks to everyone who makes this forum what it is. And a special thank you to the Moderator's. We all know sometimes they have their hands full. 

 

 

[JohnSmalls]

On 5/13/2021 at 12:50 PM, Lacassem said:

My wife is well aware when we are able to travel and eventually move I have a whole crew of folks I will be getting rounds in with lol! She always says shes a golf widow in the summer....Atleast its not 12 months right?!

It could be 12 after you cross the Mason-Dixon!  

[GolfSpy_SHARK]

1 minute ago, JohnSmalls said:

It could be 12 after you cross the Mason-Dixon!  

Some day. Some day! Keep telling myself 10  years maybe 8 if we get lucky we will see!

[hartrick11]

This is a fantastic thread to catch up on, even the PowerBI detour! 

I am a fortunate 2x tester and my experience echoes just about everything on here. I think I was first selected with less than 150 posts under my belt (and maybe even less than 100, but no way of knowing), so I can vouch for the fact that you don't need to post any/everywhere to get a chance. Just participate earnestly in whatever way works for you and be friendly! 

I especially love reading every stage 1 review (even on products that I really don't have an interest in) so I can get a feel for each tester's golf game and writing ability. Even if it's a thread I don't ultimately participate in, I will recognize the user names that I know will provide thoughtful commentary on any thread that they pop up on in the future. 

As for the testers who mail it in when they are selected, well...

[golfish!]

On 5/13/2021 at 9:28 PM, Tom the Golf Nut said:

Great work on gathering all the data @TBS it must have taken quite some time.

I could have been referred to as a stalker when I first joined. All I was interested in was the reviews and most wanted testing results. It helped me narrow down some equipment choices. I'd go buy and go into sleep mode on the site. It wasn't until someone had a question about something that I was very knowledgeable about before I got involved in the forum posting. 

My story is probably similar to others. Stalking and reading but not contributing much in the beginning.  But once you get involved your hooked. The first time I was selected to test something it was a full set of irons. Probably not the norm but my handicap probably fit the need for the type of clubs to be tested. As others have stated that they don't apply for everything, I follow the same thought. It has to be something I want to try. If it is something that I wouldn't use, why would I want to test it. If it is something that I wanted to try, and was selected and it just doesn't work for me, I would have no problem giving it to another spy to try. I wouldn't try to sell it to make a buck. That's not what we are about or at least we shouldn't be.

Testing is a privilege and should be treated as such. There is a lot of work involved. But it can be a lot of fun on the way. Whenever I test I get other golfers opinions as well. I know some pretty good golfers and I let them hit the clubs or try the ball. I would have never given a thought to a direct to consumer brand it it weren't for that opportunity. Thanks MGS. They stayed in the bag. My second opportunity was for a dozen balls. I wrote the brand off years ago. But doing a full honest test was enlightening and I was impressed with how the model performed for the price. 

In closing, thanks to everyone who makes this forum what it is. And a special thank you to the Moderator's. We all know sometimes they have their hands full. 

 

 

Definitely agree with you that once you get active on the site you really do get hooked! You look for responses to your questions and comments and look forward to sharing your knowledge with others. I keep checking back for those notifications!

[GolfSpy_APH]

Happy to see this thread get a bump. I know we didn't have quite as many tests this last season and we had a pretty significant change in staff on the forum, but truly believe we did a great job selecting and getting need testers involved as well as some experienced testers to help those first timers.

We take a good amount of time and discussion for each Selection to ensure we are doing right by the community with those selections.

[GolfSpy AFG]

7 hours ago, GolfSpy_APH said:

Happy to see this thread get a bump. I know we didn't have quite as many tests this last season and we had a pretty significant change in staff on the forum, but truly believe we did a great job selecting and getting need testers involved as well as some experienced testers to help those first timers.

We take a good amount of time and discussion for each Selection to ensure we are doing right by the community with those selections.

Agreed; an "interesting" year for tests but it seemed to me the opportunities were distributed equitably, and most importantly, in accordance with the guidance you and the mods laid out.

[TBS]

8 hours ago, GolfSpy_APH said:

Happy to see this thread get a bump. I know we didn't have quite as many tests this last season and we had a pretty significant change in staff on the forum, but truly believe we did a great job selecting and getting need testers involved as well as some experienced testers to help those first timers.

We take a good amount of time and discussion for each Selection to ensure we are doing right by the community with those selections.

For sure! We appreciate all that you do and although I love me some juicy LIV golf discussion, I want to see that 2023 has some very lively equipment and "regular golf" discussions. 

With a job change and 1 year old I don't post as much but I've always enjoyed the community here and the more tests the more energy the forum has.

[cksurfdude]

Just caught up on this thread .. really interesting!

Many thx @TBS for the time and effort of your "meta" review

Hey Mods - possibly the initial post, at least, might be added to a recommended reading list for aspiring testers..?

[GolfSpy_APH]

7 minutes ago, cksurfdude said:

Just caught up on this thread .. really interesting!

Many thx @TBS for the time and effort of your "meta" review

Hey Mods - possibly the initial post, at least, might be added to a recommended reading list for aspiring testers..?

I'll maybe see if we can link the post to the how to become a tester thread.