Forum Testing Review Recaps!

[fixyurdivot]

Presuming staff doesn't have yet another RU Kidding Me announcement (or two) before years end, what is the current total of forum product tests/reviews for 2023?  This has to be the new record and I'm guessing it blew the previous record clean out of the pond.

Don't know about everyone else, but I'm already stoked to see what 2024's product testing has in store!

[GolfSpy_APH]

Just now, fixyurdivot said:

Presuming staff doesn't have yet another RU Kidding Me announcement (or two) before years end, what is the current total of forum product tests/reviews for 2023?  This has to be the new record and I'm guessing it blew the previous record clean out of the pond.

Don't know about everyone else, but I'm already stoked to see what 2024's product testing has in store!

I think we ended at 43. We kinda turned the page to 2024 already as reviews finishing in 2024 we consider 2024 tests.

2024 will be a different year and we won't see as many tests. Or we may have similar, but it will be spread out more to have a less chaotic nature. 

We may have some larger companies, but we found great stride and home with many of the lesser known and up and coming brands. This is an area I want to take advantage of more once again. 

Tests will also not just be the reviews... There will be more on this soon.

Requirements are going to be more significant than ever as well. Our expectations are a lot higher and we will be asking a lot more of our testers moving forward. 

Also our testing pool was pretty darn thin at the end which has also influenced our decisions on number of future tests. As that trusted pool grows so can potential opps. As that shrinks so will tests. I am still a believer in one main test per member per season. This is not a place just for free sh**. 

More to come but it will be another great season!

[TJ Hall]

11 minutes ago, GolfSpy_APH said:

I think we ended at 43. We kinda turned the page to 2024 already as reviews finishing in 2024 we consider 2024 tests.

2024 will be a different year and we won't see as many tests. Or we may have similar, but it will be spread out more to have a less chaotic nature. 

We may have some larger companies, but we found great stride and home with many of the lesser known and up and coming brands. This is an area I want to take advantage of more once again. 

Tests will also not just be the reviews... There will be more on this soon.

Requirements are going to be more significant than ever as well. Our expectations are a lot higher and we will be asking a lot more of our testers moving forward. 

Also our testing pool was pretty darn thin at the end which has also influenced our decisions on number of future tests. As that trusted pool grows so can potential opps. As that shrinks so will tests. I am still a believer in one main test per member per season. This is not a place just for free sh**. 

More to come but it will be another great season!

You guys are awesome and come up with amazing tests!  I’m sure 2024 will be just as great with the team you have assembled!

[fixyurdivot]

18 minutes ago, GolfSpy_APH said:

I think we ended at 43. We kinda turned the page to 2024 already as reviews finishing in 2024 we consider 2024 tests.

Do you know what the previous record was?  43 is crazy... nearly one/week .  Agree, not just a place for free sh##, but definitely one of the forums hallmark attributes IMO.  Just do a search on a product and we most often find links to MGS product testing; be it Most Wanted and/or Forum Tests/Reviews.  That's how I found MyGolfSpy back in 2018 while searching for new irons.

I haven't read all reviews on all products this year, but I've tried to stay current with most, and it seems that the vast majority did good jobs on reviews... but perhaps not? I know a few that ghosted on their part of the agreement years past, which is unfortunate.  But those seem to be vary few and far between which means you guys are doing a great job screening and keeping up on testers.

Anyway, I was just curious about the number being I knew it had to be a new record .  Really appreciate all the effort you guys are making running the forum and the testing.

[GolfSpy_APH]

47 minutes ago, fixyurdivot said:

Do you know what the previous record was?  43 is crazy... nearly one/week .  Agree, not just a place for free sh##, but definitely one of the forums hallmark attributes IMO.  Just do a search on a product and we most often find links to MGS product testing; be it Most Wanted and/or Forum Tests/Reviews.  That's how I found MyGolfSpy back in 2018 while searching for new irons.

I haven't read all reviews on all products this year, but I've tried to stay current with most, and it seems that the vast majority did good jobs on reviews... but perhaps not? I know a few that ghosted on their part of the agreement years past, which is unfortunate.  But those seem to be vary few and far between which means you guys are doing a great job screening and keeping up on testers.

Anyway, I was just curious about the number being I knew it had to be a new record .  Really appreciate all the effort you guys are making running the forum and the testing.

It was definitely more crammed this season then we would have preferred, but we had a bit of a late start as well. 

I expect it all to flow a little better this season. 

Unfortunately we had several reviews which were not completed or fell well short or our expectations. Meaning those testers will either not ever be back or it will be some time. When the mods have more posts in a thread then testers (which the mods are not participating in) it's a telling story for us. 

Thankfully we still have many good and great testers. We took some chances here and there when we felt we could or needed to and some paid off some didn't. 

We are revamping a little bit with a call prior with testers, a new T&C's form which must be completed prior to full acceptance. Bottom line if a tester is not meeting expectations we will have no issues pulling the plug and having them forward the equipment to a new tester. This will be done at their expense. And trust me we are persistent with this. 

[Rob Person]

1 hour ago, GolfSpy_APH said:

 Bottom line if a tester is not meeting expectations we will have no issues pulling the plug and having them forward the equipment to a new tester. This will be done at their expense. And trust me we are persistent with this. 

Please let me know if this occurs with any I post! 

[TJ Hall]

36 minutes ago, Rob Person said:

Please let me know if this occurs with any I post! 

Same here!

[GolfSpy_APH]

44 minutes ago, Rob Person said:

Please let me know if this occurs with any I post! 

 

7 minutes ago, TJ Hall said:

Same here!

Provided the tester reads all instructions and follows the template/guidelines and communicates with us regarding deadlines there isn't much of an issue. 

Unfortunately some ppl have a really hard time reading and following basic instructions!

[TJ Hall]

9 minutes ago, GolfSpy_APH said:

 

Provided the tester reads all instructions and follows the template/guidelines and communicates with us regarding deadlines there isn't much of an issue. 

Unfortunately some ppl have a really hard time reading and following basic instructions!

That is very apparent from some of the recent re-test postings!

[Javs]

21 minutes ago, GolfSpy_APH said:

 

Provided the tester reads all instructions and follows the template/guidelines and communicates with us regarding deadlines there isn't much of an issue. 

Unfortunately some ppl have a really hard time reading and following basic instructions!

Please let me know immediately if at anytime I am not meeting the mail/requirements!

[fixyurdivot]

34 minutes ago, GolfSpy_APH said:

 

Provided the tester reads all instructions and follows the template/guidelines and communicates with us regarding deadlines there isn't much of an issue. 

Unfortunately some ppl have a really hard time reading and following basic instructions!

Meanwhile, somewhere in an undisclosed location, justice is being served .

[CFreddie]

2 hours ago, GolfSpy_APH said:

It was definitely more crammed this season then we would have preferred, but we had a bit of a late start as well. 

I expect it all to flow a little better this season. 

Unfortunately we had several reviews which were not completed or fell well short or our expectations. Meaning those testers will either not ever be back or it will be some time. When the mods have more posts in a thread then testers (which the mods are not participating in) it's a telling story for us. 

Thankfully we still have many good and great testers. We took some chances here and there when we felt we could or needed to and some paid off some didn't. 

We are revamping a little bit with a call prior with testers, a new T&C's form which must be completed prior to full acceptance. Bottom line if a tester is not meeting expectations we will have no issues pulling the plug and having them forward the equipment to a new tester. This will be done at their expense. And trust me we are persistent with this. 

Frustrating to hear this, but with the amount of tests, I guess it’s bound to happen. Looking forward to seeing the changes in 2024, and excited about the next group of tests in the new year!

[Tom the Golf Nut]

Unfortunate that there are some that have the “take the money and run “ attitude. 
I hope that 2024 has less. Looking forward to the new season and all it brings.

[Dweed]

7 hours ago, GolfSpy_APH said:

Requirements are going to be more significant than ever as well. Our expectations are a lot higher and we will be asking a lot more of our testers moving forward. 

Also our testing pool was pretty darn thin at the end which has also influenced our decisions on number of future tests. As that trusted pool grows so can potential opps. As that shrinks so will tests. I am still a believer in one main test per member per season. This is not a place just for free sh**. 

More to come but it will be another great season!

First off Jamie, Hats off to all of you for your hard work and dedication. You all are Outstanding.  As related to your testing pool being thin, its hard to participate in some when many of us realize that due to weather, our season is closing. Totally agree this isn't a place for freebies.  Testers spend a lot of time in these. At least I believe they do. Again great job guys and thanks to all those out there that do read the test results. It's our opinion and we appreciate people reading them.

[Shapotomous]

5 hours ago, TJ Hall said:

That is very apparent from some of the recent re-test postings!

It is kinda funny to see how many don't read the instructions but it also serves as the initial weeding out process!  If they cant follow those simple instructions how likely are they to follow the template and do an adequate review?!

[KC Golf]

The Mods have been great getting tests for us so the least the forum readers can do is follow through with some solid reviews.  I agree it just takes some effort / attention to detailed instructions,but the testing process is well worth it for all concerned. 

Looking forward to seeing the new testing opportunities in 2024. 

[Syks7]

Just wanted to say thanks for the opportunities this year.  I had a ton of fun.

[GolfSpy_APH]

14 hours ago, Syks7 said:

Just wanted to say thanks for the opportunities this year.  I had a ton of fun.

Great to have you as a tester!

So many cool opportunities this last year, so many great testers and reviews. Was a fun season!

[Berg Ryman]

So, just to chime in here, I do think with what @GolfSpy_APH is saying here, we can hopefully get to something we discussed in the focus group, which was also the traction of these reviews.

By a slower drip of reviews/demanding more engaging content/better quality of the reviewer pool/just less cramming of reviewers into a shorter time frame, it can allow those reviews that really can and should be driven and shaped by questions and thoughts of those reading along the ability to get more eyes and engagement in them, which should only make them better for those taking them on and more informative for those following.

As someone who was involved in two recent reviews that seemingly went pear-shaped, one because the company shut down midway through, one due to some self inflicted issues and shortcomings, I understand both the concerns of the reader base and the mods for wanting to get this right and commend them for addressing this in such a manner and style to make sure it happens.

[GolfSpy_APH]

10 minutes ago, Berg Ryman said:

So, just to chime in here, I do think with what @GolfSpy_APH is saying here, we can hopefully get to something we discussed in the focus group, which was also the traction of these reviews.

By a slower drip of reviews/demanding more engaging content/better quality of the reviewer pool/just less cramming of reviewers into a shorter time frame, it can allow those reviews that really can and should be driven and shaped by questions and thoughts of those reading along the ability to get more eyes and engagement in them, which should only make them better for those taking them on and more informative for those following.

As someone who was involved in two recent reviews that seemingly went pear-shaped, one because the company shut down midway through, one due to some self inflicted issues and shortcomings, I understand both the concerns of the reader base and the mods for wanting to get this right and commend them for addressing this in such a manner and style to make sure it happens.

The staff have a lot of discussion on all of this. There are some that do a very underwhelming review and then say things along the lines of well it's a small product.

In the eyes of the forum staff there is no such thing as a small product. Each product is important to the company providing it and often the smaller ones are the ones that readers are more interesting in trying. 

Sure the big ticket tests are great, but not nearly as many are going to be buying these products. Our expectations for all reviews are high and mailing it in or just putting half effort into a smaller item tells us a lot about what kind of tester we can expect. Same goes for the opposite side... Rock a ball review and you can expect us to be calling on you again soon.

The flip side, don't expect anything anytime soon. 

Our forum reviews with these recaps get more exposure then they ever have before. The companies notice, members, staff, hq and more. 

Not only that we communicate deadlines to the OEMs. When a tester misses that (unexcused) it's noticeable.

I could go on, but the staff expect a lot and we are working hard to help improve the short comings on engagement to promote them throughout the process.

The recaps have been fantastic and all the companies we have done them for have loved them.

[GolfSpy_APH]

https://mygolfspy.com/we-tried-it/forum-member-review-birdieball-2-in-1-golf-mat/

Another one up and done!

[No3PuttLaLa]

I know the mid team reviews the testing posts, but is there discussion to share that with the testers? Could be beneficial to basically see how you were graded on your review.

That said, I know that then puts more work load on Mods with limited time and resources. May have already been discussed as well, so tell me to kick rocks if I’m missing a point.

More than anything, we appreciate all you do to allow us the opportunity to test. And extremely sorry for the few that ruin it. 

[GolfSpy_APH]

1 minute ago, No3PuttLaLa said:

I know the mid team reviews the testing posts, but is there discussion to share that with the testers? Could be beneficial to basically see how you were graded on your review.

That said, I know that then puts more work load on Mods with limited time and resources. May have already been discussed as well, so tell me to kick rocks if I’m missing a point.

More than anything, we appreciate all you do to allow us the opportunity to test. And extremely sorry for the few that ruin it. 

Good question! It's been asked before, but always worth repeating.

If a tester wants to know their grade and feedback all they need to do is ask. 

We won't make them publicly available to all, but an individual tester can always ask for their own review grades.

[Rob Person]

I keep seeing these pop up on IG. Interesting product. The review has a few things that concern me. Biggest one being space to use it, and the ability to NOT create repetitive strokes. ( I know you can add breaks in it)  I would love to put something like this in my spare room though.

[Syks7]

42 minutes ago, GolfSpy_APH said:

The staff have a lot of discussion on all of this. There are some that do a very underwhelming review and then say things along the lines of well it's a small product.

In the eyes of the forum staff there is no such thing as a small product. Each product is important to the company providing it and often the smaller ones are the ones that readers are more interesting in trying. 

Sure the big ticket tests are great, but not nearly as many are going to be buying these products. Our expectations for all reviews are high and mailing it in or just putting half effort into a smaller item tells us a lot about what kind of tester we can expect. Same goes for the opposite side... Rock a ball review and you can expect us to be calling on you again soon.

The flip side, don't expect anything anytime soon. 

Our forum reviews with these recaps get more exposure then they ever have before. The companies notice, members, staff, hq and more. 

Not only that we communicate deadlines to the OEMs. When a tester misses that (unexcused) it's noticeable.

I could go on, but the staff expect a lot and we are working hard to help improve the short comings on engagement to promote them throughout the process.

The recaps have been fantastic and all the companies we have done them for have loved them.

I think one helpful thing might be an explanation of how much time it takes to do one of these tests, particularly for forum testers who don't do this all the time.  You really can't cram for these things and do a decent test.  The test template is great for the writing portion, particularly for someone that doesn't have any writing background, so it might make sense to provide a timeline template to better help testers understand when they should probably be doing certain things with the test.  E.G.  

Step 1:  (Day 1) Read this template

Step 2:  (Day 2) Decide whether or not this template can be accomplished with your schedule over the next X months.  Accept or Decline

Step 3:  Write Intro (First week)

Step 4:  Receive the product:  Take pictures of the unboxing, write down some thoughts.

Step 5:  Etc..., etc....

It doesn't necessarily have to be this prescriptive but a good illustration of just how long it takes to write a review for someone that doesn't do it regularly, along with just how much you time you need to commit to using the product to get a feel for it might go a long way to improving quality.

 

[CLenahan]

16 hours ago, Syks7 said:

Just wanted to say thanks for the opportunities this year.  I had a ton of fun.

Same here!  It was a ton of fun testing and getting to try something really new on the market

[GolfSpy_APH]

1 minute ago, Syks7 said:

I think one helpful thing might be an explanation of how much time it takes to do one of these tests, particularly for forum testers who don't do this all the time.  You really can't cram for these things and do a decent test.  The test template is great for the writing portion, particularly for someone that doesn't have any writing background, so it might make sense to provide a timeline template to better help testers understand when they should probably be doing certain things with the test.  E.G.  

Step 1:  (Day 1) Read this template

Step 2:  (Day 2) Decide whether or not this template can be accomplished with your schedule over the next X months.  Accept or Decline

Step 3:  Write Intro (First week)

Step 4:  Receive the product:  Take pictures of the unboxing, write down some thoughts.

Step 5:  Etc..., etc....

It doesn't necessarily have to be this prescriptive but a good illustration of just how long it takes to write a review for someone that doesn't do it regularly, along with just how much you time you need to commit to using the product to get a feel for it might go a long way to improving quality.

 

While not step by step, that information is there. We give dates and timelines for introduction (due one week after selections), unboxing post (due within a week of getting the product), then minimum one post or summary per week. While we encourage more.

Then we give at least a 2-3 week lead time for when the review is due.

We are updating the template a bit to provide some examples of standout reviews, post minimum for testing period and more.

One thing I always remember was how motivated I was for my first opportunity. I put hours and hours into writing, doing data collection, updates, photos, working to get conversations going in the thread and the final review itself. That was without hand holding and or being babysat throughout. As a staff member I expect at least 50% of that effort. 

With so many testers and reviews I don't want to get into the habit of babysitting testers through reviews. We are here to help, aid and assist when testers need it. 

The PM is there for support for all testers between tester and staff. Plus we nearly always have one more experienced member involved. 

Again there are updates to the template to help a bit more, but that also assumed testers actually read the full thing which often doesnt happen. Maybe I need a trick question at the end? Haha

I guess what I'm trying to say is in the feedback form we sent to many of the testers the template and guidelines never came up as an issue and we still worked a bit to improve it. I am confident in it and the staffs ability to help or answer questions testers have. Add in the number of testers and tests we have all with all the other priorities babysitting reviews isn't one I really want to do as there should be adequate motivation there to provide excellent reviews.

[Alan Scalzi]

With all the responses to this topic,  I for one as being selected to do a review can relate to this topic.  When I was chosen to do the review for Galway Bay I was thinking of all those members whom had to go to the range and or course to tryout the gear, which takes alot of time, but the most important thing the members have to realize when being chosen is they need to spend time using the products and give a good review as the product cost someone money and they are not cheep! The using the product and the review time is a payment for your help. As I have used others reviews to make  a financial decision to purchase some of the products! Hope this help from the eye of one of the selected testers for 2023! Thanks again for selecting me and all you guys do to help educate and research for us.

[Syks7]

5 minutes ago, GolfSpy_APH said:

One thing I always remember was how motivated I was for my first opportunity. I put hours and hours into writing, doing data collection, updates, photos, working to get conversations going in the thread and the final review itself. That was without hand holding and or being babysat throughout.

Again there are updates to the template to help a bit more, but that also assumed testers actually read the full thing which often doesnt happen. Maybe I need a trick question at the end? Haha

Same for me.  I really wanted to do a good job.  I'm lucky that what I do for a living that makes breaking a large task (like a review) into multiple pieces over a long timeline to make sure to meet deadlines a reasonably straight forward exercise. 

I like the current template and it does an excellent job of explicitly telling the reviewer what should be in the review, how to apply scoring,  and how to structure the writing (including some timelines).  I just think that a good update to it should include some hard facts about how much time may be required to actually write it and how much time should be spent with the product (at the range, on the green, etc.) to really get a good enough feel to write it.  I don't think this will get rid of the folks who are just trying to get a free product, but I think it might help the quality and and ensure that the reviews arrive more or less on time.

 

[BobBC78]

As a first-time reviewer this year, I found the template and timeline to be very helpful guidance. Also, looking at reviews prior testers had done on various products proved to be helpful. 

Kudos to the staff (in my case @GolfSpy_APH) for scheduling a pre-test call, which I found very helpful, and PM access to staff, fellow testers and company reps during the testing process. It was a terrific experience and I hope readers, particularly those over 60, found my comments helpful.