If your lie angle is too flat, it will make your putt left to right. That maybe the main reason, grip may not so dominant to the path.
You can refer to one of the illustration I found on the net. https://www.insidegolf.com.au/golftips/putting/the-effects-of-an-incorrect-lie-angle-on-your-putter/