47-55.1 *New Door Panels Not Fitting*

[Zippi]

I'm back on my door panels since I have a lot of time on my hands due to the Covid-19 pandemic. I bought some 1/8" Hardboard Tempered Panel at Home Depot and got one panel cut. I drilled the holes a little over-sized so the panel would float a little to line it up. Ran into a problem. The panel is hitting the door remote at the handle and the rod causing the panel to buckle a little at the top right and making the door handle not work very well. The spring now will not return the door handle back to it's default position. I checked the thickness of the original black board panel with calipers and it is 5/64". Not much difference in the 1/8" thick panel I have. I tried adding 1/8" washers behind the panel but still to tight. How did you guys remedy this issue when making your own door panels???