Preheat the oven to 350°F. Line the bottom of your 9x5" loaf pan with parchment paper. Grease the bottom and sides of the pan with butter and flour as well as cooking spray and set aside.
Combine all your dry ingredients onto a parchment sheet or in a large bowl and set aside.
Combine your buttermilk and vanilla extract and set aside. I also added a drop of almond extract, but that's totally optional.
Cream the butter and sugar together with a paddle attachment for 5 minutes until light and fluffy on medium-low speed. Stop the mixer and scrape the bowl and paddle well. Add in the lemon zest and juice and then add in the eggs one at a time waiting for each egg to absorb into the batter before adding the second. Note: Your batter may appear broken or curdled but that's normal because we've only added wet ingredients so far.
Next, add one third of the dry ingredients on low speed after mixing for about 20 seconds, add half of the buttermilk mixture, and mix in. Then add in more of the dry ingredients, then the rest of the buttermilk mixture before finishing off with the remaining dry ingredients. So you're alternating between the dry and wet ingredients, starting and ending with the dry. Mix until everything is just combined and then stop the mixer.
Use a rubber spatula to fold in any remaining bits of the flour and scrape the sides and bottom of the bowl well. Don't overmix! Pour the mixture into the prepared pan and bake at 350°F for 35-45 minutes or until the batter no longer jiggles and a cake tester comes out with a few moist crumbs. Let the cake cool in the pan for 10 minutes, then unmold onto a wire rack to cool slightly.