The winner is AZken.
After I pulled the carb and flushed out the idle passages the real problem came to light. All three of the caps blocking off vacuum ports on the carburetor were either cracked and exposing air or the end completely gone. These are the ones that come with the Holley from new, lasted less than a year, maybe replacing them with better quality when installed could save you some headaches later. After I got it running and the idle adjusted I found that little black plate that goes in the carburetor in the with the float. maybe will replace tomorrow.
