I have trouble listening to podcasts too. I find most of them to be too slow and chatty. I might be able to listen to them while I'm driving, but nowadays I don't drive much. I can listen to them while mowing the lawn and doing yard work, or while clipping counters.
I actually strongly dislike podcasts where people just talk about some topic of the day, because I find that most people don't have much to say, resulting in a low signal to noise. But I also hate talk TV shows and talk radio. I used to have to take a shuttle at work, and sports radio would always be on, droning on about something. The only podcasts I like are history or science podcasts, or maybe world affairs, but those tend to be focused on a subject and are tight and efficient.