Thought I’d go look through her drawer
He takes stuff out of the girl’s drawer to give to his next girl. He has decided that the 1st girl is too needy/high-maintenance/serious, so he just takes one more thing from her and moves on to the next girl. He has learned his lesson on this 4th time around with a girl and won’t let things get to this point with the next girl.
To help improve the meaning of these lyrics, visit "4th Time Around" by Bob Dylan Lyrics and leave a comment on the lyrics box