Madlib Sends Personal Takedown Notice for Sample Set

Is it ok to sample and not clear the rights? This is a debate that’s been going on for as long as I can remember.