“I was so into weed,” says the singer-songwriter, who still takes a different kind of trip from time to time